Sep 04 22:32:56 devstack cinder-volume[76605]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 04 22:32:56 devstack cinder-volume[76605]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 04 22:32:56 devstack cinder-volume[76605]: we strongly recommend against using it for new projects. Sep 04 22:32:56 devstack cinder-volume[76605]: If you are already using Eventlet, we recommend migrating to a different Sep 04 22:32:56 devstack cinder-volume[76605]: framework. For more detail see Sep 04 22:32:56 devstack cinder-volume[76605]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 04 22:32:56 devstack cinder-volume[76605]: import eventlet # noqa Sep 04 22:32:58 devstack cinder-volume[76605]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76605) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 04 22:32:58 devstack cinder-volume[76605]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76605) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 04 22:32:58 devstack cinder-volume[76605]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76605) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 04 22:32:59 devstack cinder-volume[76605]: INFO dbcounter [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] Registered counter for database cinder Sep 04 22:32:59 devstack cinder-volume[76605]: DEBUG oslo_db.sqlalchemy.engines [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76605) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 22:33:00 devstack cinder-volume[76605]: DEBUG dbcounter [-] [76605] Writer thread running {{(pid=76605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 04 22:33:00 devstack cinder-volume[76605]: INFO cinder.rpc [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 04 22:33:00 devstack cinder-volume[76605]: INFO cinder.rpc [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 04 22:33:00 devstack cinder-volume[76605]: DEBUG oslo_db.sqlalchemy.engines [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76605) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 22:33:00 devstack cinder-volume[76605]: INFO cinder.volume.manager [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] Determined volume DB was empty at startup. Sep 04 22:33:00 devstack cinder-volume[76605]: DEBUG cinder.volume.manager [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76605) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 04 22:33:00 devstack cinder-volume[76605]: INFO cinder.volume.manager [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 04 22:33:00 devstack cinder-volume[76605]: WARNING stevedore.named [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 04 22:33:00 devstack cinder-volume[76605]: WARNING castellan.key_manager [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 04 22:33:00 devstack cinder-volume[76605]: WARNING cinder.keymgr.conf_key_mgr [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 04 22:33:00 devstack cinder-volume[76605]: DEBUG cinder.volume.drivers.lvm [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76605) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 04 22:33:00 devstack cinder-volume[76605]: DEBUG oslo_concurrency.processutils [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:33:00 devstack cinder-volume[76605]: DEBUG oslo_concurrency.processutils [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] CMD "cinder-rtstool verify" returned: 0 in 0.431s {{(pid=76605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:33:00 devstack cinder-volume[76605]: DEBUG oslo_db.sqlalchemy.engines [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76605) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 22:33:00 devstack cinder-volume[76605]: INFO cinder.rpc [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 04 22:33:00 devstack cinder-volume[76605]: INFO cinder.rpc [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 04 22:33:00 devstack cinder-volume[76605]: WARNING stevedore.named [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 04 22:33:00 devstack cinder-volume[76605]: WARNING castellan.key_manager [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 04 22:33:00 devstack cinder-volume[76605]: INFO cinder.volume.manager [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 04 22:33:00 devstack cinder-volume[76605]: DEBUG oslo_db.sqlalchemy.engines [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76605) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 22:33:01 devstack cinder-volume[76605]: INFO oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] Starting 1 workers Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] Started child 76758 {{(pid=76605) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] Full set of CONF: {{(pid=76605) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] ******************************************************************************** {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] Configuration options gathered from: {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 04 22:33:01 devstack cinder-volume[76758]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] ================================================================================ {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] allow_availability_zone_fallback = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] allow_compression_on_image_upload = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] allowed_direct_url_schemes = [] {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] api_rate_limit = True {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] auth_strategy = keystone {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] az_cache_duration = 3600 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_availability_zone = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_host = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_name = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_stats_polling_interval = 60 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backup_api_class = cinder.backup.api.API {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backup_name_template = backup-%s {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backup_use_same_host = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backup_use_temp_snapshot = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] chap_password = **** {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] chap_username = {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] cinder_internal_tenant_project_id = 723ec54d689b4886aa80ce901f11243d {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] cinder_internal_tenant_user_id = 5a8695562b3248888ba7bcb6c1068b32 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] cloned_volume_same_az = True {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] cluster = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] compression_format = gzip {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] compute_api_class = cinder.compute.nova.API {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] config_dir = [] {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] config_source = [] {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] control_exchange = openstack {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] debug = True {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] default_availability_zone = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] default_group_type = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] default_volume_type = lvmdriver-1 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] disk_geometry = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] driver_client_cert = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] driver_client_cert_key = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] driver_data_namespace = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] driver_ssl_cert_path = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] driver_ssl_cert_verify = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] driver_use_ssl = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] enable_force_upload = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] enable_new_services = True {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] enable_unsupported_driver = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] enabled_backends = ['lvmdriver-1'] {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] enforce_multipath_for_image_xfer = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] filter_function = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] glance_api_insecure = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] glance_api_servers = ['http://192.168.122.214/image'] {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] glance_api_ssl_compression = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] glance_ca_certificates_file = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] glance_catalog_info = image:glance:publicURL {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] glance_certfile = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] glance_keyfile = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] glance_num_retries = 3 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] glance_request_timeout = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] goodness_function = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] graceful_shutdown_timeout = 5 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] group_api_class = cinder.group.api.API {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] host = devstack {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76758]: INFO cinder.volume.manager [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 04 22:33:01 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] image_compress_on_upload = True {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] image_conversion_address_space_limit = 1 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] image_conversion_cpu_limit = 60 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] image_conversion_disable = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] image_upload_use_cinder_backend = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] image_upload_use_internal_tenant = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] image_volume_cache_enabled = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] image_volume_cache_max_count = 0 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] image_volume_cache_max_size_gb = 0 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] init_host_max_objects_retrieval = 0 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] instance_format = [instance: %(uuid)s] {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] iscsi_target_flags = {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] iscsi_write_cache = on {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] iser_helper = tgtadm {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] iser_ip_address = 192.168.122.214 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] iser_port = 3260 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] log_color = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] log_config_append = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] log_dir = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] log_file = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] log_options = True {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] log_rotate_interval = 1 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] log_rotate_interval_type = days {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] log_rotation_type = none {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] max_age = 0 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] max_logfile_count = 30 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] max_logfile_size_mb = 200 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] max_over_subscription_ratio = 20.0 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] message_reap_interval = 86400 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] message_ttl = 2592000 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] migration_create_volume_timeout_secs = 300 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] monkey_patch = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] monkey_patch_modules = [] {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] my_ip = 192.168.122.214 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] no_snapshot_gb_quota = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] num_iser_scan_tries = 3 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] num_shell_tries = 3 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] num_volume_device_scan_tries = 3 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] nvmeof_conn_info_version = 1 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] nvmet_ns_id = 10 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] nvmet_port_id = 1 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] osapi_max_limit = 1000 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] osapi_volume_ext_list = [] {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:33:01 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] osapi_volume_listen = 0.0.0.0 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] osapi_volume_listen_port = 8776 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] osapi_volume_use_ssl = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] osapi_volume_workers = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] per_volume_size_limit = -1 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] periodic_fuzzy_delay = 60 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] periodic_interval = 60 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] project_id_regex = [0-9a-f\-]+ {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] public_endpoint = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] publish_errors = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] quota_backup_gigabytes = 1000 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] quota_backups = 10 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] quota_gigabytes = 1000 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] quota_groups = 10 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] quota_snapshots = 10 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] quota_volumes = 10 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] rate_limit_burst = 0 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] rate_limit_except_level = CRITICAL {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] rate_limit_interval = 0 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] reinit_driver_count = 3 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] replication_device = **** {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] report_discard_supported = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] report_interval = 120 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] reservation_clean_interval = 86400 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] reservation_expire = 86400 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] reserved_image_namespaces = [] {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] reserved_percentage = 0 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] rpc_response_timeout = 120 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] run_external_periodic_tasks = True {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] scst_target_driver = iscsi {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] scst_target_iqn_name = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] service_down_time = 720 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] shell_completion = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] snapshot_name_template = snapshot-%s {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] snapshot_same_host = True {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] split_loggers = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] state_path = /opt/stack/data/cinder {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] storage_availability_zone = nova {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] storage_protocol = iSCSI {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] syslog_log_facility = LOG_USER {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] target_helper = lioadm {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] target_ip_address = 192.168.122.214 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] target_port = 3260 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] target_protocol = iscsi {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] target_secondary_ip_addresses = [] {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] trace_flags = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] transfer_api_class = cinder.transfer.api.API {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] transport_url = **** {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] until_refresh = 0 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] use_chap_auth = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] use_default_quota_class = True {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] use_journal = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] use_json = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] use_multipath_for_image_xfer = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] use_stderr = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] use_syslog = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] verify_glance_signatures = enabled {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] volume_api_class = cinder.volume.api.API {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] volume_backend_name = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] volume_clear = zero {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] volume_clear_ionice = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] volume_clear_size = 0 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] volume_copy_bps_limit = 0 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] volume_dd_blocksize = 1M {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] volume_name_template = volume-%s {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] volume_service_inithost_offload = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack sudo[76762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 04 22:33:01 devstack sudo[76762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] volume_usage_audit_period = month {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] zoning_mode = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] oslo_concurrency.disable_process_locking = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] keystone_authtoken.auth_section = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] keystone_authtoken.auth_type = password {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] keystone_authtoken.auth_version = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] keystone_authtoken.cache = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] keystone_authtoken.certfile = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] keystone_authtoken.delay_auth_decision = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] keystone_authtoken.http_connect_timeout = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] keystone_authtoken.include_service_catalog = True {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] keystone_authtoken.insecure = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] keystone_authtoken.interface = public {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] keystone_authtoken.keyfile = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] keystone_authtoken.memcache_password = **** {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] keystone_authtoken.memcache_username = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] keystone_authtoken.region_name = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] keystone_authtoken.service_token_roles_required = True {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] keystone_authtoken.service_type = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] keystone_authtoken.token_cache_time = 300 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.214/identity {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] cache.backend = dogpile.cache.null {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] cache.backend_argument = **** {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] cache.backend_expiration_time = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] cache.config_prefix = cache.oslo {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] cache.debug_cache_backend = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] cache.enable_retry_client = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] cache.enable_socket_keepalive = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] cache.enabled = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] cache.expiration_time = 600 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] cache.hashclient_retry_attempts = 2 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] cache.memcache_dead_retry = 300 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] cache.memcache_pool_maxsize = 10 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] cache.memcache_sasl_enabled = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] cache.password = **** {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] cache.proxies = [] {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] cache.redis_db = 0 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] cache.redis_sentinel_service_name = mymaster {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] cache.redis_server = localhost:6379 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] cache.retry_attempts = 2 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] cache.retry_delay = 0.0 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] cache.socket_keepalive_count = 1 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] cache.socket_keepalive_idle = 1 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] cache.socket_keepalive_interval = 1 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] cache.socket_timeout = 1.0 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] cache.tls_allowed_ciphers = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] cache.tls_cafile = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] cache.tls_certfile = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] cache.tls_enabled = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] cache.tls_keyfile = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] cache.username = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] coordination.backend_url = **** {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] database.asyncio_connection = **** {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] database.asyncio_slave_connection = **** {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] database.backend = sqlalchemy {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] database.connection = **** {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] database.connection_debug = 0 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] database.connection_parameters = {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] database.connection_recycle_time = 3600 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] database.connection_trace = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] database.db_inc_retry_interval = True {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] database.db_max_retries = 20 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] database.db_max_retry_interval = 10 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] database.db_retry_interval = 1 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] database.max_overflow = 50 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] database.max_pool_size = 5 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] database.max_retries = 10 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] database.mysql_wsrep_sync_wait = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] database.pool_timeout = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] database.retry_interval = 10 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] database.slave_connection = **** {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] database.sqlite_synchronous = True {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] database.synchronous_reader = True {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] database.use_db_reconnect = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] oslo_messaging_tracing.insecure = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] profiler.connection_string = messaging:// {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] profiler.enabled = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] profiler.es_doc_type = notification {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] profiler.es_scroll_size = 10000 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] profiler.es_scroll_time = 2m {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] profiler.filter_error_trace = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] profiler.hmac_keys = **** {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] profiler.sentinel_service_name = mymaster {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] profiler.socket_timeout = 0.1 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] profiler.trace_requests = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] profiler.trace_sqlalchemy = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] profiler_jaeger.process_tags = {} {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] profiler_jaeger.service_name_prefix = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] profiler_otlp.service_name_prefix = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] oslo_policy.enforce_new_defaults = True {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] oslo_policy.policy_default_rule = default {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] oslo_policy.policy_file = policy.yaml {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] oslo_policy.remote_timeout = 60.0 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] privsep_osbrick.group = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] privsep_osbrick.helper_command = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] privsep_osbrick.user = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] cinder_sys_admin.group = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] cinder_sys_admin.helper_command = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] cinder_sys_admin.user = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] service_user.auth_section = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] service_user.auth_type = password {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] service_user.cafile = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] service_user.certfile = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] service_user.collect_timing = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] service_user.insecure = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] service_user.keyfile = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] service_user.send_service_user_token = True {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] service_user.split_loggers = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] service_user.timeout = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] service_user.tls_ciphers = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] service_user.tls_min_version = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] glance.auth_section = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] glance.auth_type = password {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] glance.certfile = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] glance.collect_timing = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] glance.insecure = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] glance.keyfile = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] glance.region_name = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] glance.split_loggers = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] glance.timeout = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] glance.tls_ciphers = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] glance.tls_min_version = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_defaults.backend_availability_zone = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_defaults.chap_password = **** {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_defaults.chap_username = {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_defaults.disk_geometry = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_defaults.driver_client_cert = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_defaults.driver_client_cert_key = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_defaults.driver_data_namespace = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_defaults.driver_use_ssl = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_defaults.enable_unsupported_driver = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_defaults.extra_capabilities = {} {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_defaults.filter_function = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_defaults.goodness_function = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_defaults.iscsi_target_flags = {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_defaults.iscsi_write_cache = on {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_defaults.iser_helper = tgtadm {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_defaults.iser_ip_address = 192.168.122.214 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_defaults.iser_port = 3260 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_defaults.lvm_mirrors = 0 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_defaults.lvm_share_target = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_defaults.lvm_type = auto {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_defaults.num_shell_tries = 3 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_defaults.nvmet_port_id = 1 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_defaults.replication_device = **** {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_defaults.report_discard_supported = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_defaults.reserved_percentage = 0 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_defaults.scst_target_driver = iscsi {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_defaults.scst_target_iqn_name = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_defaults.storage_protocol = iSCSI {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_defaults.target_helper = tgtadm {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_defaults.target_ip_address = 192.168.122.214 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_defaults.target_port = 3260 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_defaults.target_protocol = iscsi {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_defaults.trace_flags = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_defaults.unique_fqdn_network = True {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_defaults.use_chap_auth = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_defaults.volume_backend_name = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_defaults.volume_clear = zero {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_defaults.volume_clear_ionice = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_defaults.volume_clear_size = 0 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_defaults.volume_group = cinder-volumes {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] oslo_reports.file_event_handler = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] oslo_reports.log_dir = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] lvmdriver-1.backend_availability_zone = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] lvmdriver-1.backend_host = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] lvmdriver-1.chap_password = **** {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] lvmdriver-1.chap_username = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] lvmdriver-1.chiscsi_conf = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] lvmdriver-1.disk_geometry = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] lvmdriver-1.driver_client_cert = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] lvmdriver-1.driver_data_namespace = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] lvmdriver-1.driver_use_ssl = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] lvmdriver-1.extra_capabilities = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] lvmdriver-1.filter_function = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] lvmdriver-1.goodness_function = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] lvmdriver-1.iser_helper = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] lvmdriver-1.iser_ip_address = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] lvmdriver-1.iser_port = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] lvmdriver-1.iser_target_prefix = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] lvmdriver-1.lvm_conf_file = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] lvmdriver-1.lvm_mirrors = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] lvmdriver-1.lvm_share_target = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] lvmdriver-1.lvm_type = auto {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] lvmdriver-1.num_shell_tries = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] lvmdriver-1.nvmet_port_id = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] lvmdriver-1.replication_device = **** {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] lvmdriver-1.report_discard_supported = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] lvmdriver-1.reserved_percentage = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] lvmdriver-1.scst_target_driver = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] lvmdriver-1.storage_protocol = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] lvmdriver-1.target_helper = lioadm {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] lvmdriver-1.target_ip_address = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] lvmdriver-1.target_port = 3260 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] lvmdriver-1.target_protocol = iscsi {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] lvmdriver-1.trace_flags = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] lvmdriver-1.use_chap_auth = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] lvmdriver-1.volume_clear = zero {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] lvmdriver-1.volume_clear_size = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] lvmdriver-1.volumes_dir = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] oslo_messaging_rabbit.ssl = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] oslo_messaging_rabbit.ssl_version = {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] oslo_messaging_notifications.driver = [] {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] oslo_messaging_notifications.retry = -1 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] oslo_messaging_notifications.transport_url = **** {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] key_manager.fixed_key = **** {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] barbican.barbican_api_version = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] barbican.barbican_endpoint = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] barbican.barbican_endpoint_type = public {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] barbican.barbican_region_name = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] barbican.cafile = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] barbican.certfile = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] barbican.collect_timing = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] barbican.insecure = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] barbican.keyfile = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] barbican.number_of_retries = 60 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] barbican.retry_delay = 1 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] barbican.send_service_user_token = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] barbican.split_loggers = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] barbican.timeout = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] barbican.tls_ciphers = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] barbican.tls_min_version = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] barbican.verify_ssl = True {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] barbican.verify_ssl_path = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] barbican_service_user.auth_section = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] barbican_service_user.auth_type = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] barbican_service_user.cafile = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] barbican_service_user.certfile = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] barbican_service_user.collect_timing = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] barbican_service_user.insecure = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] barbican_service_user.keyfile = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] barbican_service_user.split_loggers = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] barbican_service_user.timeout = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] barbican_service_user.tls_ciphers = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] barbican_service_user.tls_min_version = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] vault.approle_role_id = **** {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] vault.approle_secret_id = **** {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] vault.auth_method = approle {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] vault.auth_path = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] vault.kv_mountpoint = secret {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] vault.kv_path = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] vault.kv_version = 2 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] vault.namespace = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] vault.root_token_id = **** {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] vault.ssl_ca_crt_file = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] vault.timeout = 60.0 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] vault.token_file = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] vault.token_role = None {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] vault.use_ssl = False {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:33:01 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] ******************************************************************************** {{(pid=76605) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 04 22:33:01 devstack sudo[76762]: pam_unix(sudo:session): session closed for user root Sep 04 22:33:01 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.404s {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:33:01 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:33:01 devstack sudo[76766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 22:33:01 devstack sudo[76766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:33:01 devstack sudo[76766]: pam_unix(sudo:session): session closed for user root Sep 04 22:33:01 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.368s {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:33:01 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 22:33:01 devstack cinder-volume[76758]: INFO cinder.brick.local_dev.lvm [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 04 22:33:01 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:33:01 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:33:01 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:33:02 devstack sudo[76928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 04 22:33:02 devstack sudo[76928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:33:02 devstack sudo[76928]: pam_unix(sudo:session): session closed for user root Sep 04 22:33:02 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.291s {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:33:02 devstack cinder-volume[76758]: DEBUG cinder.brick.local_dev.lvm [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76758) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 04 22:33:02 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:33:02 devstack sudo[77020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 22:33:02 devstack sudo[77020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:33:02 devstack sudo[77020]: pam_unix(sudo:session): session closed for user root Sep 04 22:33:02 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.488s {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:33:02 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:33:02 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:33:02 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:33:02 devstack sudo[77201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 22:33:02 devstack sudo[77201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:33:03 devstack sudo[77201]: pam_unix(sudo:session): session closed for user root Sep 04 22:33:03 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.266s {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:33:03 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:33:03 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:33:03 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:33:03 devstack sudo[77294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 04 22:33:03 devstack sudo[77294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:33:03 devstack sudo[77294]: pam_unix(sudo:session): session closed for user root Sep 04 22:33:03 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.322s {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:33:03 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:33:03 devstack sudo[77377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 04 22:33:03 devstack sudo[77377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:33:03 devstack sudo[77377]: pam_unix(sudo:session): session closed for user root Sep 04 22:33:03 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:33:03 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:33:03 devstack sudo[77380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 04 22:33:03 devstack sudo[77380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:33:03 devstack sudo[77380]: pam_unix(sudo:session): session closed for user root Sep 04 22:33:03 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.328s {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:33:03 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:33:04 devstack sudo[77464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 22:33:04 devstack sudo[77464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:33:04 devstack sudo[77464]: pam_unix(sudo:session): session closed for user root Sep 04 22:33:04 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:33:04 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:33:04 devstack sudo[77467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 22:33:04 devstack sudo[77467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:33:04 devstack sudo[77467]: pam_unix(sudo:session): session closed for user root Sep 04 22:33:04 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.309s {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:33:04 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:33:04 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:33:04 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:33:04 devstack sudo[77557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 22:33:04 devstack sudo[77557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:33:04 devstack sudo[77557]: pam_unix(sudo:session): session closed for user root Sep 04 22:33:04 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.286s {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:33:04 devstack cinder-volume[76758]: INFO cinder.volume.drivers.lvm [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 04 22:33:04 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:33:04 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:33:04 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:33:04 devstack sudo[77561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 22:33:04 devstack sudo[77561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:33:05 devstack sudo[77561]: pam_unix(sudo:session): session closed for user root Sep 04 22:33:05 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.270s {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:33:05 devstack cinder-volume[76758]: DEBUG cinder.volume.drivers.lvm [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] Updating volume stats {{(pid=76758) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 04 22:33:05 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:33:05 devstack sudo[77570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 04 22:33:05 devstack sudo[77570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:33:05 devstack sudo[77570]: pam_unix(sudo:session): session closed for user root Sep 04 22:33:05 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:33:05 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:33:05 devstack sudo[77573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 22:33:05 devstack sudo[77573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:33:05 devstack sudo[77573]: pam_unix(sudo:session): session closed for user root Sep 04 22:33:05 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:33:05 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:33:05 devstack sudo[77576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 22:33:05 devstack sudo[77576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:33:05 devstack sudo[77576]: pam_unix(sudo:session): session closed for user root Sep 04 22:33:05 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.266s {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:33:05 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:33:05 devstack sudo[77579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 22:33:05 devstack sudo[77579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:33:06 devstack sudo[77579]: pam_unix(sudo:session): session closed for user root Sep 04 22:33:06 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:33:06 devstack cinder-volume[76758]: INFO cinder.volume.driver [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] Driver hasn't implemented _init_vendor_properties() Sep 04 22:33:06 devstack cinder-volume[76758]: DEBUG cinder.volume.driver [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76758) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 04 22:33:06 devstack cinder-volume[76758]: DEBUG oslo_db.sqlalchemy.engines [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76758) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 22:33:06 devstack cinder-volume[76758]: DEBUG dbcounter [-] [76758] Writer thread running {{(pid=76758) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 04 22:33:06 devstack cinder-volume[76758]: DEBUG cinder.db.api [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] Building query based on filter {{(pid=76758) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 04 22:33:06 devstack cinder-volume[76758]: DEBUG cinder.image.image_utils [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76758) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 04 22:33:06 devstack cinder-volume[76758]: INFO cinder.keymgr.migration [None req-f25f715e-b409-49b3-b6da-a1287d9482f1 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 04 22:33:06 devstack cinder-volume[76758]: DEBUG cinder.volume.drivers.lvm [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] Updating volume stats {{(pid=76758) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 04 22:33:06 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:33:06 devstack sudo[77582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 04 22:33:06 devstack sudo[77582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:33:06 devstack sudo[77582]: pam_unix(sudo:session): session closed for user root Sep 04 22:33:06 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:33:06 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:33:06 devstack sudo[77585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 22:33:06 devstack sudo[77585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:33:06 devstack sudo[77585]: pam_unix(sudo:session): session closed for user root Sep 04 22:33:06 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:33:06 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:33:06 devstack sudo[77590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 22:33:06 devstack sudo[77590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:33:07 devstack sudo[77590]: pam_unix(sudo:session): session closed for user root Sep 04 22:33:07 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.280s {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:33:07 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:33:07 devstack sudo[77594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 22:33:07 devstack sudo[77594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:33:07 devstack sudo[77594]: pam_unix(sudo:session): session closed for user root Sep 04 22:33:07 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:33:07 devstack cinder-volume[76758]: DEBUG cinder.manager [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] Notifying Schedulers of capabilities ... {{(pid=76758) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:33:07 devstack cinder-volume[76758]: INFO cinder.volume.manager [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] Driver initialization completed successfully. Sep 04 22:33:07 devstack cinder-volume[76758]: INFO cinder.manager [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] Initiating service 2 cleanup Sep 04 22:33:07 devstack cinder-volume[76758]: INFO cinder.manager [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] Service 2 cleanup completed. Sep 04 22:33:07 devstack cinder-volume[76758]: DEBUG cinder.service [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] Creating RPC server for service cinder-volume {{(pid=76758) start /opt/stack/cinder/cinder/service.py:231}} Sep 04 22:33:07 devstack cinder-volume[76758]: DEBUG cinder.service [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76758) start /opt/stack/cinder/cinder/service.py:237}} Sep 04 22:33:07 devstack cinder-volume[76758]: INFO cinder.volume.manager [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 04 22:33:07 devstack cinder-volume[76758]: DEBUG cinder.volume.drivers.lvm [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] Updating volume stats {{(pid=76758) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 04 22:33:07 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:33:07 devstack sudo[77597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 04 22:33:07 devstack sudo[77597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:33:07 devstack sudo[77597]: pam_unix(sudo:session): session closed for user root Sep 04 22:33:07 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.294s {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:33:07 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:33:07 devstack sudo[77600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 22:33:07 devstack sudo[77600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:33:08 devstack sudo[77600]: pam_unix(sudo:session): session closed for user root Sep 04 22:33:08 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:33:08 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:33:08 devstack sudo[77605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 22:33:08 devstack sudo[77605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:33:08 devstack sudo[77605]: pam_unix(sudo:session): session closed for user root Sep 04 22:33:08 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.253s {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:33:08 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:33:08 devstack sudo[77611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 22:33:08 devstack sudo[77611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:33:08 devstack sudo[77611]: pam_unix(sudo:session): session closed for user root Sep 04 22:33:08 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:33:08 devstack cinder-volume[76758]: INFO cinder.volume.manager [None req-eb7693bb-34f6-4d0f-a136-33ad0233c401 None None] Driver post RPC initialization completed successfully. Sep 04 22:33:11 devstack cinder-volume[76605]: DEBUG dbcounter [-] [76605] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 22:33:18 devstack cinder-volume[76758]: DEBUG dbcounter [-] [76758] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76758) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 22:33:18 devstack cinder-volume[76758]: DEBUG dbcounter [-] [76758] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=76758) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 22:33:51 devstack cinder-volume[76758]: DEBUG oslo_service.periodic_task [None req-90abd17e-5c24-4fc3-8c44-816af00785ca None None] Running periodic task VolumeManager._thread_info {{(pid=76758) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 22:33:51 devstack cinder-volume[76758]: DEBUG cinder.volume.manager [None req-90abd17e-5c24-4fc3-8c44-816af00785ca None None] thread count: 6 {{(pid=76758) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 22:33:51 devstack cinder-volume[76758]: DEBUG cinder.volume.manager [None req-90abd17e-5c24-4fc3-8c44-816af00785ca None None] thread info: [<_MainThread(MainThread, started 123579158020224)>, , , , , ] {{(pid=76758) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 22:34:51 devstack cinder-volume[76758]: DEBUG oslo_service.periodic_task [None req-90abd17e-5c24-4fc3-8c44-816af00785ca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76758) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 22:34:51 devstack cinder-volume[76758]: DEBUG cinder.volume.drivers.lvm [None req-90abd17e-5c24-4fc3-8c44-816af00785ca None None] Updating volume stats {{(pid=76758) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 04 22:34:51 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-90abd17e-5c24-4fc3-8c44-816af00785ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:34:51 devstack sudo[82836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 04 22:34:51 devstack sudo[82836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:34:51 devstack sudo[82836]: pam_unix(sudo:session): session closed for user root Sep 04 22:34:51 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-90abd17e-5c24-4fc3-8c44-816af00785ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:34:51 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-90abd17e-5c24-4fc3-8c44-816af00785ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:34:51 devstack sudo[82840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 22:34:51 devstack sudo[82840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:34:52 devstack sudo[82840]: pam_unix(sudo:session): session closed for user root Sep 04 22:34:52 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-90abd17e-5c24-4fc3-8c44-816af00785ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:34:52 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-90abd17e-5c24-4fc3-8c44-816af00785ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:34:52 devstack sudo[82844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 22:34:52 devstack sudo[82844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:34:52 devstack sudo[82844]: pam_unix(sudo:session): session closed for user root Sep 04 22:34:52 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-90abd17e-5c24-4fc3-8c44-816af00785ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:34:52 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-90abd17e-5c24-4fc3-8c44-816af00785ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:34:52 devstack sudo[82847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 22:34:52 devstack sudo[82847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:34:52 devstack sudo[82847]: pam_unix(sudo:session): session closed for user root Sep 04 22:34:52 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-90abd17e-5c24-4fc3-8c44-816af00785ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:34:52 devstack cinder-volume[76758]: DEBUG cinder.manager [None req-90abd17e-5c24-4fc3-8c44-816af00785ca None None] Notifying Schedulers of capabilities ... {{(pid=76758) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:34:52 devstack cinder-volume[76758]: DEBUG oslo_service.periodic_task [None req-90abd17e-5c24-4fc3-8c44-816af00785ca None None] Running periodic task VolumeManager._thread_info {{(pid=76758) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 22:34:52 devstack cinder-volume[76758]: DEBUG cinder.volume.manager [None req-90abd17e-5c24-4fc3-8c44-816af00785ca None None] thread count: 6 {{(pid=76758) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 22:34:52 devstack cinder-volume[76758]: DEBUG cinder.volume.manager [None req-90abd17e-5c24-4fc3-8c44-816af00785ca None None] thread info: [<_MainThread(MainThread, started 123579158020224)>, , , , , ] {{(pid=76758) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 22:35:18 devstack cinder-volume[76758]: DEBUG dbcounter [-] [76758] Writing DB stats cinder:SELECT=1 {{(pid=76758) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 22:35:18 devstack cinder-volume[76758]: DEBUG dbcounter [-] [76758] Writing DB stats cinder:UPDATE=1 {{(pid=76758) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 22:35:51 devstack cinder-volume[76758]: DEBUG oslo_service.periodic_task [None req-90abd17e-5c24-4fc3-8c44-816af00785ca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76758) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 22:35:51 devstack cinder-volume[76758]: DEBUG cinder.volume.drivers.lvm [None req-90abd17e-5c24-4fc3-8c44-816af00785ca None None] Updating volume stats {{(pid=76758) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 04 22:35:51 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-90abd17e-5c24-4fc3-8c44-816af00785ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:35:51 devstack sudo[84485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 04 22:35:51 devstack sudo[84485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:35:51 devstack sudo[84485]: pam_unix(sudo:session): session closed for user root Sep 04 22:35:51 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-90abd17e-5c24-4fc3-8c44-816af00785ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:35:51 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-90abd17e-5c24-4fc3-8c44-816af00785ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:35:51 devstack sudo[84489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 22:35:51 devstack sudo[84489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:35:52 devstack sudo[84489]: pam_unix(sudo:session): session closed for user root Sep 04 22:35:52 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-90abd17e-5c24-4fc3-8c44-816af00785ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:35:52 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-90abd17e-5c24-4fc3-8c44-816af00785ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:35:52 devstack sudo[84526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 22:35:52 devstack sudo[84526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:35:52 devstack sudo[84526]: pam_unix(sudo:session): session closed for user root Sep 04 22:35:52 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-90abd17e-5c24-4fc3-8c44-816af00785ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:35:52 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-90abd17e-5c24-4fc3-8c44-816af00785ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:35:52 devstack sudo[84531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 22:35:52 devstack sudo[84531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:35:52 devstack sudo[84531]: pam_unix(sudo:session): session closed for user root Sep 04 22:35:52 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-90abd17e-5c24-4fc3-8c44-816af00785ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:35:52 devstack cinder-volume[76758]: DEBUG cinder.manager [None req-90abd17e-5c24-4fc3-8c44-816af00785ca None None] Notifying Schedulers of capabilities ... {{(pid=76758) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:35:52 devstack cinder-volume[76758]: DEBUG oslo_service.periodic_task [None req-90abd17e-5c24-4fc3-8c44-816af00785ca None None] Running periodic task VolumeManager._thread_info {{(pid=76758) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 22:35:52 devstack cinder-volume[76758]: DEBUG cinder.volume.manager [None req-90abd17e-5c24-4fc3-8c44-816af00785ca None None] thread count: 6 {{(pid=76758) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 22:35:52 devstack cinder-volume[76758]: DEBUG cinder.volume.manager [None req-90abd17e-5c24-4fc3-8c44-816af00785ca None None] thread info: [<_MainThread(MainThread, started 123579158020224)>, , , , , ] {{(pid=76758) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 22:36:51 devstack cinder-volume[76758]: DEBUG oslo_service.periodic_task [None req-90abd17e-5c24-4fc3-8c44-816af00785ca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76758) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 22:36:51 devstack cinder-volume[76758]: DEBUG cinder.volume.drivers.lvm [None req-90abd17e-5c24-4fc3-8c44-816af00785ca None None] Updating volume stats {{(pid=76758) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 04 22:36:51 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-90abd17e-5c24-4fc3-8c44-816af00785ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:36:51 devstack sudo[85928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 04 22:36:51 devstack sudo[85928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:36:51 devstack sudo[85928]: pam_unix(sudo:session): session closed for user root Sep 04 22:36:51 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-90abd17e-5c24-4fc3-8c44-816af00785ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:36:51 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-90abd17e-5c24-4fc3-8c44-816af00785ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:36:51 devstack sudo[85937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 22:36:51 devstack sudo[85937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:36:52 devstack sudo[85937]: pam_unix(sudo:session): session closed for user root Sep 04 22:36:52 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-90abd17e-5c24-4fc3-8c44-816af00785ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:36:52 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-90abd17e-5c24-4fc3-8c44-816af00785ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:36:52 devstack sudo[85940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 22:36:52 devstack sudo[85940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:36:52 devstack sudo[85940]: pam_unix(sudo:session): session closed for user root Sep 04 22:36:52 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-90abd17e-5c24-4fc3-8c44-816af00785ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.271s {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:36:52 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-90abd17e-5c24-4fc3-8c44-816af00785ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:36:52 devstack sudo[85957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 22:36:52 devstack sudo[85957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:36:52 devstack sudo[85957]: pam_unix(sudo:session): session closed for user root Sep 04 22:36:52 devstack cinder-volume[76758]: DEBUG oslo_concurrency.processutils [None req-90abd17e-5c24-4fc3-8c44-816af00785ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:36:52 devstack cinder-volume[76758]: DEBUG cinder.manager [None req-90abd17e-5c24-4fc3-8c44-816af00785ca None None] Notifying Schedulers of capabilities ... {{(pid=76758) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:37:18 devstack cinder-volume[76758]: DEBUG dbcounter [-] [76758] Writing DB stats cinder:SELECT=1 {{(pid=76758) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 22:37:18 devstack cinder-volume[76758]: DEBUG dbcounter [-] [76758] Writing DB stats cinder:UPDATE=1 {{(pid=76758) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 22:37:29 devstack cinder-volume[76605]: INFO oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] Caught SIGTERM, stopping children Sep 04 22:37:29 devstack cinder-volume[76605]: DEBUG oslo_concurrency.lockutils [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] Acquiring lock "singleton_lock" {{(pid=76605) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 04 22:37:29 devstack cinder-volume[76605]: DEBUG oslo_concurrency.lockutils [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] Acquired lock "singleton_lock" {{(pid=76605) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 04 22:37:29 devstack cinder-volume[76605]: DEBUG oslo_concurrency.lockutils [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] Releasing lock "singleton_lock" {{(pid=76605) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 04 22:37:29 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] Stop services. {{(pid=76605) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 04 22:37:29 devstack cinder-volume[76605]: DEBUG oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] Killing children. {{(pid=76605) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 04 22:37:29 devstack cinder-volume[76605]: INFO oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] Waiting on 1 children to exit Sep 04 22:37:32 devstack cinder-volume[76758]: DEBUG oslo_concurrency.lockutils [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] Acquiring lock "singleton_lock" {{(pid=76758) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 04 22:37:32 devstack cinder-volume[76758]: DEBUG oslo_concurrency.lockutils [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] Acquired lock "singleton_lock" {{(pid=76758) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 04 22:37:32 devstack cinder-volume[76758]: DEBUG oslo_concurrency.lockutils [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] Releasing lock "singleton_lock" {{(pid=76758) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 04 22:37:32 devstack cinder-volume[76758]: WARNING amqp [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 04 22:37:32 devstack cinder-volume[76758]: WARNING amqp [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 04 22:37:32 devstack cinder-volume[76605]: INFO oslo_service.backend._eventlet.service [None req-ca632080-ef93-4ddd-89ba-bb34a81a986f None None] Child 76758 exited with status 0 Sep 04 22:37:32 devstack cinder-volume[86770]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 04 22:37:32 devstack cinder-volume[86770]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 04 22:37:32 devstack cinder-volume[86770]: we strongly recommend against using it for new projects. Sep 04 22:37:32 devstack cinder-volume[86770]: If you are already using Eventlet, we recommend migrating to a different Sep 04 22:37:32 devstack cinder-volume[86770]: framework. For more detail see Sep 04 22:37:32 devstack cinder-volume[86770]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 04 22:37:32 devstack cinder-volume[86770]: import eventlet # noqa Sep 04 22:37:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86770) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 04 22:37:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86770) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 04 22:37:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86770) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 04 22:37:35 devstack cinder-volume[86770]: INFO dbcounter [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] Registered counter for database cinder Sep 04 22:37:35 devstack cinder-volume[86770]: DEBUG oslo_db.sqlalchemy.engines [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86770) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writer thread running {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 04 22:37:36 devstack cinder-volume[86770]: INFO cinder.rpc [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 04 22:37:36 devstack cinder-volume[86770]: INFO cinder.rpc [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_db.sqlalchemy.engines [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86770) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 22:37:36 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] Determined volume DB was empty at startup. Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86770) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 04 22:37:36 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 04 22:37:36 devstack cinder-volume[86770]: WARNING stevedore.named [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 04 22:37:36 devstack cinder-volume[86770]: WARNING castellan.key_manager [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 04 22:37:36 devstack cinder-volume[86770]: WARNING cinder.keymgr.conf_key_mgr [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 04 22:37:36 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_db.sqlalchemy.engines [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86770) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 22:37:36 devstack cinder-volume[86770]: INFO oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] Starting 1 workers Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] Started child 86988 {{(pid=86770) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] Full set of CONF: {{(pid=86770) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] ******************************************************************************** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] Configuration options gathered from: {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] ================================================================================ {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] allow_availability_zone_fallback = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] allow_compression_on_image_upload = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] allowed_direct_url_schemes = [] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] api_rate_limit = True {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] auth_strategy = keystone {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_availability_zone = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_host = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_name = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86988]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_stats_polling_interval = 60 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backup_api_class = cinder.backup.api.API {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backup_name_template = backup-%s {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backup_use_same_host = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backup_use_temp_snapshot = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] chap_password = **** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] chap_username = {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] cinder_internal_tenant_project_id = 723ec54d689b4886aa80ce901f11243d {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] cinder_internal_tenant_user_id = 5a8695562b3248888ba7bcb6c1068b32 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] cluster = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] compression_format = gzip {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] compute_api_class = cinder.compute.nova.API {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] config_dir = [] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] config_source = [] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] control_exchange = openstack {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] debug = True {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] default_availability_zone = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] default_group_type = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] default_volume_type = QuobyteHD {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] disk_geometry = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] driver_client_cert = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] driver_client_cert_key = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] driver_data_namespace = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] driver_ssl_cert_path = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] driver_ssl_cert_verify = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] driver_use_ssl = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] enable_new_services = True {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] enable_unsupported_driver = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] enabled_backends = ['QuobyteHD'] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] enforce_multipath_for_image_xfer = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] filter_function = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] glance_api_insecure = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] glance_api_servers = ['http://192.168.122.214/image'] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] glance_api_ssl_compression = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] glance_ca_certificates_file = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] glance_catalog_info = image:glance:publicURL {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] glance_certfile = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] glance_keyfile = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] glance_num_retries = 3 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] glance_request_timeout = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] goodness_function = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] graceful_shutdown_timeout = 5 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] group_api_class = cinder.group.api.API {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] host = devstack {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] image_compress_on_upload = True {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] image_conversion_address_space_limit = 1 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] image_conversion_cpu_limit = 60 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] image_conversion_disable = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] image_upload_use_cinder_backend = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] image_upload_use_internal_tenant = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] image_volume_cache_enabled = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] image_volume_cache_max_count = 0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] image_volume_cache_max_size_gb = 0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] init_host_max_objects_retrieval = 0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] instance_format = [instance: %(uuid)s] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] iscsi_target_flags = {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] iscsi_write_cache = on {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] iser_helper = tgtadm {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] iser_ip_address = 192.168.122.214 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] iser_port = 3260 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] log_color = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] log_config_append = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] log_dir = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] log_file = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] log_options = True {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] log_rotate_interval = 1 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] log_rotate_interval_type = days {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] log_rotation_type = none {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] max_age = 0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] max_logfile_count = 30 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] max_logfile_size_mb = 200 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] max_over_subscription_ratio = 20.0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] message_reap_interval = 86400 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] message_ttl = 2592000 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] migration_create_volume_timeout_secs = 300 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] monkey_patch = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] monkey_patch_modules = [] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] my_ip = 192.168.122.214 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] no_snapshot_gb_quota = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] num_iser_scan_tries = 3 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] num_shell_tries = 3 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] num_volume_device_scan_tries = 3 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] nvmeof_conn_info_version = 1 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] nvmet_ns_id = 10 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] nvmet_port_id = 1 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] osapi_max_limit = 1000 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] osapi_volume_ext_list = [] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] osapi_volume_listen_port = 8776 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] osapi_volume_use_ssl = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] osapi_volume_workers = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] per_volume_size_limit = -1 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] periodic_fuzzy_delay = 60 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] periodic_interval = 60 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] public_endpoint = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] publish_errors = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] quota_backup_gigabytes = 1000 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] quota_backups = 10 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] quota_gigabytes = 1000 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] quota_groups = 10 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] quota_snapshots = 10 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] quota_volumes = 10 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] rate_limit_burst = 0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] rate_limit_except_level = CRITICAL {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] rate_limit_interval = 0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] reinit_driver_count = 3 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] replication_device = **** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] report_discard_supported = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] report_interval = 120 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] reservation_clean_interval = 86400 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] reservation_expire = 86400 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] reserved_image_namespaces = [] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] reserved_percentage = 0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] rpc_response_timeout = 120 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] run_external_periodic_tasks = True {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] scst_target_driver = iscsi {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] scst_target_iqn_name = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] service_down_time = 720 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] shell_completion = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] snapshot_name_template = snapshot-%s {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] split_loggers = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] state_path = /opt/stack/data/cinder {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] storage_availability_zone = nova {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] storage_protocol = iSCSI {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] syslog_log_facility = LOG_USER {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] target_helper = lioadm {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] target_ip_address = 192.168.122.214 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] target_port = 3260 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] target_protocol = iscsi {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] target_secondary_ip_addresses = [] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] trace_flags = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] transport_url = **** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] until_refresh = 0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] use_chap_auth = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] use_default_quota_class = True {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] use_journal = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] use_json = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] use_multipath_for_image_xfer = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] use_stderr = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] use_syslog = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] verify_glance_signatures = enabled {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] volume_api_class = cinder.volume.api.API {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] volume_backend_name = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] volume_clear = zero {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] volume_clear_ionice = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] volume_clear_size = 0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] volume_copy_bps_limit = 0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] volume_dd_blocksize = 1M {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] volume_name_template = volume-%s {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] volume_service_inithost_offload = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] volume_usage_audit_period = month {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] zoning_mode = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] oslo_concurrency.disable_process_locking = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] keystone_authtoken.auth_section = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] keystone_authtoken.auth_type = password {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] keystone_authtoken.auth_version = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] keystone_authtoken.cache = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] keystone_authtoken.certfile = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] keystone_authtoken.include_service_catalog = True {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] keystone_authtoken.insecure = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] keystone_authtoken.interface = public {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] keystone_authtoken.keyfile = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] keystone_authtoken.memcache_password = **** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] keystone_authtoken.memcache_username = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] keystone_authtoken.region_name = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] keystone_authtoken.service_type = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.214/identity {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] cache.backend = dogpile.cache.null {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] cache.backend_argument = **** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] cache.backend_expiration_time = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] cache.config_prefix = cache.oslo {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] cache.debug_cache_backend = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] cache.enable_retry_client = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] cache.enable_socket_keepalive = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] cache.enabled = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] cache.expiration_time = 600 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] cache.hashclient_retry_attempts = 2 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] cache.memcache_dead_retry = 300 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] cache.memcache_pool_maxsize = 10 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] cache.memcache_sasl_enabled = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] cache.password = **** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] cache.proxies = [] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] cache.redis_db = 0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] cache.redis_server = localhost:6379 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] cache.retry_attempts = 2 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] cache.retry_delay = 0.0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] cache.socket_keepalive_count = 1 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] cache.socket_keepalive_idle = 1 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] cache.socket_keepalive_interval = 1 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] cache.socket_timeout = 1.0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] cache.tls_allowed_ciphers = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] cache.tls_cafile = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] cache.tls_certfile = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] cache.tls_enabled = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] cache.tls_keyfile = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] cache.username = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] coordination.backend_url = **** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] database.asyncio_connection = **** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] database.asyncio_slave_connection = **** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] database.backend = sqlalchemy {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] database.connection = **** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] database.connection_debug = 0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] database.connection_parameters = {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] database.connection_recycle_time = 3600 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] database.connection_trace = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] database.db_inc_retry_interval = True {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] database.db_max_retries = 20 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] database.db_max_retry_interval = 10 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] database.db_retry_interval = 1 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] database.max_overflow = 50 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] database.max_pool_size = 5 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] database.max_retries = 10 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] database.mysql_wsrep_sync_wait = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] database.pool_timeout = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] database.retry_interval = 10 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] database.slave_connection = **** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] database.sqlite_synchronous = True {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] database.synchronous_reader = True {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86988]: INFO cinder.volume.manager [None req-2638cfde-454b-48ac-8b1c-22003eb821d1 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] database.use_db_reconnect = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86988]: DEBUG cinder.volume.drivers.remotefs [None req-2638cfde-454b-48ac-8b1c-22003eb821d1 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86988) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] oslo_messaging_tracing.insecure = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] profiler.connection_string = messaging:// {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] profiler.enabled = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] profiler.es_doc_type = notification {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] profiler.es_scroll_size = 10000 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] profiler.es_scroll_time = 2m {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] profiler.filter_error_trace = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] profiler.hmac_keys = **** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] profiler.sentinel_service_name = mymaster {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] profiler.socket_timeout = 0.1 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] profiler.trace_requests = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] profiler.trace_sqlalchemy = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] profiler_jaeger.process_tags = {} {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] profiler_jaeger.service_name_prefix = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] profiler_otlp.service_name_prefix = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] oslo_policy.enforce_new_defaults = True {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] oslo_policy.policy_default_rule = default {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] oslo_policy.policy_file = policy.yaml {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] privsep_osbrick.group = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] privsep_osbrick.helper_command = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] privsep_osbrick.user = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] cinder_sys_admin.group = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] cinder_sys_admin.helper_command = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] cinder_sys_admin.user = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] service_user.auth_section = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] service_user.auth_type = password {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] service_user.cafile = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] service_user.certfile = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] service_user.collect_timing = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] service_user.insecure = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] service_user.keyfile = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] service_user.send_service_user_token = True {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] service_user.split_loggers = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] service_user.timeout = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] service_user.tls_ciphers = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] service_user.tls_min_version = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] glance.auth_section = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] glance.auth_type = password {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] glance.certfile = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] glance.collect_timing = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] glance.insecure = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] glance.keyfile = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] glance.region_name = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] glance.split_loggers = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] glance.timeout = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] glance.tls_ciphers = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] glance.tls_min_version = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.backend_availability_zone = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.chap_password = **** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.chap_username = {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.disk_geometry = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.driver_client_cert = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.driver_client_cert_key = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.driver_data_namespace = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.driver_use_ssl = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.extra_capabilities = {} {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.filter_function = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.goodness_function = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.iscsi_target_flags = {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.iscsi_write_cache = on {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.iser_helper = tgtadm {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.iser_ip_address = 192.168.122.214 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.iser_port = 3260 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.nas_host = {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.nas_login = admin {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.nas_mount_options = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.nas_password = **** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.nas_private_key = {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.nas_share_path = {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.num_shell_tries = 3 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.quobyte_volume_url = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.replication_device = **** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.report_discard_supported = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.reserved_percentage = 0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.target_helper = tgtadm {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.target_ip_address = 192.168.122.214 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.target_port = 3260 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.target_protocol = iscsi {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.trace_flags = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.unique_fqdn_network = True {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.use_chap_auth = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.volume_backend_name = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.volume_clear = zero {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.volume_clear_ionice = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.volume_clear_size = 0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] oslo_reports.file_event_handler = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] oslo_reports.log_dir = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.backend_availability_zone = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.backend_host = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.chap_password = **** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.chap_username = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.chiscsi_conf = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.disk_geometry = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.driver_client_cert = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.driver_data_namespace = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.driver_use_ssl = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.extra_capabilities = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.filter_function = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.goodness_function = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.iser_helper = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.iser_ip_address = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.iser_port = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.iser_target_prefix = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.nas_host = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.nas_login = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.nas_mount_options = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.nas_password = **** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.nas_private_key = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.nas_share_path = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.nas_ssh_port = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.num_shell_tries = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.nvmet_port_id = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.replication_device = **** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.report_discard_supported = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.reserved_percentage = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.scst_target_driver = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86988]: DEBUG cinder.volume.drivers.quobyte [None req-2638cfde-454b-48ac-8b1c-22003eb821d1 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86988) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 04 22:37:36 devstack cinder-volume[86988]: WARNING cinder.volume.drivers.quobyte [None req-2638cfde-454b-48ac-8b1c-22003eb821d1 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 04 22:37:36 devstack cinder-volume[86988]: WARNING cinder.volume.drivers.quobyte [None req-2638cfde-454b-48ac-8b1c-22003eb821d1 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 04 22:37:36 devstack cinder-volume[86988]: DEBUG oslo_concurrency.processutils [None req-2638cfde-454b-48ac-8b1c-22003eb821d1 None None] Running cmd (subprocess): mount.quobyte {{(pid=86988) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.storage_protocol = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.target_helper = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.target_ip_address = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.target_port = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.target_prefix = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.target_protocol = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.trace_flags = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.use_chap_auth = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.volume_clear = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.volume_clear_size = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] QuobyteHD.volumes_dir = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] oslo_messaging_rabbit.ssl = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] oslo_messaging_notifications.driver = [] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] oslo_messaging_notifications.retry = -1 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] key_manager.fixed_key = **** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] barbican.barbican_api_version = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] barbican.barbican_endpoint = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] barbican.barbican_endpoint_type = public {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] barbican.barbican_region_name = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] barbican.cafile = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] barbican.certfile = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] barbican.collect_timing = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] barbican.insecure = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] barbican.keyfile = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] barbican.number_of_retries = 60 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] barbican.retry_delay = 1 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] barbican.send_service_user_token = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] barbican.split_loggers = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] barbican.timeout = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] barbican.tls_ciphers = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack quobyte-client[86993]: Reading configuration file: /etc/quobyte/client.cfg Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] barbican.tls_min_version = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] barbican.verify_ssl = True {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] barbican.verify_ssl_path = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] barbican_service_user.auth_section = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] barbican_service_user.auth_type = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack quobyte-client[86993]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] barbican_service_user.cafile = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] barbican_service_user.certfile = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] barbican_service_user.collect_timing = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86988]: DEBUG oslo_concurrency.processutils [None req-2638cfde-454b-48ac-8b1c-22003eb821d1 None None] CMD "mount.quobyte" returned: 1 in 0.064s {{(pid=86988) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] barbican_service_user.insecure = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] barbican_service_user.keyfile = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] barbican_service_user.split_loggers = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86988]: DEBUG oslo_concurrency.lockutils [None req-2638cfde-454b-48ac-8b1c-22003eb821d1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86988) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] barbican_service_user.timeout = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86988]: DEBUG oslo_concurrency.lockutils [None req-2638cfde-454b-48ac-8b1c-22003eb821d1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86988) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] barbican_service_user.tls_ciphers = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86988]: DEBUG cinder.volume.drivers.quobyte [None req-2638cfde-454b-48ac-8b1c-22003eb821d1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=86988) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] barbican_service_user.tls_min_version = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] vault.approle_role_id = **** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] vault.approle_secret_id = **** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] vault.auth_method = approle {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86988]: INFO cinder.volume.drivers.quobyte [None req-2638cfde-454b-48ac-8b1c-22003eb821d1 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 ... Sep 04 22:37:36 devstack cinder-volume[86988]: DEBUG oslo_concurrency.processutils [None req-2638cfde-454b-48ac-8b1c-22003eb821d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 -c /etc/quobyte/client-cinder.cfg {{(pid=86988) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] vault.auth_path = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] vault.kv_mountpoint = secret {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] vault.kv_path = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] vault.kv_version = 2 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] vault.namespace = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] vault.root_token_id = **** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] vault.ssl_ca_crt_file = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] vault.timeout = 60.0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] vault.token_file = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] vault.token_role = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] vault.use_ssl = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:36 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] ******************************************************************************** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 04 22:37:36 devstack sudo[86994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 -c /etc/quobyte/client-cinder.cfg Sep 04 22:37:36 devstack sudo[86994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:37:37 devstack sudo[86994]: pam_unix(sudo:session): session closed for user root Sep 04 22:37:37 devstack cinder-volume[86988]: DEBUG oslo_concurrency.processutils [None req-2638cfde-454b-48ac-8b1c-22003eb821d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.373s {{(pid=86988) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:37:37 devstack cinder-volume[86988]: INFO cinder.volume.drivers.quobyte [None req-2638cfde-454b-48ac-8b1c-22003eb821d1 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 succeeded Sep 04 22:37:37 devstack cinder-volume[86988]: DEBUG cinder.volume.drivers.quobyte [None req-2638cfde-454b-48ac-8b1c-22003eb821d1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=86988) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:37:37 devstack cinder-volume[86988]: DEBUG oslo_concurrency.lockutils [None req-2638cfde-454b-48ac-8b1c-22003eb821d1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.385s {{(pid=86988) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:37:37 devstack cinder-volume[86988]: DEBUG oslo_concurrency.processutils [None req-2638cfde-454b-48ac-8b1c-22003eb821d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=86988) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:37:37 devstack sudo[87063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:37:37 devstack sudo[87063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:37:37 devstack sudo[87063]: pam_unix(sudo:session): session closed for user root Sep 04 22:37:37 devstack cinder-volume[86988]: DEBUG oslo_concurrency.processutils [None req-2638cfde-454b-48ac-8b1c-22003eb821d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.240s {{(pid=86988) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:37:37 devstack cinder-volume[86988]: INFO cinder.volume.driver [None req-2638cfde-454b-48ac-8b1c-22003eb821d1 None None] Driver hasn't implemented _init_vendor_properties() Sep 04 22:37:37 devstack cinder-volume[86988]: DEBUG cinder.volume.driver [None req-2638cfde-454b-48ac-8b1c-22003eb821d1 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7158851623535, 'free_capacity_gb': 1773.7158851623535, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86988) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 04 22:37:37 devstack cinder-volume[86988]: DEBUG oslo_db.sqlalchemy.engines [None req-2638cfde-454b-48ac-8b1c-22003eb821d1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86988) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 22:37:37 devstack cinder-volume[86988]: DEBUG dbcounter [-] [86988] Writer thread running {{(pid=86988) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 04 22:37:37 devstack cinder-volume[86988]: DEBUG cinder.db.api [None req-2638cfde-454b-48ac-8b1c-22003eb821d1 None None] Building query based on filter {{(pid=86988) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 04 22:37:37 devstack cinder-volume[86988]: DEBUG cinder.image.image_utils [None req-2638cfde-454b-48ac-8b1c-22003eb821d1 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86988) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 04 22:37:37 devstack cinder-volume[86988]: INFO cinder.keymgr.migration [None req-189b4bba-4549-4a61-9c9c-6e89b42fc14e None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 04 22:37:37 devstack cinder-volume[86988]: DEBUG oslo_concurrency.lockutils [None req-2638cfde-454b-48ac-8b1c-22003eb821d1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86988) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:37:37 devstack cinder-volume[86988]: DEBUG oslo_concurrency.lockutils [None req-2638cfde-454b-48ac-8b1c-22003eb821d1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86988) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:37:37 devstack cinder-volume[86988]: DEBUG cinder.volume.drivers.quobyte [None req-2638cfde-454b-48ac-8b1c-22003eb821d1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=86988) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:37:37 devstack cinder-volume[86988]: DEBUG cinder.volume.drivers.quobyte [None req-2638cfde-454b-48ac-8b1c-22003eb821d1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=86988) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:37:37 devstack cinder-volume[86988]: DEBUG oslo_concurrency.lockutils [None req-2638cfde-454b-48ac-8b1c-22003eb821d1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86988) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:37:37 devstack cinder-volume[86988]: DEBUG oslo_concurrency.processutils [None req-2638cfde-454b-48ac-8b1c-22003eb821d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=86988) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:37:37 devstack sudo[87066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:37:37 devstack sudo[87066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:37:37 devstack sudo[87066]: pam_unix(sudo:session): session closed for user root Sep 04 22:37:37 devstack cinder-volume[86988]: DEBUG oslo_concurrency.processutils [None req-2638cfde-454b-48ac-8b1c-22003eb821d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.236s {{(pid=86988) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:37:37 devstack cinder-volume[86988]: DEBUG cinder.manager [None req-2638cfde-454b-48ac-8b1c-22003eb821d1 None None] Notifying Schedulers of capabilities ... {{(pid=86988) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:37:37 devstack cinder-volume[86988]: INFO cinder.volume.manager [None req-2638cfde-454b-48ac-8b1c-22003eb821d1 None None] Driver initialization completed successfully. Sep 04 22:37:37 devstack cinder-volume[86988]: INFO cinder.manager [None req-2638cfde-454b-48ac-8b1c-22003eb821d1 None None] Initiating service 3 cleanup Sep 04 22:37:37 devstack cinder-volume[86988]: INFO cinder.manager [None req-2638cfde-454b-48ac-8b1c-22003eb821d1 None None] Service 3 cleanup completed. Sep 04 22:37:37 devstack cinder-volume[86988]: DEBUG cinder.service [None req-2638cfde-454b-48ac-8b1c-22003eb821d1 None None] Creating RPC server for service cinder-volume {{(pid=86988) start /opt/stack/cinder/cinder/service.py:231}} Sep 04 22:37:37 devstack cinder-volume[86988]: DEBUG cinder.service [None req-2638cfde-454b-48ac-8b1c-22003eb821d1 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86988) start /opt/stack/cinder/cinder/service.py:237}} Sep 04 22:37:37 devstack cinder-volume[86988]: INFO cinder.volume.manager [None req-2638cfde-454b-48ac-8b1c-22003eb821d1 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 04 22:37:37 devstack cinder-volume[86988]: DEBUG oslo_concurrency.lockutils [None req-2638cfde-454b-48ac-8b1c-22003eb821d1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86988) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:37:37 devstack cinder-volume[86988]: DEBUG oslo_concurrency.lockutils [None req-2638cfde-454b-48ac-8b1c-22003eb821d1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86988) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:37:37 devstack cinder-volume[86988]: DEBUG cinder.volume.drivers.quobyte [None req-2638cfde-454b-48ac-8b1c-22003eb821d1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=86988) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:37:37 devstack cinder-volume[86988]: DEBUG cinder.volume.drivers.quobyte [None req-2638cfde-454b-48ac-8b1c-22003eb821d1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=86988) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:37:37 devstack cinder-volume[86988]: DEBUG oslo_concurrency.lockutils [None req-2638cfde-454b-48ac-8b1c-22003eb821d1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86988) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:37:37 devstack cinder-volume[86988]: DEBUG oslo_concurrency.processutils [None req-2638cfde-454b-48ac-8b1c-22003eb821d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=86988) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:37:37 devstack sudo[87069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:37:37 devstack sudo[87069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:37:38 devstack sudo[87069]: pam_unix(sudo:session): session closed for user root Sep 04 22:37:38 devstack cinder-volume[86988]: DEBUG oslo_concurrency.processutils [None req-2638cfde-454b-48ac-8b1c-22003eb821d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.255s {{(pid=86988) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:37:38 devstack cinder-volume[86988]: INFO cinder.volume.manager [None req-2638cfde-454b-48ac-8b1c-22003eb821d1 None None] Driver post RPC initialization completed successfully. Sep 04 22:37:42 devstack cinder-volume[86988]: DEBUG oslo_concurrency.lockutils [None req-b22711bd-8458-4950-b433-77b0a8f0f487 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86988) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:37:42 devstack cinder-volume[86988]: DEBUG oslo_concurrency.lockutils [None req-b22711bd-8458-4950-b433-77b0a8f0f487 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86988) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:37:42 devstack cinder-volume[86988]: DEBUG cinder.volume.drivers.quobyte [None req-b22711bd-8458-4950-b433-77b0a8f0f487 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=86988) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:37:42 devstack cinder-volume[86988]: DEBUG cinder.volume.drivers.quobyte [None req-b22711bd-8458-4950-b433-77b0a8f0f487 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=86988) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:37:42 devstack cinder-volume[86988]: DEBUG oslo_concurrency.lockutils [None req-b22711bd-8458-4950-b433-77b0a8f0f487 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86988) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:37:42 devstack cinder-volume[86988]: DEBUG oslo_concurrency.processutils [None req-b22711bd-8458-4950-b433-77b0a8f0f487 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=86988) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:37:42 devstack sudo[87218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:37:42 devstack sudo[87218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:37:42 devstack sudo[87218]: pam_unix(sudo:session): session closed for user root Sep 04 22:37:42 devstack cinder-volume[86988]: DEBUG oslo_concurrency.processutils [None req-b22711bd-8458-4950-b433-77b0a8f0f487 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.236s {{(pid=86988) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:37:42 devstack cinder-volume[86988]: DEBUG cinder.manager [None req-b22711bd-8458-4950-b433-77b0a8f0f487 None None] Notifying Schedulers of capabilities ... {{(pid=86988) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:37:43 devstack cinder-volume[86770]: INFO oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] Caught SIGTERM, stopping children Sep 04 22:37:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] Acquiring lock "singleton_lock" {{(pid=86770) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 04 22:37:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] Acquired lock "singleton_lock" {{(pid=86770) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 04 22:37:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] Releasing lock "singleton_lock" {{(pid=86770) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 04 22:37:43 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] Stop services. {{(pid=86770) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 04 22:37:43 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] Killing children. {{(pid=86770) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 04 22:37:43 devstack cinder-volume[86770]: INFO oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] Waiting on 1 children to exit Sep 04 22:37:46 devstack cinder-volume[86988]: DEBUG oslo_concurrency.lockutils [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] Acquiring lock "singleton_lock" {{(pid=86988) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 04 22:37:46 devstack cinder-volume[86988]: DEBUG oslo_concurrency.lockutils [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] Acquired lock "singleton_lock" {{(pid=86988) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 04 22:37:46 devstack cinder-volume[86988]: DEBUG oslo_concurrency.lockutils [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] Releasing lock "singleton_lock" {{(pid=86988) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 04 22:37:46 devstack cinder-volume[86988]: WARNING amqp [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 04 22:37:46 devstack cinder-volume[86988]: WARNING amqp [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 04 22:37:46 devstack cinder-volume[86770]: INFO oslo_service.backend._eventlet.service [None req-8fee0074-4acf-4cf7-92b8-e2f3f8b1c0c6 None None] Child 86988 exited with status 0 Sep 04 22:37:46 devstack cinder-volume[87280]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 04 22:37:46 devstack cinder-volume[87280]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 04 22:37:46 devstack cinder-volume[87280]: we strongly recommend against using it for new projects. Sep 04 22:37:46 devstack cinder-volume[87280]: If you are already using Eventlet, we recommend migrating to a different Sep 04 22:37:46 devstack cinder-volume[87280]: framework. For more detail see Sep 04 22:37:46 devstack cinder-volume[87280]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 04 22:37:46 devstack cinder-volume[87280]: import eventlet # noqa Sep 04 22:37:49 devstack cinder-volume[87280]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87280) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 04 22:37:49 devstack cinder-volume[87280]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87280) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 04 22:37:49 devstack cinder-volume[87280]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87280) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 04 22:37:50 devstack cinder-volume[87280]: INFO dbcounter [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] Registered counter for database cinder Sep 04 22:37:50 devstack cinder-volume[87280]: DEBUG oslo_db.sqlalchemy.engines [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87280) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG dbcounter [-] [87280] Writer thread running {{(pid=87280) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 04 22:37:51 devstack cinder-volume[87280]: INFO cinder.rpc [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 04 22:37:51 devstack cinder-volume[87280]: INFO cinder.rpc [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_db.sqlalchemy.engines [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87280) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 22:37:51 devstack cinder-volume[87280]: INFO cinder.volume.manager [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] Determined volume DB was empty at startup. Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG cinder.volume.manager [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87280) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 04 22:37:51 devstack cinder-volume[87280]: WARNING stevedore.named [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 04 22:37:51 devstack cinder-volume[87280]: WARNING castellan.key_manager [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 04 22:37:51 devstack cinder-volume[87280]: WARNING cinder.keymgr.conf_key_mgr [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 04 22:37:51 devstack cinder-volume[87280]: INFO cinder.volume.manager [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_db.sqlalchemy.engines [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87280) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 22:37:51 devstack cinder-volume[87280]: INFO oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] Starting 1 workers Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] Started child 87576 {{(pid=87280) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] Full set of CONF: {{(pid=87280) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] ******************************************************************************** {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] Configuration options gathered from: {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] ================================================================================ {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] allow_availability_zone_fallback = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] allow_compression_on_image_upload = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] allowed_direct_url_schemes = [] {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] api_rate_limit = True {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] auth_strategy = keystone {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_availability_zone = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_host = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87576]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_name = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_stats_polling_interval = 60 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backup_api_class = cinder.backup.api.API {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backup_name_template = backup-%s {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backup_use_same_host = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backup_use_temp_snapshot = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] chap_password = **** {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] chap_username = {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] cinder_internal_tenant_project_id = 723ec54d689b4886aa80ce901f11243d {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] cinder_internal_tenant_user_id = 5a8695562b3248888ba7bcb6c1068b32 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] cluster = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] compression_format = gzip {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] compute_api_class = cinder.compute.nova.API {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] config_dir = [] {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] config_source = [] {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] control_exchange = openstack {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] debug = True {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] default_availability_zone = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] default_group_type = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] default_volume_type = QuobyteHD {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] disk_geometry = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] driver_client_cert = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] driver_client_cert_key = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] driver_data_namespace = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] driver_ssl_cert_path = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] driver_ssl_cert_verify = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] driver_use_ssl = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] enable_new_services = True {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] enable_unsupported_driver = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] enabled_backends = ['QuobyteHD'] {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] enforce_multipath_for_image_xfer = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] filter_function = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] glance_api_insecure = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] glance_api_servers = ['http://192.168.122.214/image'] {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] glance_api_ssl_compression = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] glance_ca_certificates_file = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] glance_catalog_info = image:glance:publicURL {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] glance_certfile = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] glance_keyfile = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] glance_num_retries = 3 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] glance_request_timeout = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] goodness_function = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] graceful_shutdown_timeout = 5 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] group_api_class = cinder.group.api.API {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] host = devstack {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] image_compress_on_upload = True {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] image_conversion_address_space_limit = 1 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] image_conversion_cpu_limit = 60 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] image_conversion_disable = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] image_upload_use_cinder_backend = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] image_upload_use_internal_tenant = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] image_volume_cache_enabled = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] image_volume_cache_max_count = 0 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] image_volume_cache_max_size_gb = 0 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] init_host_max_objects_retrieval = 0 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] instance_format = [instance: %(uuid)s] {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] iscsi_target_flags = {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] iscsi_write_cache = on {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] iser_helper = tgtadm {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] iser_ip_address = 192.168.122.214 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] iser_port = 3260 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] log_color = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] log_config_append = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] log_dir = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] log_file = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] log_options = True {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] log_rotate_interval = 1 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] log_rotate_interval_type = days {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] log_rotation_type = none {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] max_age = 0 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] max_logfile_count = 30 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] max_logfile_size_mb = 200 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] max_over_subscription_ratio = 20.0 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] message_reap_interval = 86400 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] message_ttl = 2592000 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] migration_create_volume_timeout_secs = 300 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] monkey_patch = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] monkey_patch_modules = [] {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] my_ip = 192.168.122.214 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] no_snapshot_gb_quota = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] num_iser_scan_tries = 3 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] num_shell_tries = 3 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] num_volume_device_scan_tries = 3 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] nvmeof_conn_info_version = 1 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] nvmet_ns_id = 10 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] nvmet_port_id = 1 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] osapi_max_limit = 1000 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] osapi_volume_ext_list = [] {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] osapi_volume_listen_port = 8776 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] osapi_volume_use_ssl = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] osapi_volume_workers = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] per_volume_size_limit = -1 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] periodic_fuzzy_delay = 60 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] periodic_interval = 60 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] public_endpoint = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] publish_errors = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] quota_backup_gigabytes = 1000 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] quota_backups = 10 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] quota_gigabytes = 1000 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] quota_groups = 10 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] quota_snapshots = 10 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] quota_volumes = 10 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] rate_limit_burst = 0 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] rate_limit_except_level = CRITICAL {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] rate_limit_interval = 0 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] reinit_driver_count = 3 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] replication_device = **** {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] report_discard_supported = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] report_interval = 120 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] reservation_clean_interval = 86400 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] reservation_expire = 86400 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] reserved_image_namespaces = [] {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] reserved_percentage = 0 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] rpc_response_timeout = 120 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] run_external_periodic_tasks = True {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] scst_target_driver = iscsi {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-f4c6a3cb-48c4-4469-8efb-58b592537b22 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] scst_target_iqn_name = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] service_down_time = 720 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] shell_completion = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] snapshot_name_template = snapshot-%s {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] split_loggers = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] state_path = /opt/stack/data/cinder {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] storage_availability_zone = nova {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] storage_protocol = iSCSI {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] syslog_log_facility = LOG_USER {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-f4c6a3cb-48c4-4469-8efb-58b592537b22 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87576) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] target_helper = lioadm {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] target_ip_address = 192.168.122.214 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] target_port = 3260 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] target_protocol = iscsi {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] target_secondary_ip_addresses = [] {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] trace_flags = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] transport_url = **** {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] until_refresh = 0 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] use_chap_auth = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] use_default_quota_class = True {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] use_journal = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] use_json = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] use_multipath_for_image_xfer = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] use_stderr = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] use_syslog = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] verify_glance_signatures = enabled {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] volume_api_class = cinder.volume.api.API {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] volume_backend_name = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] volume_clear = zero {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] volume_clear_ionice = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] volume_clear_size = 0 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] volume_copy_bps_limit = 0 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] volume_dd_blocksize = 1M {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] volume_name_template = volume-%s {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] volume_service_inithost_offload = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] volume_usage_audit_period = month {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] zoning_mode = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] oslo_concurrency.disable_process_locking = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] keystone_authtoken.auth_section = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] keystone_authtoken.auth_type = password {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] keystone_authtoken.auth_version = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] keystone_authtoken.cache = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] keystone_authtoken.certfile = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] keystone_authtoken.include_service_catalog = True {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] keystone_authtoken.insecure = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] keystone_authtoken.interface = public {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] keystone_authtoken.keyfile = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] keystone_authtoken.memcache_password = **** {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] keystone_authtoken.memcache_username = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] keystone_authtoken.region_name = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] keystone_authtoken.service_type = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.214/identity {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] cache.backend = dogpile.cache.null {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] cache.backend_argument = **** {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] cache.backend_expiration_time = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] cache.config_prefix = cache.oslo {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] cache.debug_cache_backend = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] cache.enable_retry_client = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] cache.enable_socket_keepalive = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] cache.enabled = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] cache.expiration_time = 600 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] cache.hashclient_retry_attempts = 2 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] cache.memcache_dead_retry = 300 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] cache.memcache_pool_maxsize = 10 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] cache.memcache_sasl_enabled = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] cache.password = **** {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] cache.proxies = [] {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] cache.redis_db = 0 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] cache.redis_server = localhost:6379 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] cache.retry_attempts = 2 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] cache.retry_delay = 0.0 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] cache.socket_keepalive_count = 1 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] cache.socket_keepalive_idle = 1 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] cache.socket_keepalive_interval = 1 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] cache.socket_timeout = 1.0 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] cache.tls_allowed_ciphers = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] cache.tls_cafile = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] cache.tls_certfile = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] cache.tls_enabled = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] cache.tls_keyfile = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] cache.username = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] coordination.backend_url = **** {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] database.asyncio_connection = **** {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] database.asyncio_slave_connection = **** {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] database.backend = sqlalchemy {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] database.connection = **** {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] database.connection_debug = 0 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] database.connection_parameters = {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] database.connection_recycle_time = 3600 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] database.connection_trace = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] database.db_inc_retry_interval = True {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] database.db_max_retries = 20 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] database.db_max_retry_interval = 10 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] database.db_retry_interval = 1 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] database.max_overflow = 50 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] database.max_pool_size = 5 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] database.max_retries = 10 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] database.mysql_wsrep_sync_wait = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] database.pool_timeout = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] database.retry_interval = 10 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] database.slave_connection = **** {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] database.sqlite_synchronous = True {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] database.synchronous_reader = True {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] database.use_db_reconnect = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] oslo_messaging_tracing.insecure = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] profiler.connection_string = messaging:// {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] profiler.enabled = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] profiler.es_doc_type = notification {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] profiler.es_scroll_size = 10000 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] profiler.es_scroll_time = 2m {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] profiler.filter_error_trace = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] profiler.hmac_keys = **** {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] profiler.sentinel_service_name = mymaster {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-f4c6a3cb-48c4-4469-8efb-58b592537b22 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87576) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] profiler.socket_timeout = 0.1 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.quobyte [None req-f4c6a3cb-48c4-4469-8efb-58b592537b22 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] profiler.trace_requests = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.quobyte [None req-f4c6a3cb-48c4-4469-8efb-58b592537b22 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] profiler.trace_sqlalchemy = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] profiler_jaeger.process_tags = {} {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] profiler_jaeger.service_name_prefix = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] profiler_otlp.service_name_prefix = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f4c6a3cb-48c4-4469-8efb-58b592537b22 None None] Running cmd (subprocess): mount.quobyte {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] oslo_policy.enforce_new_defaults = True {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] oslo_policy.policy_default_rule = default {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] oslo_policy.policy_file = policy.yaml {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] privsep_osbrick.group = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] privsep_osbrick.helper_command = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] privsep_osbrick.user = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] cinder_sys_admin.group = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] cinder_sys_admin.helper_command = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] cinder_sys_admin.user = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] service_user.auth_section = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] service_user.auth_type = password {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] service_user.cafile = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] service_user.certfile = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] service_user.collect_timing = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] service_user.insecure = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] service_user.keyfile = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] service_user.send_service_user_token = True {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] service_user.split_loggers = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] service_user.timeout = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] service_user.tls_ciphers = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] service_user.tls_min_version = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] glance.auth_section = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] glance.auth_type = password {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] glance.certfile = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] glance.collect_timing = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] glance.insecure = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] glance.keyfile = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] glance.region_name = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] glance.split_loggers = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] glance.timeout = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] glance.tls_ciphers = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] glance.tls_min_version = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.backend_availability_zone = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.chap_password = **** {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.chap_username = {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.disk_geometry = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.driver_client_cert = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.driver_client_cert_key = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.driver_data_namespace = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.driver_use_ssl = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.extra_capabilities = {} {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.filter_function = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.goodness_function = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.iscsi_target_flags = {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.iscsi_write_cache = on {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.iser_helper = tgtadm {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.iser_ip_address = 192.168.122.214 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.iser_port = 3260 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.nas_host = {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.nas_login = admin {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.nas_mount_options = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.nas_password = **** {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.nas_private_key = {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.nas_share_path = {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.num_shell_tries = 3 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.quobyte_volume_url = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.replication_device = **** {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.report_discard_supported = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.reserved_percentage = 0 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.target_helper = tgtadm {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.target_ip_address = 192.168.122.214 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.target_port = 3260 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.target_protocol = iscsi {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.trace_flags = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.unique_fqdn_network = True {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.use_chap_auth = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.volume_backend_name = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.volume_clear = zero {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.volume_clear_ionice = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.volume_clear_size = 0 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] oslo_reports.file_event_handler = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] oslo_reports.log_dir = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.backend_availability_zone = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.backend_host = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.chap_password = **** {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.chap_username = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.chiscsi_conf = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.disk_geometry = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.driver_client_cert = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.driver_data_namespace = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.driver_use_ssl = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.extra_capabilities = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.filter_function = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.goodness_function = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f4c6a3cb-48c4-4469-8efb-58b592537b22 None None] CMD "mount.quobyte" returned: 1 in 0.051s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f4c6a3cb-48c4-4469-8efb-58b592537b22 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.iser_helper = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f4c6a3cb-48c4-4469-8efb-58b592537b22 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.iser_ip_address = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-f4c6a3cb-48c4-4469-8efb-58b592537b22 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.iser_port = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.iser_target_prefix = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.nas_host = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.nas_login = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.nas_mount_options = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.nas_password = **** {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.nas_private_key = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.nas_share_path = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.nas_ssh_port = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.num_shell_tries = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.nvmet_port_id = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-f4c6a3cb-48c4-4469-8efb-58b592537b22 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f4c6a3cb-48c4-4469-8efb-58b592537b22 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f4c6a3cb-48c4-4469-8efb-58b592537b22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.replication_device = **** {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.report_discard_supported = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.reserved_percentage = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.scst_target_driver = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.storage_protocol = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.target_helper = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.target_ip_address = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.target_port = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.target_prefix = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.target_protocol = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.trace_flags = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.use_chap_auth = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.volume_clear = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.volume_clear_size = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] QuobyteHD.volumes_dir = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] oslo_messaging_rabbit.ssl = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] oslo_messaging_notifications.driver = [] {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] oslo_messaging_notifications.retry = -1 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] key_manager.fixed_key = **** {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] barbican.barbican_api_version = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] barbican.barbican_endpoint = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] barbican.barbican_endpoint_type = public {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] barbican.barbican_region_name = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] barbican.cafile = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] barbican.certfile = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] barbican.collect_timing = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] barbican.insecure = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] barbican.keyfile = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] barbican.number_of_retries = 60 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] barbican.retry_delay = 1 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] barbican.send_service_user_token = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] barbican.split_loggers = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] barbican.timeout = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] barbican.tls_ciphers = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] barbican.tls_min_version = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] barbican.verify_ssl = True {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] barbican.verify_ssl_path = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] barbican_service_user.auth_section = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] barbican_service_user.auth_type = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack sudo[87578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] barbican_service_user.cafile = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] barbican_service_user.certfile = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] barbican_service_user.collect_timing = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] barbican_service_user.insecure = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] barbican_service_user.keyfile = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] barbican_service_user.split_loggers = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] barbican_service_user.timeout = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] barbican_service_user.tls_ciphers = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] barbican_service_user.tls_min_version = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] vault.approle_role_id = **** {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] vault.approle_secret_id = **** {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] vault.auth_method = approle {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] vault.auth_path = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack sudo[87578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] vault.kv_mountpoint = secret {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] vault.kv_path = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] vault.kv_version = 2 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] vault.namespace = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] vault.root_token_id = **** {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] vault.ssl_ca_crt_file = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] vault.timeout = 60.0 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] vault.token_file = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] vault.token_role = None {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] vault.use_ssl = False {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 22:37:51 devstack cinder-volume[87280]: DEBUG oslo_service.backend._eventlet.service [None req-5f1a97b0-efd3-433e-afea-f7b7a6d24fe0 None None] ******************************************************************************** {{(pid=87280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 04 22:37:51 devstack sudo[87578]: pam_unix(sudo:session): session closed for user root Sep 04 22:37:51 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f4c6a3cb-48c4-4469-8efb-58b592537b22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.268s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:37:51 devstack cinder-volume[87576]: INFO cinder.volume.driver [None req-f4c6a3cb-48c4-4469-8efb-58b592537b22 None None] Driver hasn't implemented _init_vendor_properties() Sep 04 22:37:51 devstack cinder-volume[87576]: DEBUG cinder.volume.driver [None req-f4c6a3cb-48c4-4469-8efb-58b592537b22 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7158851623535, 'free_capacity_gb': 1773.7158851623535, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87576) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 04 22:37:52 devstack cinder-volume[87576]: DEBUG oslo_db.sqlalchemy.engines [None req-f4c6a3cb-48c4-4469-8efb-58b592537b22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87576) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 22:37:52 devstack cinder-volume[87576]: DEBUG dbcounter [-] [87576] Writer thread running {{(pid=87576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 04 22:37:52 devstack cinder-volume[87576]: DEBUG cinder.db.api [None req-f4c6a3cb-48c4-4469-8efb-58b592537b22 None None] Building query based on filter {{(pid=87576) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 04 22:37:52 devstack cinder-volume[87576]: DEBUG cinder.image.image_utils [None req-f4c6a3cb-48c4-4469-8efb-58b592537b22 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87576) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 04 22:37:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f4c6a3cb-48c4-4469-8efb-58b592537b22 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:37:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f4c6a3cb-48c4-4469-8efb-58b592537b22 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:37:52 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-f4c6a3cb-48c4-4469-8efb-58b592537b22 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:37:52 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-f4c6a3cb-48c4-4469-8efb-58b592537b22 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:37:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f4c6a3cb-48c4-4469-8efb-58b592537b22 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:37:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f4c6a3cb-48c4-4469-8efb-58b592537b22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:37:52 devstack cinder-volume[87576]: INFO cinder.keymgr.migration [None req-1b622015-c0a2-4c1b-8d7b-60beabf25de7 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 04 22:37:52 devstack sudo[87593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:37:52 devstack sudo[87593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:37:52 devstack sudo[87593]: pam_unix(sudo:session): session closed for user root Sep 04 22:37:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f4c6a3cb-48c4-4469-8efb-58b592537b22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.246s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:37:52 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-f4c6a3cb-48c4-4469-8efb-58b592537b22 None None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:37:52 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-f4c6a3cb-48c4-4469-8efb-58b592537b22 None None] Driver initialization completed successfully. Sep 04 22:37:52 devstack cinder-volume[87576]: INFO cinder.manager [None req-f4c6a3cb-48c4-4469-8efb-58b592537b22 None None] Initiating service 3 cleanup Sep 04 22:37:52 devstack cinder-volume[87576]: INFO cinder.manager [None req-f4c6a3cb-48c4-4469-8efb-58b592537b22 None None] Service 3 cleanup completed. Sep 04 22:37:52 devstack cinder-volume[87576]: DEBUG cinder.service [None req-f4c6a3cb-48c4-4469-8efb-58b592537b22 None None] Creating RPC server for service cinder-volume {{(pid=87576) start /opt/stack/cinder/cinder/service.py:231}} Sep 04 22:37:52 devstack cinder-volume[87576]: DEBUG cinder.service [None req-f4c6a3cb-48c4-4469-8efb-58b592537b22 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87576) start /opt/stack/cinder/cinder/service.py:237}} Sep 04 22:37:52 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-f4c6a3cb-48c4-4469-8efb-58b592537b22 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 04 22:37:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f4c6a3cb-48c4-4469-8efb-58b592537b22 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:37:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f4c6a3cb-48c4-4469-8efb-58b592537b22 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:37:52 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-f4c6a3cb-48c4-4469-8efb-58b592537b22 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:37:52 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-f4c6a3cb-48c4-4469-8efb-58b592537b22 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:37:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f4c6a3cb-48c4-4469-8efb-58b592537b22 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:37:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f4c6a3cb-48c4-4469-8efb-58b592537b22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:37:52 devstack sudo[87604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:37:52 devstack sudo[87604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:37:52 devstack sudo[87604]: pam_unix(sudo:session): session closed for user root Sep 04 22:37:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f4c6a3cb-48c4-4469-8efb-58b592537b22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.240s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:37:52 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-f4c6a3cb-48c4-4469-8efb-58b592537b22 None None] Driver post RPC initialization completed successfully. Sep 04 22:38:01 devstack cinder-volume[87280]: DEBUG dbcounter [-] [87280] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87280) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 22:38:02 devstack cinder-volume[87576]: DEBUG dbcounter [-] [87576] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=87576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 22:38:02 devstack cinder-volume[87576]: DEBUG dbcounter [-] [87576] Writing DB stats cinder:SELECT=4 {{(pid=87576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 22:38:11 devstack cinder-volume[87576]: DEBUG oslo_service.periodic_task [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Running periodic task VolumeManager._thread_info {{(pid=87576) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 22:38:11 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] thread count: 6 {{(pid=87576) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 22:38:11 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] thread info: [<_MainThread(MainThread, started 125730416963712)>, , , , , ] {{(pid=87576) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 22:38:50 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-ece7ab10-c88f-4c6c-919b-23f1428d885c tempest-DeleteServersTestJSON-1988961172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:38:50 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-ece7ab10-c88f-4c6c-919b-23f1428d885c tempest-DeleteServersTestJSON-1988961172 None] Flow 'volume_create_manager' (082d778e-1c34-45e4-92e7-aec99e70f9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:38:50 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-ece7ab10-c88f-4c6c-919b-23f1428d885c tempest-DeleteServersTestJSON-1988961172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a05b3b9-733d-4b5f-bd89-e4aabd0bcde1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:38:50 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-ece7ab10-c88f-4c6c-919b-23f1428d885c tempest-DeleteServersTestJSON-1988961172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a05b3b9-733d-4b5f-bd89-e4aabd0bcde1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:38:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-137157830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3568198-ec9b-4972-af4a-3b1998171da9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d35cc2461d2485d96720fa9aab588ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:38:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:38:50Z,use_quota=True,user_id='0882fb25078d47e3a06df4bcb5b4afae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:38:50 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-ece7ab10-c88f-4c6c-919b-23f1428d885c tempest-DeleteServersTestJSON-1988961172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8730a519-f1d4-4df5-bbcd-ad4024a75242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:38:50 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-ece7ab10-c88f-4c6c-919b-23f1428d885c tempest-DeleteServersTestJSON-1988961172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8730a519-f1d4-4df5-bbcd-ad4024a75242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:38:50 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-ece7ab10-c88f-4c6c-919b-23f1428d885c tempest-DeleteServersTestJSON-1988961172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (534a5434-fcd4-42b9-a220-548a1c8bfe73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:38:50 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-ece7ab10-c88f-4c6c-919b-23f1428d885c tempest-DeleteServersTestJSON-1988961172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (534a5434-fcd4-42b9-a220-548a1c8bfe73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3568198-ec9b-4972-af4a-3b1998171da9', 'volume_name': 'volume-e3568198-ec9b-4972-af4a-3b1998171da9', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:38:50 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-ece7ab10-c88f-4c6c-919b-23f1428d885c tempest-DeleteServersTestJSON-1988961172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c88bf612-5be9-47c2-9764-6d782998a010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:38:50 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-ece7ab10-c88f-4c6c-919b-23f1428d885c tempest-DeleteServersTestJSON-1988961172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c88bf612-5be9-47c2-9764-6d782998a010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:38:50 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-ece7ab10-c88f-4c6c-919b-23f1428d885c tempest-DeleteServersTestJSON-1988961172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dbf74ed-f254-4241-8021-e55fb82de0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:38:50 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-ece7ab10-c88f-4c6c-919b-23f1428d885c tempest-DeleteServersTestJSON-1988961172 None] Volume e3568198-ec9b-4972-af4a-3b1998171da9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3568198-ec9b-4972-af4a-3b1998171da9', 'volume_size': 1} Sep 04 22:38:50 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-ece7ab10-c88f-4c6c-919b-23f1428d885c tempest-DeleteServersTestJSON-1988961172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:38:50 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-ece7ab10-c88f-4c6c-919b-23f1428d885c tempest-DeleteServersTestJSON-1988961172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:38:50 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-ece7ab10-c88f-4c6c-919b-23f1428d885c tempest-DeleteServersTestJSON-1988961172 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:38:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-137157830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3568198-ec9b-4972-af4a-3b1998171da9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d35cc2461d2485d96720fa9aab588ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:38:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:38:50Z,use_quota=True,user_id='0882fb25078d47e3a06df4bcb5b4afae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:38:50 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-ece7ab10-c88f-4c6c-919b-23f1428d885c tempest-DeleteServersTestJSON-1988961172 None] Creating volume e3568198-ec9b-4972-af4a-3b1998171da9 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:38:50 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-ece7ab10-c88f-4c6c-919b-23f1428d885c tempest-DeleteServersTestJSON-1988961172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:38:50 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-ece7ab10-c88f-4c6c-919b-23f1428d885c tempest-DeleteServersTestJSON-1988961172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:38:50 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-ece7ab10-c88f-4c6c-919b-23f1428d885c tempest-DeleteServersTestJSON-1988961172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:38:50 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-ece7ab10-c88f-4c6c-919b-23f1428d885c tempest-DeleteServersTestJSON-1988961172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:38:50 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-ece7ab10-c88f-4c6c-919b-23f1428d885c tempest-DeleteServersTestJSON-1988961172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:38:50 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-ece7ab10-c88f-4c6c-919b-23f1428d885c tempest-DeleteServersTestJSON-1988961172 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:38:50 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-ece7ab10-c88f-4c6c-919b-23f1428d885c tempest-DeleteServersTestJSON-1988961172 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:38:50 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ece7ab10-c88f-4c6c-919b-23f1428d885c tempest-DeleteServersTestJSON-1988961172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e3568198-ec9b-4972-af4a-3b1998171da9 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:38:50 devstack sudo[88319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e3568198-ec9b-4972-af4a-3b1998171da9 1073741824 Sep 04 22:38:50 devstack sudo[88319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:38:50 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-dca24dcc-1d98-4511-ac3a-016a1066612c tempest-SnapshotsActionsTest-182824703 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:38:50 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-dca24dcc-1d98-4511-ac3a-016a1066612c tempest-SnapshotsActionsTest-182824703 None] Flow 'volume_create_manager' (0593bb8f-fe81-4177-b40c-2f38838cf20e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:38:51 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-dca24dcc-1d98-4511-ac3a-016a1066612c tempest-SnapshotsActionsTest-182824703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fc123da-d0d4-46b0-aa89-29c3d6685537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:38:51 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-dca24dcc-1d98-4511-ac3a-016a1066612c tempest-SnapshotsActionsTest-182824703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fc123da-d0d4-46b0-aa89-29c3d6685537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:38:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-530863322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1967a16-ac2c-45d4-bdc8-77c13cf4830e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d49c3e56fdc4e559c8d0215733e1cfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:38:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:38:51Z,use_quota=True,user_id='874ea8df2212453d8a58841c340aeffb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:38:51 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-dca24dcc-1d98-4511-ac3a-016a1066612c tempest-SnapshotsActionsTest-182824703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0e95af9-75e2-4159-aac2-d1d8f671b979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:38:51 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-dca24dcc-1d98-4511-ac3a-016a1066612c tempest-SnapshotsActionsTest-182824703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0e95af9-75e2-4159-aac2-d1d8f671b979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:38:51 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-dca24dcc-1d98-4511-ac3a-016a1066612c tempest-SnapshotsActionsTest-182824703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b98dbbb8-49d6-4f8d-a490-fac9ffb8c01e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:38:51 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-dca24dcc-1d98-4511-ac3a-016a1066612c tempest-SnapshotsActionsTest-182824703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b98dbbb8-49d6-4f8d-a490-fac9ffb8c01e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1967a16-ac2c-45d4-bdc8-77c13cf4830e', 'volume_name': 'volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:38:51 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-dca24dcc-1d98-4511-ac3a-016a1066612c tempest-SnapshotsActionsTest-182824703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b85e2bf4-8130-4358-8a32-bdcffff4fd83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:38:51 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-dca24dcc-1d98-4511-ac3a-016a1066612c tempest-SnapshotsActionsTest-182824703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b85e2bf4-8130-4358-8a32-bdcffff4fd83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:38:51 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-dca24dcc-1d98-4511-ac3a-016a1066612c tempest-SnapshotsActionsTest-182824703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f06acfd-97a1-49e8-a25a-51b23ca0ff44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:38:51 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-dca24dcc-1d98-4511-ac3a-016a1066612c tempest-SnapshotsActionsTest-182824703 None] Volume e1967a16-ac2c-45d4-bdc8-77c13cf4830e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e', 'volume_size': 1} Sep 04 22:38:51 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-dca24dcc-1d98-4511-ac3a-016a1066612c tempest-SnapshotsActionsTest-182824703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:38:51 devstack sudo[88319]: pam_unix(sudo:session): session closed for user root Sep 04 22:38:51 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ece7ab10-c88f-4c6c-919b-23f1428d885c tempest-DeleteServersTestJSON-1988961172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e3568198-ec9b-4972-af4a-3b1998171da9 1073741824" returned: 0 in 0.655s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:38:51 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ece7ab10-c88f-4c6c-919b-23f1428d885c tempest-DeleteServersTestJSON-1988961172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e3568198-ec9b-4972-af4a-3b1998171da9 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:38:51 devstack sudo[88638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e3568198-ec9b-4972-af4a-3b1998171da9 Sep 04 22:38:51 devstack sudo[88638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:38:51 devstack sudo[88638]: pam_unix(sudo:session): session closed for user root Sep 04 22:38:51 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ece7ab10-c88f-4c6c-919b-23f1428d885c tempest-DeleteServersTestJSON-1988961172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e3568198-ec9b-4972-af4a-3b1998171da9" returned: 0 in 0.249s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:38:51 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-ece7ab10-c88f-4c6c-919b-23f1428d885c tempest-DeleteServersTestJSON-1988961172 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:38:51 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-ece7ab10-c88f-4c6c-919b-23f1428d885c tempest-DeleteServersTestJSON-1988961172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:38:51 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-dca24dcc-1d98-4511-ac3a-016a1066612c tempest-SnapshotsActionsTest-182824703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.685s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:38:51 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-dca24dcc-1d98-4511-ac3a-016a1066612c tempest-SnapshotsActionsTest-182824703 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:38:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-530863322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1967a16-ac2c-45d4-bdc8-77c13cf4830e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d49c3e56fdc4e559c8d0215733e1cfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:38:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:38:51Z,use_quota=True,user_id='874ea8df2212453d8a58841c340aeffb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:38:51 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-dca24dcc-1d98-4511-ac3a-016a1066612c tempest-SnapshotsActionsTest-182824703 None] Creating volume e1967a16-ac2c-45d4-bdc8-77c13cf4830e {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:38:51 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-dca24dcc-1d98-4511-ac3a-016a1066612c tempest-SnapshotsActionsTest-182824703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:38:51 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-dca24dcc-1d98-4511-ac3a-016a1066612c tempest-SnapshotsActionsTest-182824703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:38:51 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-dca24dcc-1d98-4511-ac3a-016a1066612c tempest-SnapshotsActionsTest-182824703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:38:51 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-dca24dcc-1d98-4511-ac3a-016a1066612c tempest-SnapshotsActionsTest-182824703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:38:51 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-dca24dcc-1d98-4511-ac3a-016a1066612c tempest-SnapshotsActionsTest-182824703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:38:51 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-dca24dcc-1d98-4511-ac3a-016a1066612c tempest-SnapshotsActionsTest-182824703 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:38:51 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-dca24dcc-1d98-4511-ac3a-016a1066612c tempest-SnapshotsActionsTest-182824703 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:38:51 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-dca24dcc-1d98-4511-ac3a-016a1066612c tempest-SnapshotsActionsTest-182824703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:38:51 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-ece7ab10-c88f-4c6c-919b-23f1428d885c tempest-DeleteServersTestJSON-1988961172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dbf74ed-f254-4241-8021-e55fb82de0db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3568198-ec9b-4972-af4a-3b1998171da9', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:38:51 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-ece7ab10-c88f-4c6c-919b-23f1428d885c tempest-DeleteServersTestJSON-1988961172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2409653c-efda-4f72-a658-3ec62aa254cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:38:51 devstack sudo[88641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e 1073741824 Sep 04 22:38:51 devstack sudo[88641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:38:51 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-ece7ab10-c88f-4c6c-919b-23f1428d885c tempest-DeleteServersTestJSON-1988961172 None] Volume volume-e3568198-ec9b-4972-af4a-3b1998171da9 (e3568198-ec9b-4972-af4a-3b1998171da9): created successfully Sep 04 22:38:51 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-ece7ab10-c88f-4c6c-919b-23f1428d885c tempest-DeleteServersTestJSON-1988961172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2409653c-efda-4f72-a658-3ec62aa254cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:38:51 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-ece7ab10-c88f-4c6c-919b-23f1428d885c tempest-DeleteServersTestJSON-1988961172 None] Flow 'volume_create_manager' (082d778e-1c34-45e4-92e7-aec99e70f9b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:38:51 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-ece7ab10-c88f-4c6c-919b-23f1428d885c tempest-DeleteServersTestJSON-1988961172 None] Created volume successfully. Sep 04 22:38:52 devstack sudo[88641]: pam_unix(sudo:session): session closed for user root Sep 04 22:38:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-dca24dcc-1d98-4511-ac3a-016a1066612c tempest-SnapshotsActionsTest-182824703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e 1073741824" returned: 0 in 0.468s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:38:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-dca24dcc-1d98-4511-ac3a-016a1066612c tempest-SnapshotsActionsTest-182824703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:38:52 devstack sudo[88647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e Sep 04 22:38:52 devstack sudo[88647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:38:52 devstack sudo[88647]: pam_unix(sudo:session): session closed for user root Sep 04 22:38:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-dca24dcc-1d98-4511-ac3a-016a1066612c tempest-SnapshotsActionsTest-182824703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e" returned: 0 in 0.294s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:38:52 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-dca24dcc-1d98-4511-ac3a-016a1066612c tempest-SnapshotsActionsTest-182824703 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:38:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-dca24dcc-1d98-4511-ac3a-016a1066612c tempest-SnapshotsActionsTest-182824703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:38:52 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-dca24dcc-1d98-4511-ac3a-016a1066612c tempest-SnapshotsActionsTest-182824703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f06acfd-97a1-49e8-a25a-51b23ca0ff44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:38:52 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-dca24dcc-1d98-4511-ac3a-016a1066612c tempest-SnapshotsActionsTest-182824703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81171214-b849-4c77-b0f6-c1f3b8f446fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:38:52 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-dca24dcc-1d98-4511-ac3a-016a1066612c tempest-SnapshotsActionsTest-182824703 None] Volume volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e (e1967a16-ac2c-45d4-bdc8-77c13cf4830e): created successfully Sep 04 22:38:52 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-dca24dcc-1d98-4511-ac3a-016a1066612c tempest-SnapshotsActionsTest-182824703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81171214-b849-4c77-b0f6-c1f3b8f446fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:38:52 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-dca24dcc-1d98-4511-ac3a-016a1066612c tempest-SnapshotsActionsTest-182824703 None] Flow 'volume_create_manager' (0593bb8f-fe81-4177-b40c-2f38838cf20e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:38:52 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-dca24dcc-1d98-4511-ac3a-016a1066612c tempest-SnapshotsActionsTest-182824703 None] Created volume successfully. Sep 04 22:38:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-df0e3949-7a1d-48d3-9b70-68ce43c4c637 tempest-SnapshotsActionsTest-182824703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:38:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-df0e3949-7a1d-48d3-9b70-68ce43c4c637 tempest-SnapshotsActionsTest-182824703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:38:54 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-df0e3949-7a1d-48d3-9b70-68ce43c4c637 tempest-SnapshotsActionsTest-182824703 None] Creating offline snapshot e86157e3-7834-4a13-8933-e777215f4058 of volume e1967a16-ac2c-45d4-bdc8-77c13cf4830e {{(pid=87576) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 22:38:54 devstack cinder-volume[87576]: INFO oslo.privsep.daemon [None req-df0e3949-7a1d-48d3-9b70-68ce43c4c637 tempest-SnapshotsActionsTest-182824703 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpiilf9e7d/privsep.sock'] Sep 04 22:38:54 devstack sudo[88656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpiilf9e7d/privsep.sock Sep 04 22:38:54 devstack sudo[88656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:38:55 devstack cinder-volume[87576]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 04 22:38:55 devstack cinder-volume[87576]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 04 22:38:55 devstack cinder-volume[87576]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 04 22:38:55 devstack cinder-volume[87576]: WARNING oslo.privsep.daemon [-] privsep log: Sep 04 22:38:55 devstack cinder-volume[87576]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 04 22:38:55 devstack cinder-volume[87576]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 04 22:38:55 devstack cinder-volume[87576]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 04 22:38:55 devstack cinder-volume[87576]: WARNING oslo.privsep.daemon [-] privsep log: Sep 04 22:38:55 devstack cinder-volume[87576]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 04 22:38:55 devstack sudo[88656]: pam_unix(sudo:session): session closed for user root Sep 04 22:38:55 devstack cinder-volume[87576]: INFO oslo.privsep.daemon [None req-df0e3949-7a1d-48d3-9b70-68ce43c4c637 tempest-SnapshotsActionsTest-182824703 None] Spawned new privsep daemon via rootwrap Sep 04 22:38:55 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [None req-df0e3949-7a1d-48d3-9b70-68ce43c4c637 tempest-SnapshotsActionsTest-182824703 None] Accepted privsep connection to /tmp/tmpiilf9e7d/privsep.sock {{(pid=87576) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 04 22:38:55 devstack cinder-volume[87576]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 04 22:38:55 devstack cinder-volume[87576]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 04 22:38:55 devstack cinder-volume[87576]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 04 22:38:55 devstack cinder-volume[87576]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88666 Sep 04 22:38:55 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e42b39-df2a-4444-96ae-13dd6573bb5b]: (2,) {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:38:55 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4c302a-a627-41e4-8a71-54518de38247]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:38:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-df0e3949-7a1d-48d3-9b70-68ce43c4c637 tempest-SnapshotsActionsTest-182824703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:38:55 devstack sudo[88669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e Sep 04 22:38:55 devstack sudo[88669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:38:56 devstack sudo[88669]: pam_unix(sudo:session): session closed for user root Sep 04 22:38:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-df0e3949-7a1d-48d3-9b70-68ce43c4c637 tempest-SnapshotsActionsTest-182824703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e" returned: 0 in 0.507s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:38:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-df0e3949-7a1d-48d3-9b70-68ce43c4c637 tempest-SnapshotsActionsTest-182824703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.e86157e3-7834-4a13-8933-e777215f4058 1G {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:38:56 devstack sudo[88740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.e86157e3-7834-4a13-8933-e777215f4058 1G Sep 04 22:38:56 devstack sudo[88740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:38:56 devstack cinder-volume[87576]: WARNING py.warnings [req-d4ce0c0f-1827-497b-a0df-d5f53035acb8 req-75423bdd-be83-485c-a90f-407e333e45c3 tempest-DeleteServersTestJSON-1988961172 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Sep 04 22:38:56 devstack cinder-volume[87576]: .first() Sep 04 22:38:56 devstack cinder-volume[87576]: Sep 04 22:38:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-d4ce0c0f-1827-497b-a0df-d5f53035acb8 req-75423bdd-be83-485c-a90f-407e333e45c3 tempest-DeleteServersTestJSON-1988961172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:38:56 devstack sudo[88740]: pam_unix(sudo:session): session closed for user root Sep 04 22:38:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-df0e3949-7a1d-48d3-9b70-68ce43c4c637 tempest-SnapshotsActionsTest-182824703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.e86157e3-7834-4a13-8933-e777215f4058 1G" returned: 0 in 0.500s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:38:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-df0e3949-7a1d-48d3-9b70-68ce43c4c637 tempest-SnapshotsActionsTest-182824703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.e86157e3-7834-4a13-8933-e777215f4058 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:38:56 devstack sudo[88746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.e86157e3-7834-4a13-8933-e777215f4058 Sep 04 22:38:56 devstack sudo[88746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:38:57 devstack sudo[88746]: pam_unix(sudo:session): session closed for user root Sep 04 22:38:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-df0e3949-7a1d-48d3-9b70-68ce43c4c637 tempest-SnapshotsActionsTest-182824703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.e86157e3-7834-4a13-8933-e777215f4058" returned: 0 in 0.294s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:38:57 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-df0e3949-7a1d-48d3-9b70-68ce43c4c637 tempest-SnapshotsActionsTest-182824703 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.e86157e3-7834-4a13-8933-e777215f4058 is being set with open permissions: ugo+rw Sep 04 22:38:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-df0e3949-7a1d-48d3-9b70-68ce43c4c637 tempest-SnapshotsActionsTest-182824703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.e86157e3-7834-4a13-8933-e777215f4058 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:38:57 devstack sudo[88751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.e86157e3-7834-4a13-8933-e777215f4058 Sep 04 22:38:57 devstack sudo[88751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:38:57 devstack sudo[88751]: pam_unix(sudo:session): session closed for user root Sep 04 22:38:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-df0e3949-7a1d-48d3-9b70-68ce43c4c637 tempest-SnapshotsActionsTest-182824703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.e86157e3-7834-4a13-8933-e777215f4058" returned: 0 in 0.257s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:38:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-df0e3949-7a1d-48d3-9b70-68ce43c4c637 tempest-SnapshotsActionsTest-182824703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:38:57 devstack sudo[88755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.info Sep 04 22:38:57 devstack sudo[88755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:38:57 devstack sudo[88755]: pam_unix(sudo:session): session closed for user root Sep 04 22:38:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-df0e3949-7a1d-48d3-9b70-68ce43c4c637 tempest-SnapshotsActionsTest-182824703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.info" returned: 0 in 0.249s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:38:57 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-df0e3949-7a1d-48d3-9b70-68ce43c4c637 tempest-SnapshotsActionsTest-182824703 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.info is being set with open permissions: ugo+rw Sep 04 22:38:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-df0e3949-7a1d-48d3-9b70-68ce43c4c637 tempest-SnapshotsActionsTest-182824703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:38:57 devstack sudo[88758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.info Sep 04 22:38:57 devstack sudo[88758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:38:57 devstack sudo[88758]: pam_unix(sudo:session): session closed for user root Sep 04 22:38:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-df0e3949-7a1d-48d3-9b70-68ce43c4c637 tempest-SnapshotsActionsTest-182824703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.info" returned: 0 in 0.236s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:38:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-df0e3949-7a1d-48d3-9b70-68ce43c4c637 tempest-SnapshotsActionsTest-182824703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.863s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:38:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-d4ce0c0f-1827-497b-a0df-d5f53035acb8 req-75423bdd-be83-485c-a90f-407e333e45c3 tempest-DeleteServersTestJSON-1988961172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.399s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:38:57 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-df0e3949-7a1d-48d3-9b70-68ce43c4c637 tempest-SnapshotsActionsTest-182824703 None] Create snapshot completed successfully Sep 04 22:38:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-d4ce0c0f-1827-497b-a0df-d5f53035acb8 req-75423bdd-be83-485c-a90f-407e333e45c3 tempest-DeleteServersTestJSON-1988961172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.117s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:38:58 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-d4ce0c0f-1827-497b-a0df-d5f53035acb8 req-75423bdd-be83-485c-a90f-407e333e45c3 tempest-DeleteServersTestJSON-1988961172 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4', 'name': 'volume-e3568198-ec9b-4972-af4a-3b1998171da9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a80e2efa-e1e9-4274-85b1-606086241826', 'enforce_multipath': True} {{(pid=87576) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 22:38:58 devstack cinder-volume[87576]: INFO cinder.volume.manager [req-d4ce0c0f-1827-497b-a0df-d5f53035acb8 req-75423bdd-be83-485c-a90f-407e333e45c3 tempest-DeleteServersTestJSON-1988961172 None] attachment_update completed successfully. Sep 04 22:38:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-faa062ae-bcb1-4025-aa83-b78def82050a tempest-SnapshotsActionsTest-182824703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:38:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-faa062ae-bcb1-4025-aa83-b78def82050a tempest-SnapshotsActionsTest-182824703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:38:58 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-faa062ae-bcb1-4025-aa83-b78def82050a tempest-SnapshotsActionsTest-182824703 None] Creating offline snapshot ba6e1079-7534-4305-a199-4fe5cf8fa27d of volume e1967a16-ac2c-45d4-bdc8-77c13cf4830e {{(pid=87576) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 22:38:59 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[8edab013-fee1-470c-803c-16d04a623e7a]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:38:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-faa062ae-bcb1-4025-aa83-b78def82050a tempest-SnapshotsActionsTest-182824703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.e86157e3-7834-4a13-8933-e777215f4058 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:38:59 devstack sudo[89148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.e86157e3-7834-4a13-8933-e777215f4058 Sep 04 22:38:59 devstack sudo[89148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:38:59 devstack sudo[89148]: pam_unix(sudo:session): session closed for user root Sep 04 22:38:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-faa062ae-bcb1-4025-aa83-b78def82050a tempest-SnapshotsActionsTest-182824703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.e86157e3-7834-4a13-8933-e777215f4058" returned: 0 in 0.516s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:38:59 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-faa062ae-bcb1-4025-aa83-b78def82050a tempest-SnapshotsActionsTest-182824703 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 22:38:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-faa062ae-bcb1-4025-aa83-b78def82050a tempest-SnapshotsActionsTest-182824703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.e86157e3-7834-4a13-8933-e777215f4058,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.ba6e1079-7534-4305-a199-4fe5cf8fa27d 1G {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:38:59 devstack sudo[89154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.e86157e3-7834-4a13-8933-e777215f4058,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.ba6e1079-7534-4305-a199-4fe5cf8fa27d 1G Sep 04 22:38:59 devstack sudo[89154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:39:00 devstack sudo[89154]: pam_unix(sudo:session): session closed for user root Sep 04 22:39:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-faa062ae-bcb1-4025-aa83-b78def82050a tempest-SnapshotsActionsTest-182824703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.e86157e3-7834-4a13-8933-e777215f4058,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.ba6e1079-7534-4305-a199-4fe5cf8fa27d 1G" returned: 0 in 0.635s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:39:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-faa062ae-bcb1-4025-aa83-b78def82050a tempest-SnapshotsActionsTest-182824703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.e86157e3-7834-4a13-8933-e777215f4058 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.ba6e1079-7534-4305-a199-4fe5cf8fa27d {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:39:00 devstack sudo[89160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.e86157e3-7834-4a13-8933-e777215f4058 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.ba6e1079-7534-4305-a199-4fe5cf8fa27d Sep 04 22:39:00 devstack sudo[89160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:39:00 devstack sudo[89160]: pam_unix(sudo:session): session closed for user root Sep 04 22:39:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-faa062ae-bcb1-4025-aa83-b78def82050a tempest-SnapshotsActionsTest-182824703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.e86157e3-7834-4a13-8933-e777215f4058 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.ba6e1079-7534-4305-a199-4fe5cf8fa27d" returned: 0 in 0.490s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:39:00 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-faa062ae-bcb1-4025-aa83-b78def82050a tempest-SnapshotsActionsTest-182824703 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.ba6e1079-7534-4305-a199-4fe5cf8fa27d is being set with open permissions: ugo+rw Sep 04 22:39:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-faa062ae-bcb1-4025-aa83-b78def82050a tempest-SnapshotsActionsTest-182824703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.ba6e1079-7534-4305-a199-4fe5cf8fa27d {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:39:00 devstack sudo[89167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.ba6e1079-7534-4305-a199-4fe5cf8fa27d Sep 04 22:39:00 devstack sudo[89167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:39:01 devstack sudo[89167]: pam_unix(sudo:session): session closed for user root Sep 04 22:39:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-faa062ae-bcb1-4025-aa83-b78def82050a tempest-SnapshotsActionsTest-182824703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.ba6e1079-7534-4305-a199-4fe5cf8fa27d" returned: 0 in 0.341s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:39:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-faa062ae-bcb1-4025-aa83-b78def82050a tempest-SnapshotsActionsTest-182824703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.124s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:39:01 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-faa062ae-bcb1-4025-aa83-b78def82050a tempest-SnapshotsActionsTest-182824703 None] Create snapshot completed successfully Sep 04 22:39:01 devstack cinder-volume[87576]: INFO cinder.volume.manager [req-529cb38d-642c-4216-ae2d-aac2aa23b360 req-acafe01b-b45f-4394-a9d3-5c730836ab21 tempest-DeleteServersTestJSON-1988961172 None] Terminate volume connection completed successfully. Sep 04 22:39:01 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-529cb38d-642c-4216-ae2d-aac2aa23b360 req-acafe01b-b45f-4394-a9d3-5c730836ab21 tempest-DeleteServersTestJSON-1988961172 None] Deleting attachment a80e2efa-e1e9-4274-85b1-606086241826. {{(pid=87576) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 22:39:02 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-3ddfed2c-3b0b-48a3-8e40-0cdf7979459b tempest-SnapshotsActionsTest-376767662 None] Acquiring lock "cinder-ba6e1079-7534-4305-a199-4fe5cf8fa27d-delete_snapshot" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:39:02 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-3ddfed2c-3b0b-48a3-8e40-0cdf7979459b tempest-SnapshotsActionsTest-376767662 None] Lock "cinder-ba6e1079-7534-4305-a199-4fe5cf8fa27d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:39:02 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-3ddfed2c-3b0b-48a3-8e40-0cdf7979459b tempest-SnapshotsActionsTest-376767662 None] Acquiring lock "cinder-quobyte-e1967a16-ac2c-45d4-bdc8-77c13cf4830e" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:39:02 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-3ddfed2c-3b0b-48a3-8e40-0cdf7979459b tempest-SnapshotsActionsTest-376767662 None] Lock "cinder-quobyte-e1967a16-ac2c-45d4-bdc8-77c13cf4830e" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:39:02 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-3ddfed2c-3b0b-48a3-8e40-0cdf7979459b tempest-SnapshotsActionsTest-376767662 None] Acquiring lock "cinder-quobyte-ba6e1079-7534-4305-a199-4fe5cf8fa27d" by "_delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:39:02 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-3ddfed2c-3b0b-48a3-8e40-0cdf7979459b tempest-SnapshotsActionsTest-376767662 None] Lock "cinder-quobyte-ba6e1079-7534-4305-a199-4fe5cf8fa27d" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:39:02 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-3ddfed2c-3b0b-48a3-8e40-0cdf7979459b tempest-SnapshotsActionsTest-376767662 None] Deleting offline snapshot ba6e1079-7534-4305-a199-4fe5cf8fa27d of volume e1967a16-ac2c-45d4-bdc8-77c13cf4830e {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 22:39:02 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-3ddfed2c-3b0b-48a3-8e40-0cdf7979459b tempest-SnapshotsActionsTest-376767662 None] snapshot_file for this snap is: volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.ba6e1079-7534-4305-a199-4fe5cf8fa27d {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 22:39:02 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[54cfc263-67ca-4ccc-ade2-78fe2ecf7534]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:39:02 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3ddfed2c-3b0b-48a3-8e40-0cdf7979459b tempest-SnapshotsActionsTest-376767662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.ba6e1079-7534-4305-a199-4fe5cf8fa27d {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:39:02 devstack sudo[89223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.ba6e1079-7534-4305-a199-4fe5cf8fa27d Sep 04 22:39:02 devstack sudo[89223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:39:03 devstack sudo[89223]: pam_unix(sudo:session): session closed for user root Sep 04 22:39:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3ddfed2c-3b0b-48a3-8e40-0cdf7979459b tempest-SnapshotsActionsTest-376767662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.ba6e1079-7534-4305-a199-4fe5cf8fa27d" returned: 0 in 0.423s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:39:03 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-3ddfed2c-3b0b-48a3-8e40-0cdf7979459b tempest-SnapshotsActionsTest-376767662 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 22:39:03 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f663ff-8724-4983-9557-5dd03f31f7e4]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:39:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3ddfed2c-3b0b-48a3-8e40-0cdf7979459b tempest-SnapshotsActionsTest-376767662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.e86157e3-7834-4a13-8933-e777215f4058 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:39:03 devstack sudo[89229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.e86157e3-7834-4a13-8933-e777215f4058 Sep 04 22:39:03 devstack sudo[89229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:39:03 devstack sudo[89229]: pam_unix(sudo:session): session closed for user root Sep 04 22:39:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3ddfed2c-3b0b-48a3-8e40-0cdf7979459b tempest-SnapshotsActionsTest-376767662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.e86157e3-7834-4a13-8933-e777215f4058" returned: 0 in 0.566s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:39:03 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-3ddfed2c-3b0b-48a3-8e40-0cdf7979459b tempest-SnapshotsActionsTest-376767662 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 22:39:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3ddfed2c-3b0b-48a3-8e40-0cdf7979459b tempest-SnapshotsActionsTest-376767662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.ba6e1079-7534-4305-a199-4fe5cf8fa27d {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:39:03 devstack sudo[89236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.ba6e1079-7534-4305-a199-4fe5cf8fa27d Sep 04 22:39:03 devstack sudo[89236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:39:03 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-9595d3e4-69bd-48f8-90d1-c3de86c41f65 tempest-DeleteServersTestJSON-1988961172 None] Acquiring lock "cinder-e3568198-ec9b-4972-af4a-3b1998171da9-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:39:03 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-9595d3e4-69bd-48f8-90d1-c3de86c41f65 tempest-DeleteServersTestJSON-1988961172 None] Lock "cinder-e3568198-ec9b-4972-af4a-3b1998171da9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:39:03 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-9595d3e4-69bd-48f8-90d1-c3de86c41f65 tempest-DeleteServersTestJSON-1988961172 None] Acquiring lock "cinder-quobyte-e3568198-ec9b-4972-af4a-3b1998171da9" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:39:03 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-9595d3e4-69bd-48f8-90d1-c3de86c41f65 tempest-DeleteServersTestJSON-1988961172 None] Lock "cinder-quobyte-e3568198-ec9b-4972-af4a-3b1998171da9" acquired by "delete_volume" :: waited 0.027s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:39:03 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a52b02-791f-4abb-a6cc-72f9aebd23ed]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:39:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-9595d3e4-69bd-48f8-90d1-c3de86c41f65 tempest-DeleteServersTestJSON-1988961172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e3568198-ec9b-4972-af4a-3b1998171da9 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:39:04 devstack sudo[89238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e3568198-ec9b-4972-af4a-3b1998171da9 Sep 04 22:39:04 devstack sudo[89238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:39:04 devstack sudo[89236]: pam_unix(sudo:session): session closed for user root Sep 04 22:39:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3ddfed2c-3b0b-48a3-8e40-0cdf7979459b tempest-SnapshotsActionsTest-376767662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.ba6e1079-7534-4305-a199-4fe5cf8fa27d" returned: 0 in 0.464s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:39:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3ddfed2c-3b0b-48a3-8e40-0cdf7979459b tempest-SnapshotsActionsTest-376767662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.ba6e1079-7534-4305-a199-4fe5cf8fa27d {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:39:04 devstack sudo[89244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.ba6e1079-7534-4305-a199-4fe5cf8fa27d Sep 04 22:39:04 devstack sudo[89244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:39:04 devstack sudo[89238]: pam_unix(sudo:session): session closed for user root Sep 04 22:39:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-9595d3e4-69bd-48f8-90d1-c3de86c41f65 tempest-DeleteServersTestJSON-1988961172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e3568198-ec9b-4972-af4a-3b1998171da9" returned: 0 in 0.400s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:39:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-9595d3e4-69bd-48f8-90d1-c3de86c41f65 tempest-DeleteServersTestJSON-1988961172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e3568198-ec9b-4972-af4a-3b1998171da9 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:39:04 devstack sudo[89249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e3568198-ec9b-4972-af4a-3b1998171da9 Sep 04 22:39:04 devstack sudo[89249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:39:04 devstack sudo[89244]: pam_unix(sudo:session): session closed for user root Sep 04 22:39:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3ddfed2c-3b0b-48a3-8e40-0cdf7979459b tempest-SnapshotsActionsTest-376767662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.ba6e1079-7534-4305-a199-4fe5cf8fa27d" returned: 0 in 0.261s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:39:04 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-3ddfed2c-3b0b-48a3-8e40-0cdf7979459b tempest-SnapshotsActionsTest-376767662 None] Lock "cinder-quobyte-ba6e1079-7534-4305-a199-4fe5cf8fa27d" released by "_delete_snapshot" :: held 1.825s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:39:04 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-3ddfed2c-3b0b-48a3-8e40-0cdf7979459b tempest-SnapshotsActionsTest-376767662 None] Lock "cinder-quobyte-e1967a16-ac2c-45d4-bdc8-77c13cf4830e" released by "delete_snapshot" :: held 1.862s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:39:04 devstack cinder-volume[87576]: WARNING cinder.quota [None req-3ddfed2c-3b0b-48a3-8e40-0cdf7979459b tempest-SnapshotsActionsTest-376767662 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 04 22:39:04 devstack cinder-volume[87576]: WARNING cinder.quota [None req-3ddfed2c-3b0b-48a3-8e40-0cdf7979459b tempest-SnapshotsActionsTest-376767662 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 04 22:39:04 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-3ddfed2c-3b0b-48a3-8e40-0cdf7979459b tempest-SnapshotsActionsTest-376767662 None] Created reservations ['163c858e-cd84-44e9-a1f2-1f8435d27b9d', '0ca00cea-f69f-420d-a03b-79fac8b9a408', '0f35e0d7-4134-435c-b573-a5b55c5b758e', '22971c38-d24e-4c33-8442-c273087677d9'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:39:04 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-3ddfed2c-3b0b-48a3-8e40-0cdf7979459b tempest-SnapshotsActionsTest-376767662 None] Delete snapshot completed successfully. Sep 04 22:39:04 devstack sudo[89249]: pam_unix(sudo:session): session closed for user root Sep 04 22:39:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-9595d3e4-69bd-48f8-90d1-c3de86c41f65 tempest-DeleteServersTestJSON-1988961172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e3568198-ec9b-4972-af4a-3b1998171da9" returned: 0 in 0.312s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:39:04 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-3ddfed2c-3b0b-48a3-8e40-0cdf7979459b tempest-SnapshotsActionsTest-376767662 None] Lock "cinder-ba6e1079-7534-4305-a199-4fe5cf8fa27d-delete_snapshot" released by "delete_snapshot" :: held 2.106s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:39:04 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-9595d3e4-69bd-48f8-90d1-c3de86c41f65 tempest-DeleteServersTestJSON-1988961172 None] Lock "cinder-quobyte-e3568198-ec9b-4972-af4a-3b1998171da9" released by "delete_volume" :: held 0.756s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:39:04 devstack cinder-volume[87576]: WARNING cinder.quota [None req-9595d3e4-69bd-48f8-90d1-c3de86c41f65 tempest-DeleteServersTestJSON-1988961172 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 04 22:39:04 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-9595d3e4-69bd-48f8-90d1-c3de86c41f65 tempest-DeleteServersTestJSON-1988961172 None] Created reservations ['7273554a-c4a5-4bf5-92f3-225333d80db2', 'a30c08d9-5cc7-4e83-b85e-c2296fc1c938', '813df16b-46a1-4f02-93f5-6782956799ff', 'cba10ad6-186e-4459-97ea-e650319911ac'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:39:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-9595d3e4-69bd-48f8-90d1-c3de86c41f65 tempest-DeleteServersTestJSON-1988961172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:39:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-9595d3e4-69bd-48f8-90d1-c3de86c41f65 tempest-DeleteServersTestJSON-1988961172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:39:04 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-9595d3e4-69bd-48f8-90d1-c3de86c41f65 tempest-DeleteServersTestJSON-1988961172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:39:04 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-9595d3e4-69bd-48f8-90d1-c3de86c41f65 tempest-DeleteServersTestJSON-1988961172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:39:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-9595d3e4-69bd-48f8-90d1-c3de86c41f65 tempest-DeleteServersTestJSON-1988961172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:39:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-9595d3e4-69bd-48f8-90d1-c3de86c41f65 tempest-DeleteServersTestJSON-1988961172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:39:04 devstack sudo[89253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:39:04 devstack sudo[89253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:39:05 devstack sudo[89253]: pam_unix(sudo:session): session closed for user root Sep 04 22:39:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-9595d3e4-69bd-48f8-90d1-c3de86c41f65 tempest-DeleteServersTestJSON-1988961172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.547s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:39:05 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-9595d3e4-69bd-48f8-90d1-c3de86c41f65 tempest-DeleteServersTestJSON-1988961172 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:39:05 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-9595d3e4-69bd-48f8-90d1-c3de86c41f65 tempest-DeleteServersTestJSON-1988961172 None] Deleted volume successfully. Sep 04 22:39:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-37d09cb4-ccb9-4c6c-b345-e29076404f66 tempest-SnapshotsActionsTest-182824703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:39:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-37d09cb4-ccb9-4c6c-b345-e29076404f66 tempest-SnapshotsActionsTest-182824703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:39:05 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-9595d3e4-69bd-48f8-90d1-c3de86c41f65 tempest-DeleteServersTestJSON-1988961172 None] Lock "cinder-e3568198-ec9b-4972-af4a-3b1998171da9-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:39:05 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-37d09cb4-ccb9-4c6c-b345-e29076404f66 tempest-SnapshotsActionsTest-182824703 None] Creating offline snapshot 982e0014-a839-4efb-9c3f-1149198ca13e of volume e1967a16-ac2c-45d4-bdc8-77c13cf4830e {{(pid=87576) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 22:39:05 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbeff808-45e6-421b-b840-c330ccfebf09]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:39:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-37d09cb4-ccb9-4c6c-b345-e29076404f66 tempest-SnapshotsActionsTest-182824703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.e86157e3-7834-4a13-8933-e777215f4058 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:39:05 devstack sudo[89258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.e86157e3-7834-4a13-8933-e777215f4058 Sep 04 22:39:05 devstack sudo[89258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:39:06 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-03f4b06e-2861-424c-95ff-3cb93eed79a5 tempest-AttachVolumeShelveTestJSON-1171912429 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:39:06 devstack sudo[89258]: pam_unix(sudo:session): session closed for user root Sep 04 22:39:06 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-03f4b06e-2861-424c-95ff-3cb93eed79a5 tempest-AttachVolumeShelveTestJSON-1171912429 None] Flow 'volume_create_manager' (549c0cb3-9109-4e1a-be83-24f4a1f74cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:39:06 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-03f4b06e-2861-424c-95ff-3cb93eed79a5 tempest-AttachVolumeShelveTestJSON-1171912429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87ce6269-7410-479d-9e9a-4fc419e57cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:39:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-37d09cb4-ccb9-4c6c-b345-e29076404f66 tempest-SnapshotsActionsTest-182824703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.e86157e3-7834-4a13-8933-e777215f4058" returned: 0 in 0.540s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:39:06 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-37d09cb4-ccb9-4c6c-b345-e29076404f66 tempest-SnapshotsActionsTest-182824703 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 22:39:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-37d09cb4-ccb9-4c6c-b345-e29076404f66 tempest-SnapshotsActionsTest-182824703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.e86157e3-7834-4a13-8933-e777215f4058,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.982e0014-a839-4efb-9c3f-1149198ca13e 1G {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:39:06 devstack sudo[89265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.e86157e3-7834-4a13-8933-e777215f4058,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.982e0014-a839-4efb-9c3f-1149198ca13e 1G Sep 04 22:39:06 devstack sudo[89265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:39:06 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-03f4b06e-2861-424c-95ff-3cb93eed79a5 tempest-AttachVolumeShelveTestJSON-1171912429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87ce6269-7410-479d-9e9a-4fc419e57cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:39:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1583174820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58237ec8-e6c7-43ae-a06f-11bad28ef6d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='401030677a4c4b8087437a91f095fa21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:39:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:39:06Z,use_quota=True,user_id='b35cc977e116487f95f8a54f8c3cc864',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:39:06 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-03f4b06e-2861-424c-95ff-3cb93eed79a5 tempest-AttachVolumeShelveTestJSON-1171912429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a635666c-aae4-4778-8523-03d7f5a15188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:39:06 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-03f4b06e-2861-424c-95ff-3cb93eed79a5 tempest-AttachVolumeShelveTestJSON-1171912429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a635666c-aae4-4778-8523-03d7f5a15188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:39:06 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-03f4b06e-2861-424c-95ff-3cb93eed79a5 tempest-AttachVolumeShelveTestJSON-1171912429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3048d57-e5ed-4d2c-8791-206d5b2a3a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:39:06 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-03f4b06e-2861-424c-95ff-3cb93eed79a5 tempest-AttachVolumeShelveTestJSON-1171912429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3048d57-e5ed-4d2c-8791-206d5b2a3a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58237ec8-e6c7-43ae-a06f-11bad28ef6d8', 'volume_name': 'volume-58237ec8-e6c7-43ae-a06f-11bad28ef6d8', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:39:06 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-03f4b06e-2861-424c-95ff-3cb93eed79a5 tempest-AttachVolumeShelveTestJSON-1171912429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6203830a-1220-46c7-9dc3-e5bcc18924c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:39:06 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-03f4b06e-2861-424c-95ff-3cb93eed79a5 tempest-AttachVolumeShelveTestJSON-1171912429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6203830a-1220-46c7-9dc3-e5bcc18924c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:39:06 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-03f4b06e-2861-424c-95ff-3cb93eed79a5 tempest-AttachVolumeShelveTestJSON-1171912429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (206cbaaf-e0ce-4ed4-b09e-bcd7899f6015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:39:06 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-03f4b06e-2861-424c-95ff-3cb93eed79a5 tempest-AttachVolumeShelveTestJSON-1171912429 None] Volume 58237ec8-e6c7-43ae-a06f-11bad28ef6d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58237ec8-e6c7-43ae-a06f-11bad28ef6d8', 'volume_size': 1} Sep 04 22:39:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-03f4b06e-2861-424c-95ff-3cb93eed79a5 tempest-AttachVolumeShelveTestJSON-1171912429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:39:06 devstack sudo[89265]: pam_unix(sudo:session): session closed for user root Sep 04 22:39:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-37d09cb4-ccb9-4c6c-b345-e29076404f66 tempest-SnapshotsActionsTest-182824703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.e86157e3-7834-4a13-8933-e777215f4058,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.982e0014-a839-4efb-9c3f-1149198ca13e 1G" returned: 0 in 0.601s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:39:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-37d09cb4-ccb9-4c6c-b345-e29076404f66 tempest-SnapshotsActionsTest-182824703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.e86157e3-7834-4a13-8933-e777215f4058 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.982e0014-a839-4efb-9c3f-1149198ca13e {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:39:06 devstack sudo[89271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.e86157e3-7834-4a13-8933-e777215f4058 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.982e0014-a839-4efb-9c3f-1149198ca13e Sep 04 22:39:06 devstack sudo[89271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:39:06 devstack sudo[89271]: pam_unix(sudo:session): session closed for user root Sep 04 22:39:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-37d09cb4-ccb9-4c6c-b345-e29076404f66 tempest-SnapshotsActionsTest-182824703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.e86157e3-7834-4a13-8933-e777215f4058 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.982e0014-a839-4efb-9c3f-1149198ca13e" returned: 0 in 0.319s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:39:06 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-37d09cb4-ccb9-4c6c-b345-e29076404f66 tempest-SnapshotsActionsTest-182824703 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.982e0014-a839-4efb-9c3f-1149198ca13e is being set with open permissions: ugo+rw Sep 04 22:39:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-37d09cb4-ccb9-4c6c-b345-e29076404f66 tempest-SnapshotsActionsTest-182824703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.982e0014-a839-4efb-9c3f-1149198ca13e {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:39:06 devstack sudo[89277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.982e0014-a839-4efb-9c3f-1149198ca13e Sep 04 22:39:06 devstack sudo[89277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:39:07 devstack sudo[89277]: pam_unix(sudo:session): session closed for user root Sep 04 22:39:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-37d09cb4-ccb9-4c6c-b345-e29076404f66 tempest-SnapshotsActionsTest-182824703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.982e0014-a839-4efb-9c3f-1149198ca13e" returned: 0 in 0.276s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:39:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-37d09cb4-ccb9-4c6c-b345-e29076404f66 tempest-SnapshotsActionsTest-182824703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.857s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:39:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-03f4b06e-2861-424c-95ff-3cb93eed79a5 tempest-AttachVolumeShelveTestJSON-1171912429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.173s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:39:07 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-03f4b06e-2861-424c-95ff-3cb93eed79a5 tempest-AttachVolumeShelveTestJSON-1171912429 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:39:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1583174820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58237ec8-e6c7-43ae-a06f-11bad28ef6d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='401030677a4c4b8087437a91f095fa21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:39:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:39:06Z,use_quota=True,user_id='b35cc977e116487f95f8a54f8c3cc864',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:39:07 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-03f4b06e-2861-424c-95ff-3cb93eed79a5 tempest-AttachVolumeShelveTestJSON-1171912429 None] Creating volume 58237ec8-e6c7-43ae-a06f-11bad28ef6d8 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:39:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-03f4b06e-2861-424c-95ff-3cb93eed79a5 tempest-AttachVolumeShelveTestJSON-1171912429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:39:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-03f4b06e-2861-424c-95ff-3cb93eed79a5 tempest-AttachVolumeShelveTestJSON-1171912429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:39:07 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-03f4b06e-2861-424c-95ff-3cb93eed79a5 tempest-AttachVolumeShelveTestJSON-1171912429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:39:07 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-03f4b06e-2861-424c-95ff-3cb93eed79a5 tempest-AttachVolumeShelveTestJSON-1171912429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:39:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-03f4b06e-2861-424c-95ff-3cb93eed79a5 tempest-AttachVolumeShelveTestJSON-1171912429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:39:07 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-03f4b06e-2861-424c-95ff-3cb93eed79a5 tempest-AttachVolumeShelveTestJSON-1171912429 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:39:07 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-03f4b06e-2861-424c-95ff-3cb93eed79a5 tempest-AttachVolumeShelveTestJSON-1171912429 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:39:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-03f4b06e-2861-424c-95ff-3cb93eed79a5 tempest-AttachVolumeShelveTestJSON-1171912429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-58237ec8-e6c7-43ae-a06f-11bad28ef6d8 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:39:07 devstack sudo[89281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-58237ec8-e6c7-43ae-a06f-11bad28ef6d8 1073741824 Sep 04 22:39:07 devstack sudo[89281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:39:07 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-37d09cb4-ccb9-4c6c-b345-e29076404f66 tempest-SnapshotsActionsTest-182824703 None] Create snapshot completed successfully Sep 04 22:39:07 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c710736d-f39a-4f19-b367-172229d7ca4e tempest-SnapshotsActionsTest-376767662 None] Acquiring lock "cinder-982e0014-a839-4efb-9c3f-1149198ca13e-delete_snapshot" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:39:07 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c710736d-f39a-4f19-b367-172229d7ca4e tempest-SnapshotsActionsTest-376767662 None] Lock "cinder-982e0014-a839-4efb-9c3f-1149198ca13e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:39:07 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c710736d-f39a-4f19-b367-172229d7ca4e tempest-SnapshotsActionsTest-376767662 None] Acquiring lock "cinder-quobyte-e1967a16-ac2c-45d4-bdc8-77c13cf4830e" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:39:07 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c710736d-f39a-4f19-b367-172229d7ca4e tempest-SnapshotsActionsTest-376767662 None] Lock "cinder-quobyte-e1967a16-ac2c-45d4-bdc8-77c13cf4830e" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:39:07 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c710736d-f39a-4f19-b367-172229d7ca4e tempest-SnapshotsActionsTest-376767662 None] Acquiring lock "cinder-quobyte-982e0014-a839-4efb-9c3f-1149198ca13e" by "_delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:39:07 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c710736d-f39a-4f19-b367-172229d7ca4e tempest-SnapshotsActionsTest-376767662 None] Lock "cinder-quobyte-982e0014-a839-4efb-9c3f-1149198ca13e" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:39:07 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-c710736d-f39a-4f19-b367-172229d7ca4e tempest-SnapshotsActionsTest-376767662 None] Deleting offline snapshot 982e0014-a839-4efb-9c3f-1149198ca13e of volume e1967a16-ac2c-45d4-bdc8-77c13cf4830e {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 22:39:07 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-c710736d-f39a-4f19-b367-172229d7ca4e tempest-SnapshotsActionsTest-376767662 None] snapshot_file for this snap is: volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.982e0014-a839-4efb-9c3f-1149198ca13e {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 22:39:07 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ddc1c13-2e4e-4219-848b-e153df5c6c27]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:39:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c710736d-f39a-4f19-b367-172229d7ca4e tempest-SnapshotsActionsTest-376767662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.982e0014-a839-4efb-9c3f-1149198ca13e {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:39:07 devstack sudo[89281]: pam_unix(sudo:session): session closed for user root Sep 04 22:39:07 devstack sudo[89287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.982e0014-a839-4efb-9c3f-1149198ca13e Sep 04 22:39:07 devstack sudo[89287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:39:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-03f4b06e-2861-424c-95ff-3cb93eed79a5 tempest-AttachVolumeShelveTestJSON-1171912429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-58237ec8-e6c7-43ae-a06f-11bad28ef6d8 1073741824" returned: 0 in 0.633s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:39:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-03f4b06e-2861-424c-95ff-3cb93eed79a5 tempest-AttachVolumeShelveTestJSON-1171912429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-58237ec8-e6c7-43ae-a06f-11bad28ef6d8 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:39:08 devstack sudo[89289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-58237ec8-e6c7-43ae-a06f-11bad28ef6d8 Sep 04 22:39:08 devstack sudo[89289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:39:08 devstack sudo[89287]: pam_unix(sudo:session): session closed for user root Sep 04 22:39:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c710736d-f39a-4f19-b367-172229d7ca4e tempest-SnapshotsActionsTest-376767662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.982e0014-a839-4efb-9c3f-1149198ca13e" returned: 0 in 0.466s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:39:08 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-c710736d-f39a-4f19-b367-172229d7ca4e tempest-SnapshotsActionsTest-376767662 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 22:39:08 devstack sudo[89289]: pam_unix(sudo:session): session closed for user root Sep 04 22:39:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-03f4b06e-2861-424c-95ff-3cb93eed79a5 tempest-AttachVolumeShelveTestJSON-1171912429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-58237ec8-e6c7-43ae-a06f-11bad28ef6d8" returned: 0 in 0.295s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:39:08 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-03f4b06e-2861-424c-95ff-3cb93eed79a5 tempest-AttachVolumeShelveTestJSON-1171912429 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:39:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-03f4b06e-2861-424c-95ff-3cb93eed79a5 tempest-AttachVolumeShelveTestJSON-1171912429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:39:08 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ffb8a84-eec7-4213-b9d4-f30fafd21fce]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:39:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c710736d-f39a-4f19-b367-172229d7ca4e tempest-SnapshotsActionsTest-376767662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.e86157e3-7834-4a13-8933-e777215f4058 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:39:08 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-03f4b06e-2861-424c-95ff-3cb93eed79a5 tempest-AttachVolumeShelveTestJSON-1171912429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (206cbaaf-e0ce-4ed4-b09e-bcd7899f6015) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58237ec8-e6c7-43ae-a06f-11bad28ef6d8', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:39:08 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-03f4b06e-2861-424c-95ff-3cb93eed79a5 tempest-AttachVolumeShelveTestJSON-1171912429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec9adb75-7a70-48a3-adca-a7801d5cfdc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:39:08 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-03f4b06e-2861-424c-95ff-3cb93eed79a5 tempest-AttachVolumeShelveTestJSON-1171912429 None] Volume volume-58237ec8-e6c7-43ae-a06f-11bad28ef6d8 (58237ec8-e6c7-43ae-a06f-11bad28ef6d8): created successfully Sep 04 22:39:08 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-03f4b06e-2861-424c-95ff-3cb93eed79a5 tempest-AttachVolumeShelveTestJSON-1171912429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec9adb75-7a70-48a3-adca-a7801d5cfdc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:39:08 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-03f4b06e-2861-424c-95ff-3cb93eed79a5 tempest-AttachVolumeShelveTestJSON-1171912429 None] Flow 'volume_create_manager' (549c0cb3-9109-4e1a-be83-24f4a1f74cd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:39:08 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-03f4b06e-2861-424c-95ff-3cb93eed79a5 tempest-AttachVolumeShelveTestJSON-1171912429 None] Created volume successfully. Sep 04 22:39:08 devstack sudo[89296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.e86157e3-7834-4a13-8933-e777215f4058 Sep 04 22:39:08 devstack sudo[89296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:39:08 devstack sudo[89296]: pam_unix(sudo:session): session closed for user root Sep 04 22:39:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c710736d-f39a-4f19-b367-172229d7ca4e tempest-SnapshotsActionsTest-376767662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.e86157e3-7834-4a13-8933-e777215f4058" returned: 0 in 0.441s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:39:08 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-c710736d-f39a-4f19-b367-172229d7ca4e tempest-SnapshotsActionsTest-376767662 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 22:39:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c710736d-f39a-4f19-b367-172229d7ca4e tempest-SnapshotsActionsTest-376767662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.982e0014-a839-4efb-9c3f-1149198ca13e {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:39:08 devstack sudo[89301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.982e0014-a839-4efb-9c3f-1149198ca13e Sep 04 22:39:08 devstack sudo[89301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:39:09 devstack sudo[89301]: pam_unix(sudo:session): session closed for user root Sep 04 22:39:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c710736d-f39a-4f19-b367-172229d7ca4e tempest-SnapshotsActionsTest-376767662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.982e0014-a839-4efb-9c3f-1149198ca13e" returned: 0 in 0.423s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:39:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c710736d-f39a-4f19-b367-172229d7ca4e tempest-SnapshotsActionsTest-376767662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.982e0014-a839-4efb-9c3f-1149198ca13e {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:39:09 devstack sudo[89310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.982e0014-a839-4efb-9c3f-1149198ca13e Sep 04 22:39:09 devstack sudo[89310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:39:09 devstack sudo[89310]: pam_unix(sudo:session): session closed for user root Sep 04 22:39:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c710736d-f39a-4f19-b367-172229d7ca4e tempest-SnapshotsActionsTest-376767662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.982e0014-a839-4efb-9c3f-1149198ca13e" returned: 0 in 0.295s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:39:09 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c710736d-f39a-4f19-b367-172229d7ca4e tempest-SnapshotsActionsTest-376767662 None] Lock "cinder-quobyte-982e0014-a839-4efb-9c3f-1149198ca13e" released by "_delete_snapshot" :: held 1.754s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:39:09 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c710736d-f39a-4f19-b367-172229d7ca4e tempest-SnapshotsActionsTest-376767662 None] Lock "cinder-quobyte-e1967a16-ac2c-45d4-bdc8-77c13cf4830e" released by "delete_snapshot" :: held 1.798s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:39:09 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-c710736d-f39a-4f19-b367-172229d7ca4e tempest-SnapshotsActionsTest-376767662 None] Created reservations ['7e442689-2541-473b-a616-370aff84546b', '6645e132-e656-403a-9073-4bf7f2f1dd58', '0733535a-f667-406a-aa7e-f0c422a21484', '05c18eba-e224-4cca-a302-269dfdb71ff9'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:39:09 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-c710736d-f39a-4f19-b367-172229d7ca4e tempest-SnapshotsActionsTest-376767662 None] Delete snapshot completed successfully. Sep 04 22:39:09 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c710736d-f39a-4f19-b367-172229d7ca4e tempest-SnapshotsActionsTest-376767662 None] Lock "cinder-982e0014-a839-4efb-9c3f-1149198ca13e-delete_snapshot" released by "delete_snapshot" :: held 1.967s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:39:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-b2bed506-fe1a-4a59-8212-00c70d3742a5 tempest-SnapshotsActionsTest-182824703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:39:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-b2bed506-fe1a-4a59-8212-00c70d3742a5 tempest-SnapshotsActionsTest-182824703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:39:10 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-b2bed506-fe1a-4a59-8212-00c70d3742a5 tempest-SnapshotsActionsTest-182824703 None] Creating offline snapshot f622e005-5aaf-4ad8-a6aa-cea0c50f7673 of volume e1967a16-ac2c-45d4-bdc8-77c13cf4830e {{(pid=87576) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 22:39:10 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0643bc4-b3fc-44f4-971e-83025d4f7819]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:39:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b2bed506-fe1a-4a59-8212-00c70d3742a5 tempest-SnapshotsActionsTest-182824703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.e86157e3-7834-4a13-8933-e777215f4058 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:39:10 devstack sudo[89314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.e86157e3-7834-4a13-8933-e777215f4058 Sep 04 22:39:10 devstack sudo[89314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:39:10 devstack sudo[89314]: pam_unix(sudo:session): session closed for user root Sep 04 22:39:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b2bed506-fe1a-4a59-8212-00c70d3742a5 tempest-SnapshotsActionsTest-182824703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.e86157e3-7834-4a13-8933-e777215f4058" returned: 0 in 0.485s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:39:10 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-b2bed506-fe1a-4a59-8212-00c70d3742a5 tempest-SnapshotsActionsTest-182824703 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 22:39:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b2bed506-fe1a-4a59-8212-00c70d3742a5 tempest-SnapshotsActionsTest-182824703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.e86157e3-7834-4a13-8933-e777215f4058,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.f622e005-5aaf-4ad8-a6aa-cea0c50f7673 1G {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:39:10 devstack sudo[89326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.e86157e3-7834-4a13-8933-e777215f4058,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.f622e005-5aaf-4ad8-a6aa-cea0c50f7673 1G Sep 04 22:39:10 devstack sudo[89326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:39:11 devstack sudo[89326]: pam_unix(sudo:session): session closed for user root Sep 04 22:39:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b2bed506-fe1a-4a59-8212-00c70d3742a5 tempest-SnapshotsActionsTest-182824703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.e86157e3-7834-4a13-8933-e777215f4058,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.f622e005-5aaf-4ad8-a6aa-cea0c50f7673 1G" returned: 0 in 0.621s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:39:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b2bed506-fe1a-4a59-8212-00c70d3742a5 tempest-SnapshotsActionsTest-182824703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.e86157e3-7834-4a13-8933-e777215f4058 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.f622e005-5aaf-4ad8-a6aa-cea0c50f7673 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:39:11 devstack sudo[89340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.e86157e3-7834-4a13-8933-e777215f4058 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.f622e005-5aaf-4ad8-a6aa-cea0c50f7673 Sep 04 22:39:11 devstack sudo[89340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:39:11 devstack cinder-volume[87576]: DEBUG oslo_service.periodic_task [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87576) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 22:39:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:39:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:39:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:39:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:39:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:39:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:39:11 devstack sudo[89342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:39:11 devstack sudo[89342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:39:11 devstack sudo[89340]: pam_unix(sudo:session): session closed for user root Sep 04 22:39:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b2bed506-fe1a-4a59-8212-00c70d3742a5 tempest-SnapshotsActionsTest-182824703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.e86157e3-7834-4a13-8933-e777215f4058 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.f622e005-5aaf-4ad8-a6aa-cea0c50f7673" returned: 0 in 0.520s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:39:11 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-b2bed506-fe1a-4a59-8212-00c70d3742a5 tempest-SnapshotsActionsTest-182824703 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.f622e005-5aaf-4ad8-a6aa-cea0c50f7673 is being set with open permissions: ugo+rw Sep 04 22:39:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b2bed506-fe1a-4a59-8212-00c70d3742a5 tempest-SnapshotsActionsTest-182824703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.f622e005-5aaf-4ad8-a6aa-cea0c50f7673 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:39:12 devstack sudo[89348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.f622e005-5aaf-4ad8-a6aa-cea0c50f7673 Sep 04 22:39:12 devstack sudo[89348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:39:12 devstack sudo[89342]: pam_unix(sudo:session): session closed for user root Sep 04 22:39:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.382s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:39:12 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:39:12 devstack cinder-volume[87576]: DEBUG oslo_service.periodic_task [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Running periodic task VolumeManager._thread_info {{(pid=87576) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 22:39:12 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] thread count: 8 {{(pid=87576) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 22:39:12 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] thread info: [<_MainThread(MainThread, started 125730416963712)>, , , , , , , ] {{(pid=87576) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 22:39:12 devstack sudo[89348]: pam_unix(sudo:session): session closed for user root Sep 04 22:39:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b2bed506-fe1a-4a59-8212-00c70d3742a5 tempest-SnapshotsActionsTest-182824703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.f622e005-5aaf-4ad8-a6aa-cea0c50f7673" returned: 0 in 0.411s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:39:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-b2bed506-fe1a-4a59-8212-00c70d3742a5 tempest-SnapshotsActionsTest-182824703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.198s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:39:12 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-b2bed506-fe1a-4a59-8212-00c70d3742a5 tempest-SnapshotsActionsTest-182824703 None] Create snapshot completed successfully Sep 04 22:39:13 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-5c21aa3f-2781-4013-8217-22d12bd014a1 tempest-SnapshotsActionsTest-376767662 None] Acquiring lock "cinder-f622e005-5aaf-4ad8-a6aa-cea0c50f7673-delete_snapshot" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:39:13 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-5c21aa3f-2781-4013-8217-22d12bd014a1 tempest-SnapshotsActionsTest-376767662 None] Lock "cinder-f622e005-5aaf-4ad8-a6aa-cea0c50f7673-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:39:13 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-5c21aa3f-2781-4013-8217-22d12bd014a1 tempest-SnapshotsActionsTest-376767662 None] Acquiring lock "cinder-quobyte-e1967a16-ac2c-45d4-bdc8-77c13cf4830e" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:39:13 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-5c21aa3f-2781-4013-8217-22d12bd014a1 tempest-SnapshotsActionsTest-376767662 None] Lock "cinder-quobyte-e1967a16-ac2c-45d4-bdc8-77c13cf4830e" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:39:13 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-5c21aa3f-2781-4013-8217-22d12bd014a1 tempest-SnapshotsActionsTest-376767662 None] Acquiring lock "cinder-quobyte-f622e005-5aaf-4ad8-a6aa-cea0c50f7673" by "_delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:39:13 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-5c21aa3f-2781-4013-8217-22d12bd014a1 tempest-SnapshotsActionsTest-376767662 None] Lock "cinder-quobyte-f622e005-5aaf-4ad8-a6aa-cea0c50f7673" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:39:13 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-5c21aa3f-2781-4013-8217-22d12bd014a1 tempest-SnapshotsActionsTest-376767662 None] Deleting offline snapshot f622e005-5aaf-4ad8-a6aa-cea0c50f7673 of volume e1967a16-ac2c-45d4-bdc8-77c13cf4830e {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 22:39:13 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-5c21aa3f-2781-4013-8217-22d12bd014a1 tempest-SnapshotsActionsTest-376767662 None] snapshot_file for this snap is: volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.f622e005-5aaf-4ad8-a6aa-cea0c50f7673 {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 22:39:13 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[8017ae96-5f70-486f-b268-cacbb0785521]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:39:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5c21aa3f-2781-4013-8217-22d12bd014a1 tempest-SnapshotsActionsTest-376767662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.f622e005-5aaf-4ad8-a6aa-cea0c50f7673 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:39:13 devstack sudo[89353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.f622e005-5aaf-4ad8-a6aa-cea0c50f7673 Sep 04 22:39:13 devstack sudo[89353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:39:14 devstack sudo[89353]: pam_unix(sudo:session): session closed for user root Sep 04 22:39:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5c21aa3f-2781-4013-8217-22d12bd014a1 tempest-SnapshotsActionsTest-376767662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.f622e005-5aaf-4ad8-a6aa-cea0c50f7673" returned: 0 in 0.478s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:39:14 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-5c21aa3f-2781-4013-8217-22d12bd014a1 tempest-SnapshotsActionsTest-376767662 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 22:39:14 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4286ac6-40ef-4171-90d9-fc557f38cd65]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:39:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5c21aa3f-2781-4013-8217-22d12bd014a1 tempest-SnapshotsActionsTest-376767662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.e86157e3-7834-4a13-8933-e777215f4058 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:39:14 devstack sudo[89359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.e86157e3-7834-4a13-8933-e777215f4058 Sep 04 22:39:14 devstack sudo[89359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:39:14 devstack sudo[89359]: pam_unix(sudo:session): session closed for user root Sep 04 22:39:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5c21aa3f-2781-4013-8217-22d12bd014a1 tempest-SnapshotsActionsTest-376767662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.e86157e3-7834-4a13-8933-e777215f4058" returned: 0 in 0.518s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:39:14 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-5c21aa3f-2781-4013-8217-22d12bd014a1 tempest-SnapshotsActionsTest-376767662 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 22:39:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5c21aa3f-2781-4013-8217-22d12bd014a1 tempest-SnapshotsActionsTest-376767662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.f622e005-5aaf-4ad8-a6aa-cea0c50f7673 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:39:14 devstack sudo[89364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.f622e005-5aaf-4ad8-a6aa-cea0c50f7673 Sep 04 22:39:14 devstack sudo[89364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:39:15 devstack sudo[89364]: pam_unix(sudo:session): session closed for user root Sep 04 22:39:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5c21aa3f-2781-4013-8217-22d12bd014a1 tempest-SnapshotsActionsTest-376767662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.f622e005-5aaf-4ad8-a6aa-cea0c50f7673" returned: 0 in 0.557s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:39:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5c21aa3f-2781-4013-8217-22d12bd014a1 tempest-SnapshotsActionsTest-376767662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.f622e005-5aaf-4ad8-a6aa-cea0c50f7673 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:39:15 devstack sudo[89370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.f622e005-5aaf-4ad8-a6aa-cea0c50f7673 Sep 04 22:39:15 devstack sudo[89370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:39:15 devstack sudo[89370]: pam_unix(sudo:session): session closed for user root Sep 04 22:39:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5c21aa3f-2781-4013-8217-22d12bd014a1 tempest-SnapshotsActionsTest-376767662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.f622e005-5aaf-4ad8-a6aa-cea0c50f7673" returned: 0 in 0.331s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:39:15 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-5c21aa3f-2781-4013-8217-22d12bd014a1 tempest-SnapshotsActionsTest-376767662 None] Lock "cinder-quobyte-f622e005-5aaf-4ad8-a6aa-cea0c50f7673" released by "_delete_snapshot" :: held 2.040s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:39:15 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-5c21aa3f-2781-4013-8217-22d12bd014a1 tempest-SnapshotsActionsTest-376767662 None] Lock "cinder-quobyte-e1967a16-ac2c-45d4-bdc8-77c13cf4830e" released by "delete_snapshot" :: held 2.072s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:39:15 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-5c21aa3f-2781-4013-8217-22d12bd014a1 tempest-SnapshotsActionsTest-376767662 None] Created reservations ['fbaa0019-3643-45c6-9781-f04d018e8fdd', '65d3d652-6b0c-4248-9d63-100cb79a12b7', '7764cd77-e3a8-400a-9cc3-18a1c37a0624', '4b2e068d-e8b6-4e1f-b18c-bce68ffb6dbd'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:39:15 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-5c21aa3f-2781-4013-8217-22d12bd014a1 tempest-SnapshotsActionsTest-376767662 None] Delete snapshot completed successfully. Sep 04 22:39:15 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-5c21aa3f-2781-4013-8217-22d12bd014a1 tempest-SnapshotsActionsTest-376767662 None] Lock "cinder-f622e005-5aaf-4ad8-a6aa-cea0c50f7673-delete_snapshot" released by "delete_snapshot" :: held 2.287s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:39:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-4ccb57d8-6700-4593-a149-37321752cfa4 tempest-SnapshotsActionsTest-182824703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:39:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-4ccb57d8-6700-4593-a149-37321752cfa4 tempest-SnapshotsActionsTest-182824703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:39:17 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-4ccb57d8-6700-4593-a149-37321752cfa4 tempest-SnapshotsActionsTest-182824703 None] Creating offline snapshot 4a65478a-8ac1-46a5-b114-d1a23d3acb0c of volume e1967a16-ac2c-45d4-bdc8-77c13cf4830e {{(pid=87576) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 22:39:17 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[29626239-87dd-4674-aed8-68509cadaec3]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:39:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4ccb57d8-6700-4593-a149-37321752cfa4 tempest-SnapshotsActionsTest-182824703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.e86157e3-7834-4a13-8933-e777215f4058 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:39:17 devstack sudo[89375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.e86157e3-7834-4a13-8933-e777215f4058 Sep 04 22:39:17 devstack sudo[89375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:39:17 devstack sudo[89375]: pam_unix(sudo:session): session closed for user root Sep 04 22:39:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4ccb57d8-6700-4593-a149-37321752cfa4 tempest-SnapshotsActionsTest-182824703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.e86157e3-7834-4a13-8933-e777215f4058" returned: 0 in 0.506s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:39:17 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-4ccb57d8-6700-4593-a149-37321752cfa4 tempest-SnapshotsActionsTest-182824703 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 22:39:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4ccb57d8-6700-4593-a149-37321752cfa4 tempest-SnapshotsActionsTest-182824703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.e86157e3-7834-4a13-8933-e777215f4058,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.4a65478a-8ac1-46a5-b114-d1a23d3acb0c 1G {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:39:17 devstack sudo[89380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.e86157e3-7834-4a13-8933-e777215f4058,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.4a65478a-8ac1-46a5-b114-d1a23d3acb0c 1G Sep 04 22:39:17 devstack sudo[89380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:39:18 devstack sudo[89380]: pam_unix(sudo:session): session closed for user root Sep 04 22:39:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4ccb57d8-6700-4593-a149-37321752cfa4 tempest-SnapshotsActionsTest-182824703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.e86157e3-7834-4a13-8933-e777215f4058,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.4a65478a-8ac1-46a5-b114-d1a23d3acb0c 1G" returned: 0 in 0.472s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:39:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4ccb57d8-6700-4593-a149-37321752cfa4 tempest-SnapshotsActionsTest-182824703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.e86157e3-7834-4a13-8933-e777215f4058 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.4a65478a-8ac1-46a5-b114-d1a23d3acb0c {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:39:18 devstack sudo[89387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.e86157e3-7834-4a13-8933-e777215f4058 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.4a65478a-8ac1-46a5-b114-d1a23d3acb0c Sep 04 22:39:18 devstack sudo[89387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:39:18 devstack sudo[89387]: pam_unix(sudo:session): session closed for user root Sep 04 22:39:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4ccb57d8-6700-4593-a149-37321752cfa4 tempest-SnapshotsActionsTest-182824703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.e86157e3-7834-4a13-8933-e777215f4058 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.4a65478a-8ac1-46a5-b114-d1a23d3acb0c" returned: 0 in 0.340s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:39:18 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-4ccb57d8-6700-4593-a149-37321752cfa4 tempest-SnapshotsActionsTest-182824703 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.4a65478a-8ac1-46a5-b114-d1a23d3acb0c is being set with open permissions: ugo+rw Sep 04 22:39:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4ccb57d8-6700-4593-a149-37321752cfa4 tempest-SnapshotsActionsTest-182824703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.4a65478a-8ac1-46a5-b114-d1a23d3acb0c {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:39:18 devstack sudo[89392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.4a65478a-8ac1-46a5-b114-d1a23d3acb0c Sep 04 22:39:18 devstack sudo[89392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:39:18 devstack sudo[89392]: pam_unix(sudo:session): session closed for user root Sep 04 22:39:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4ccb57d8-6700-4593-a149-37321752cfa4 tempest-SnapshotsActionsTest-182824703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.4a65478a-8ac1-46a5-b114-d1a23d3acb0c" returned: 0 in 0.272s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:39:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-4ccb57d8-6700-4593-a149-37321752cfa4 tempest-SnapshotsActionsTest-182824703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.709s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:39:18 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-4ccb57d8-6700-4593-a149-37321752cfa4 tempest-SnapshotsActionsTest-182824703 None] Create snapshot completed successfully Sep 04 22:39:19 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-40c7b320-8491-47dc-999a-fc1161c0874c tempest-SnapshotsActionsTest-376767662 None] Acquiring lock "cinder-4a65478a-8ac1-46a5-b114-d1a23d3acb0c-delete_snapshot" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:39:19 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-40c7b320-8491-47dc-999a-fc1161c0874c tempest-SnapshotsActionsTest-376767662 None] Lock "cinder-4a65478a-8ac1-46a5-b114-d1a23d3acb0c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:39:19 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-40c7b320-8491-47dc-999a-fc1161c0874c tempest-SnapshotsActionsTest-376767662 None] Acquiring lock "cinder-quobyte-e1967a16-ac2c-45d4-bdc8-77c13cf4830e" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:39:19 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-40c7b320-8491-47dc-999a-fc1161c0874c tempest-SnapshotsActionsTest-376767662 None] Lock "cinder-quobyte-e1967a16-ac2c-45d4-bdc8-77c13cf4830e" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:39:19 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-40c7b320-8491-47dc-999a-fc1161c0874c tempest-SnapshotsActionsTest-376767662 None] Acquiring lock "cinder-quobyte-4a65478a-8ac1-46a5-b114-d1a23d3acb0c" by "_delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:39:19 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-40c7b320-8491-47dc-999a-fc1161c0874c tempest-SnapshotsActionsTest-376767662 None] Lock "cinder-quobyte-4a65478a-8ac1-46a5-b114-d1a23d3acb0c" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:39:19 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-40c7b320-8491-47dc-999a-fc1161c0874c tempest-SnapshotsActionsTest-376767662 None] Deleting offline snapshot 4a65478a-8ac1-46a5-b114-d1a23d3acb0c of volume e1967a16-ac2c-45d4-bdc8-77c13cf4830e {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 22:39:19 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-40c7b320-8491-47dc-999a-fc1161c0874c tempest-SnapshotsActionsTest-376767662 None] snapshot_file for this snap is: volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.4a65478a-8ac1-46a5-b114-d1a23d3acb0c {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 22:39:19 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dab519b-0aec-4c3e-9099-80aae994056c]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:39:19 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-40c7b320-8491-47dc-999a-fc1161c0874c tempest-SnapshotsActionsTest-376767662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.4a65478a-8ac1-46a5-b114-d1a23d3acb0c {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:39:19 devstack sudo[89395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.4a65478a-8ac1-46a5-b114-d1a23d3acb0c Sep 04 22:39:19 devstack sudo[89395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:39:20 devstack sudo[89395]: pam_unix(sudo:session): session closed for user root Sep 04 22:39:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-40c7b320-8491-47dc-999a-fc1161c0874c tempest-SnapshotsActionsTest-376767662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.4a65478a-8ac1-46a5-b114-d1a23d3acb0c" returned: 0 in 0.500s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:39:20 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-40c7b320-8491-47dc-999a-fc1161c0874c tempest-SnapshotsActionsTest-376767662 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 22:39:20 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0fe99f-21dc-4173-a195-0c9579c68d22]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:39:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-40c7b320-8491-47dc-999a-fc1161c0874c tempest-SnapshotsActionsTest-376767662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.e86157e3-7834-4a13-8933-e777215f4058 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:39:20 devstack sudo[89401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.e86157e3-7834-4a13-8933-e777215f4058 Sep 04 22:39:20 devstack sudo[89401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:39:20 devstack sudo[89401]: pam_unix(sudo:session): session closed for user root Sep 04 22:39:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-40c7b320-8491-47dc-999a-fc1161c0874c tempest-SnapshotsActionsTest-376767662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.e86157e3-7834-4a13-8933-e777215f4058" returned: 0 in 0.397s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:39:20 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-40c7b320-8491-47dc-999a-fc1161c0874c tempest-SnapshotsActionsTest-376767662 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 22:39:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-40c7b320-8491-47dc-999a-fc1161c0874c tempest-SnapshotsActionsTest-376767662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.4a65478a-8ac1-46a5-b114-d1a23d3acb0c {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:39:20 devstack sudo[89406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.4a65478a-8ac1-46a5-b114-d1a23d3acb0c Sep 04 22:39:20 devstack sudo[89406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:39:20 devstack sudo[89406]: pam_unix(sudo:session): session closed for user root Sep 04 22:39:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-40c7b320-8491-47dc-999a-fc1161c0874c tempest-SnapshotsActionsTest-376767662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.4a65478a-8ac1-46a5-b114-d1a23d3acb0c" returned: 0 in 0.414s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:39:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-40c7b320-8491-47dc-999a-fc1161c0874c tempest-SnapshotsActionsTest-376767662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.4a65478a-8ac1-46a5-b114-d1a23d3acb0c {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:39:20 devstack sudo[89412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.4a65478a-8ac1-46a5-b114-d1a23d3acb0c Sep 04 22:39:20 devstack sudo[89412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:39:21 devstack sudo[89412]: pam_unix(sudo:session): session closed for user root Sep 04 22:39:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-40c7b320-8491-47dc-999a-fc1161c0874c tempest-SnapshotsActionsTest-376767662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.4a65478a-8ac1-46a5-b114-d1a23d3acb0c" returned: 0 in 0.256s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:39:21 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-40c7b320-8491-47dc-999a-fc1161c0874c tempest-SnapshotsActionsTest-376767662 None] Lock "cinder-quobyte-4a65478a-8ac1-46a5-b114-d1a23d3acb0c" released by "_delete_snapshot" :: held 1.690s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:39:21 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-40c7b320-8491-47dc-999a-fc1161c0874c tempest-SnapshotsActionsTest-376767662 None] Lock "cinder-quobyte-e1967a16-ac2c-45d4-bdc8-77c13cf4830e" released by "delete_snapshot" :: held 1.722s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:39:21 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-40c7b320-8491-47dc-999a-fc1161c0874c tempest-SnapshotsActionsTest-376767662 None] Created reservations ['e24be9f0-1bff-4058-a6b3-1f1f57cdeaac', '96fb6874-be65-4023-9b6c-04514449695b', '7db5f81d-5ce3-46de-b3f8-5e7c5b99a402', 'dd228d66-3ae7-4d71-8a81-4de099a0bf87'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:39:21 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-40c7b320-8491-47dc-999a-fc1161c0874c tempest-SnapshotsActionsTest-376767662 None] Delete snapshot completed successfully. Sep 04 22:39:21 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-40c7b320-8491-47dc-999a-fc1161c0874c tempest-SnapshotsActionsTest-376767662 None] Lock "cinder-4a65478a-8ac1-46a5-b114-d1a23d3acb0c-delete_snapshot" released by "delete_snapshot" :: held 1.903s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:39:22 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-ed8c55c7-1941-42f7-aa85-c8554fa0ab74 tempest-SnapshotsActionsTest-182824703 None] Acquiring lock "cinder-e86157e3-7834-4a13-8933-e777215f4058-delete_snapshot" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:39:22 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-ed8c55c7-1941-42f7-aa85-c8554fa0ab74 tempest-SnapshotsActionsTest-182824703 None] Lock "cinder-e86157e3-7834-4a13-8933-e777215f4058-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:39:22 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-ed8c55c7-1941-42f7-aa85-c8554fa0ab74 tempest-SnapshotsActionsTest-182824703 None] Acquiring lock "cinder-quobyte-e1967a16-ac2c-45d4-bdc8-77c13cf4830e" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:39:22 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-ed8c55c7-1941-42f7-aa85-c8554fa0ab74 tempest-SnapshotsActionsTest-182824703 None] Lock "cinder-quobyte-e1967a16-ac2c-45d4-bdc8-77c13cf4830e" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:39:22 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-ed8c55c7-1941-42f7-aa85-c8554fa0ab74 tempest-SnapshotsActionsTest-182824703 None] Acquiring lock "cinder-quobyte-e86157e3-7834-4a13-8933-e777215f4058" by "_delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:39:22 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-ed8c55c7-1941-42f7-aa85-c8554fa0ab74 tempest-SnapshotsActionsTest-182824703 None] Lock "cinder-quobyte-e86157e3-7834-4a13-8933-e777215f4058" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:39:22 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-ed8c55c7-1941-42f7-aa85-c8554fa0ab74 tempest-SnapshotsActionsTest-182824703 None] Deleting offline snapshot e86157e3-7834-4a13-8933-e777215f4058 of volume e1967a16-ac2c-45d4-bdc8-77c13cf4830e {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 22:39:22 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-ed8c55c7-1941-42f7-aa85-c8554fa0ab74 tempest-SnapshotsActionsTest-182824703 None] snapshot_file for this snap is: volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.e86157e3-7834-4a13-8933-e777215f4058 {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 22:39:22 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[816ba92f-4757-4f6f-a867-775b4420f4ac]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:39:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ed8c55c7-1941-42f7-aa85-c8554fa0ab74 tempest-SnapshotsActionsTest-182824703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.e86157e3-7834-4a13-8933-e777215f4058 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:39:22 devstack sudo[89452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.e86157e3-7834-4a13-8933-e777215f4058 Sep 04 22:39:22 devstack sudo[89452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:39:22 devstack sudo[89452]: pam_unix(sudo:session): session closed for user root Sep 04 22:39:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ed8c55c7-1941-42f7-aa85-c8554fa0ab74 tempest-SnapshotsActionsTest-182824703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.e86157e3-7834-4a13-8933-e777215f4058" returned: 0 in 0.435s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:39:22 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-ed8c55c7-1941-42f7-aa85-c8554fa0ab74 tempest-SnapshotsActionsTest-182824703 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 22:39:22 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[19941d3d-ac64-4229-ac46-8c9a3ba21275]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:39:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ed8c55c7-1941-42f7-aa85-c8554fa0ab74 tempest-SnapshotsActionsTest-182824703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:39:22 devstack sudo[89457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e Sep 04 22:39:22 devstack sudo[89457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:39:23 devstack sudo[89457]: pam_unix(sudo:session): session closed for user root Sep 04 22:39:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ed8c55c7-1941-42f7-aa85-c8554fa0ab74 tempest-SnapshotsActionsTest-182824703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e" returned: 0 in 0.459s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:39:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ed8c55c7-1941-42f7-aa85-c8554fa0ab74 tempest-SnapshotsActionsTest-182824703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.e86157e3-7834-4a13-8933-e777215f4058 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:39:23 devstack sudo[89462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.e86157e3-7834-4a13-8933-e777215f4058 Sep 04 22:39:23 devstack sudo[89462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:39:23 devstack sudo[89462]: pam_unix(sudo:session): session closed for user root Sep 04 22:39:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ed8c55c7-1941-42f7-aa85-c8554fa0ab74 tempest-SnapshotsActionsTest-182824703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.e86157e3-7834-4a13-8933-e777215f4058" returned: 0 in 0.453s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:39:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ed8c55c7-1941-42f7-aa85-c8554fa0ab74 tempest-SnapshotsActionsTest-182824703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.e86157e3-7834-4a13-8933-e777215f4058 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:39:23 devstack sudo[89468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.e86157e3-7834-4a13-8933-e777215f4058 Sep 04 22:39:23 devstack sudo[89468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:39:23 devstack sudo[89468]: pam_unix(sudo:session): session closed for user root Sep 04 22:39:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ed8c55c7-1941-42f7-aa85-c8554fa0ab74 tempest-SnapshotsActionsTest-182824703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e.e86157e3-7834-4a13-8933-e777215f4058" returned: 0 in 0.298s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:39:23 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-ed8c55c7-1941-42f7-aa85-c8554fa0ab74 tempest-SnapshotsActionsTest-182824703 None] Lock "cinder-quobyte-e86157e3-7834-4a13-8933-e777215f4058" released by "_delete_snapshot" :: held 1.799s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:39:23 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-ed8c55c7-1941-42f7-aa85-c8554fa0ab74 tempest-SnapshotsActionsTest-182824703 None] Lock "cinder-quobyte-e1967a16-ac2c-45d4-bdc8-77c13cf4830e" released by "delete_snapshot" :: held 1.829s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:39:24 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-ed8c55c7-1941-42f7-aa85-c8554fa0ab74 tempest-SnapshotsActionsTest-182824703 None] Created reservations ['731c54c5-a018-4d03-a67b-af59dc4be3e2', '65e58aae-e65f-477a-a7fa-6365b6898359', '8fa38785-57bc-4b28-883b-5ed49d8bbb5c', 'a6c8370f-1390-47f3-998b-b5b90d698df3'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:39:24 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-ed8c55c7-1941-42f7-aa85-c8554fa0ab74 tempest-SnapshotsActionsTest-182824703 None] Delete snapshot completed successfully. Sep 04 22:39:24 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-ed8c55c7-1941-42f7-aa85-c8554fa0ab74 tempest-SnapshotsActionsTest-182824703 None] Lock "cinder-e86157e3-7834-4a13-8933-e777215f4058-delete_snapshot" released by "delete_snapshot" :: held 2.020s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:39:24 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-eb34e071-f493-481b-8cea-8d01e4761aa9 tempest-SnapshotsActionsTest-182824703 None] Acquiring lock "cinder-e1967a16-ac2c-45d4-bdc8-77c13cf4830e-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:39:24 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-eb34e071-f493-481b-8cea-8d01e4761aa9 tempest-SnapshotsActionsTest-182824703 None] Lock "cinder-e1967a16-ac2c-45d4-bdc8-77c13cf4830e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:39:24 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-eb34e071-f493-481b-8cea-8d01e4761aa9 tempest-SnapshotsActionsTest-182824703 None] Acquiring lock "cinder-quobyte-e1967a16-ac2c-45d4-bdc8-77c13cf4830e" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:39:24 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-eb34e071-f493-481b-8cea-8d01e4761aa9 tempest-SnapshotsActionsTest-182824703 None] Lock "cinder-quobyte-e1967a16-ac2c-45d4-bdc8-77c13cf4830e" acquired by "delete_volume" :: waited 0.018s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:39:24 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15c52e6-1e29-4d5f-8e86-d17aa2b084e2]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:39:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-eb34e071-f493-481b-8cea-8d01e4761aa9 tempest-SnapshotsActionsTest-182824703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:39:24 devstack sudo[89474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e Sep 04 22:39:24 devstack sudo[89474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:39:25 devstack sudo[89474]: pam_unix(sudo:session): session closed for user root Sep 04 22:39:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-eb34e071-f493-481b-8cea-8d01e4761aa9 tempest-SnapshotsActionsTest-182824703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e" returned: 0 in 0.620s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:39:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-eb34e071-f493-481b-8cea-8d01e4761aa9 tempest-SnapshotsActionsTest-182824703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:39:25 devstack sudo[89495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e Sep 04 22:39:25 devstack sudo[89495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:39:25 devstack sudo[89495]: pam_unix(sudo:session): session closed for user root Sep 04 22:39:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-eb34e071-f493-481b-8cea-8d01e4761aa9 tempest-SnapshotsActionsTest-182824703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1967a16-ac2c-45d4-bdc8-77c13cf4830e" returned: 0 in 0.357s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:39:25 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-eb34e071-f493-481b-8cea-8d01e4761aa9 tempest-SnapshotsActionsTest-182824703 None] Lock "cinder-quobyte-e1967a16-ac2c-45d4-bdc8-77c13cf4830e" released by "delete_volume" :: held 1.056s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:39:25 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-eb34e071-f493-481b-8cea-8d01e4761aa9 tempest-SnapshotsActionsTest-182824703 None] Created reservations ['54c512fb-a87b-4aa2-9fad-abd516dbac34', '0cc137d0-2b2a-49ed-9e38-5e39e3b0bb12', 'f813eb91-e65f-4bf8-a5d4-f81bc2fa6afb', '7b241147-7831-4bf0-8778-684a39293f43'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:39:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-eb34e071-f493-481b-8cea-8d01e4761aa9 tempest-SnapshotsActionsTest-182824703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:39:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-eb34e071-f493-481b-8cea-8d01e4761aa9 tempest-SnapshotsActionsTest-182824703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:39:25 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-eb34e071-f493-481b-8cea-8d01e4761aa9 tempest-SnapshotsActionsTest-182824703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:39:25 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-eb34e071-f493-481b-8cea-8d01e4761aa9 tempest-SnapshotsActionsTest-182824703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:39:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-eb34e071-f493-481b-8cea-8d01e4761aa9 tempest-SnapshotsActionsTest-182824703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:39:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-eb34e071-f493-481b-8cea-8d01e4761aa9 tempest-SnapshotsActionsTest-182824703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:39:25 devstack sudo[89498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:39:25 devstack sudo[89498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:39:25 devstack sudo[89498]: pam_unix(sudo:session): session closed for user root Sep 04 22:39:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-eb34e071-f493-481b-8cea-8d01e4761aa9 tempest-SnapshotsActionsTest-182824703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.304s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:39:25 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-eb34e071-f493-481b-8cea-8d01e4761aa9 tempest-SnapshotsActionsTest-182824703 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:39:25 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-eb34e071-f493-481b-8cea-8d01e4761aa9 tempest-SnapshotsActionsTest-182824703 None] Deleted volume successfully. Sep 04 22:39:26 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-eb34e071-f493-481b-8cea-8d01e4761aa9 tempest-SnapshotsActionsTest-182824703 None] Lock "cinder-e1967a16-ac2c-45d4-bdc8-77c13cf4830e-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:39:29 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-ec8d23b4-5332-47c5-b589-0a6e7faf1823 req-3062220a-54ed-4ae5-985f-e65edbc8878a tempest-AttachVolumeShelveTestJSON-1171912429 None] No connector for attachment bdc25943-9a98-4e3e-bb35-d2b3f1f411ee; skipping storage backend terminate_connection call. {{(pid=87576) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 04 22:39:29 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-ec8d23b4-5332-47c5-b589-0a6e7faf1823 req-3062220a-54ed-4ae5-985f-e65edbc8878a tempest-AttachVolumeShelveTestJSON-1171912429 None] Deleting attachment bdc25943-9a98-4e3e-bb35-d2b3f1f411ee. {{(pid=87576) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 22:39:39 devstack cinder-volume[87576]: DEBUG dbcounter [-] [87576] Writing DB stats cinder:SELECT=58,cinder:UPDATE=58,cinder:INSERT=17,cinder:DELETE=3 {{(pid=87576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 22:39:39 devstack cinder-volume[87576]: DEBUG dbcounter [-] [87576] Writing DB stats cinder:UPDATE=61,cinder:SELECT=65,cinder:INSERT=15,cinder:DELETE=7 {{(pid=87576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 22:39:43 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8943e0a-a223-4d55-9282-f8787bdccdc3 tempest-TaggedAttachmentsTest-892373650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:39:43 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-a8943e0a-a223-4d55-9282-f8787bdccdc3 tempest-TaggedAttachmentsTest-892373650 None] Flow 'volume_create_manager' (5da0fb57-7ef0-4210-a93c-3d9a7138fcbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:39:43 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-a8943e0a-a223-4d55-9282-f8787bdccdc3 tempest-TaggedAttachmentsTest-892373650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fdfa98d-a081-4274-b6ed-cdc93bf8f320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:39:43 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-a8943e0a-a223-4d55-9282-f8787bdccdc3 tempest-TaggedAttachmentsTest-892373650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fdfa98d-a081-4274-b6ed-cdc93bf8f320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:39:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-650357524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69b65448-6146-4077-9402-a0b6f4e0c6ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dce71d900f7442d68cf6b057c7cc3e55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:39:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:39:43Z,use_quota=True,user_id='92b900260b57423295bc1b9f50729084',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:39:43 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-a8943e0a-a223-4d55-9282-f8787bdccdc3 tempest-TaggedAttachmentsTest-892373650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (934228c1-809a-4412-9e2b-889e24c123f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:39:43 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-a8943e0a-a223-4d55-9282-f8787bdccdc3 tempest-TaggedAttachmentsTest-892373650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (934228c1-809a-4412-9e2b-889e24c123f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:39:43 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-a8943e0a-a223-4d55-9282-f8787bdccdc3 tempest-TaggedAttachmentsTest-892373650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59ae1feb-31d0-4aef-8a3a-871614867e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:39:43 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-a8943e0a-a223-4d55-9282-f8787bdccdc3 tempest-TaggedAttachmentsTest-892373650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59ae1feb-31d0-4aef-8a3a-871614867e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69b65448-6146-4077-9402-a0b6f4e0c6ce', 'volume_name': 'volume-69b65448-6146-4077-9402-a0b6f4e0c6ce', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:39:43 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-a8943e0a-a223-4d55-9282-f8787bdccdc3 tempest-TaggedAttachmentsTest-892373650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b8a2a4b-2a62-4ebf-8a17-6d13ff48b0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:39:43 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-a8943e0a-a223-4d55-9282-f8787bdccdc3 tempest-TaggedAttachmentsTest-892373650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b8a2a4b-2a62-4ebf-8a17-6d13ff48b0af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:39:43 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-a8943e0a-a223-4d55-9282-f8787bdccdc3 tempest-TaggedAttachmentsTest-892373650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89297c07-e27f-46fd-9752-0e3ff527aab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:39:43 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-a8943e0a-a223-4d55-9282-f8787bdccdc3 tempest-TaggedAttachmentsTest-892373650 None] Volume 69b65448-6146-4077-9402-a0b6f4e0c6ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69b65448-6146-4077-9402-a0b6f4e0c6ce', 'volume_size': 1} Sep 04 22:39:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-a8943e0a-a223-4d55-9282-f8787bdccdc3 tempest-TaggedAttachmentsTest-892373650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:39:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-a8943e0a-a223-4d55-9282-f8787bdccdc3 tempest-TaggedAttachmentsTest-892373650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:39:43 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-a8943e0a-a223-4d55-9282-f8787bdccdc3 tempest-TaggedAttachmentsTest-892373650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:39:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-650357524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69b65448-6146-4077-9402-a0b6f4e0c6ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dce71d900f7442d68cf6b057c7cc3e55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:39:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:39:43Z,use_quota=True,user_id='92b900260b57423295bc1b9f50729084',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:39:43 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-a8943e0a-a223-4d55-9282-f8787bdccdc3 tempest-TaggedAttachmentsTest-892373650 None] Creating volume 69b65448-6146-4077-9402-a0b6f4e0c6ce {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:39:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-a8943e0a-a223-4d55-9282-f8787bdccdc3 tempest-TaggedAttachmentsTest-892373650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:39:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-a8943e0a-a223-4d55-9282-f8787bdccdc3 tempest-TaggedAttachmentsTest-892373650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:39:43 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-a8943e0a-a223-4d55-9282-f8787bdccdc3 tempest-TaggedAttachmentsTest-892373650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:39:43 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-a8943e0a-a223-4d55-9282-f8787bdccdc3 tempest-TaggedAttachmentsTest-892373650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:39:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-a8943e0a-a223-4d55-9282-f8787bdccdc3 tempest-TaggedAttachmentsTest-892373650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:39:43 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-a8943e0a-a223-4d55-9282-f8787bdccdc3 tempest-TaggedAttachmentsTest-892373650 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:39:43 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-a8943e0a-a223-4d55-9282-f8787bdccdc3 tempest-TaggedAttachmentsTest-892373650 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:39:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a8943e0a-a223-4d55-9282-f8787bdccdc3 tempest-TaggedAttachmentsTest-892373650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-69b65448-6146-4077-9402-a0b6f4e0c6ce 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:39:43 devstack sudo[89513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-69b65448-6146-4077-9402-a0b6f4e0c6ce 1073741824 Sep 04 22:39:43 devstack sudo[89513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:39:43 devstack sudo[89513]: pam_unix(sudo:session): session closed for user root Sep 04 22:39:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a8943e0a-a223-4d55-9282-f8787bdccdc3 tempest-TaggedAttachmentsTest-892373650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-69b65448-6146-4077-9402-a0b6f4e0c6ce 1073741824" returned: 0 in 0.602s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:39:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a8943e0a-a223-4d55-9282-f8787bdccdc3 tempest-TaggedAttachmentsTest-892373650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-69b65448-6146-4077-9402-a0b6f4e0c6ce {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:39:43 devstack sudo[89520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-69b65448-6146-4077-9402-a0b6f4e0c6ce Sep 04 22:39:43 devstack sudo[89520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:39:44 devstack sudo[89520]: pam_unix(sudo:session): session closed for user root Sep 04 22:39:44 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a8943e0a-a223-4d55-9282-f8787bdccdc3 tempest-TaggedAttachmentsTest-892373650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-69b65448-6146-4077-9402-a0b6f4e0c6ce" returned: 0 in 0.293s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:39:44 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-a8943e0a-a223-4d55-9282-f8787bdccdc3 tempest-TaggedAttachmentsTest-892373650 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:39:44 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-a8943e0a-a223-4d55-9282-f8787bdccdc3 tempest-TaggedAttachmentsTest-892373650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:39:44 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-a8943e0a-a223-4d55-9282-f8787bdccdc3 tempest-TaggedAttachmentsTest-892373650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89297c07-e27f-46fd-9752-0e3ff527aab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69b65448-6146-4077-9402-a0b6f4e0c6ce', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:39:44 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-a8943e0a-a223-4d55-9282-f8787bdccdc3 tempest-TaggedAttachmentsTest-892373650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6be2c1df-4b56-4de1-80dc-9b65a2de0c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:39:44 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-a8943e0a-a223-4d55-9282-f8787bdccdc3 tempest-TaggedAttachmentsTest-892373650 None] Volume volume-69b65448-6146-4077-9402-a0b6f4e0c6ce (69b65448-6146-4077-9402-a0b6f4e0c6ce): created successfully Sep 04 22:39:44 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-a8943e0a-a223-4d55-9282-f8787bdccdc3 tempest-TaggedAttachmentsTest-892373650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6be2c1df-4b56-4de1-80dc-9b65a2de0c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:39:44 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-a8943e0a-a223-4d55-9282-f8787bdccdc3 tempest-TaggedAttachmentsTest-892373650 None] Flow 'volume_create_manager' (5da0fb57-7ef0-4210-a93c-3d9a7138fcbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:39:44 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-a8943e0a-a223-4d55-9282-f8787bdccdc3 tempest-TaggedAttachmentsTest-892373650 None] Created volume successfully. Sep 04 22:40:02 devstack cinder-volume[87576]: DEBUG dbcounter [-] [87576] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 22:40:02 devstack cinder-volume[87576]: DEBUG dbcounter [-] [87576] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4 {{(pid=87576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 22:40:03 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5714784-3eaf-421f-a95b-a708e3d51ede tempest-VolumeQuotasAdminTestJSON-1331002922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:40:03 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d5714784-3eaf-421f-a95b-a708e3d51ede tempest-VolumeQuotasAdminTestJSON-1331002922 None] Flow 'volume_create_manager' (a406f9cd-9eca-4e0c-8082-a07db34e1a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:40:03 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d5714784-3eaf-421f-a95b-a708e3d51ede tempest-VolumeQuotasAdminTestJSON-1331002922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0941ed60-5c36-466b-9aa3-47bf4214790f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:40:03 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d5714784-3eaf-421f-a95b-a708e3d51ede tempest-VolumeQuotasAdminTestJSON-1331002922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0941ed60-5c36-466b-9aa3-47bf4214790f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:40:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-886836524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f283d16a-12aa-4a2b-a078-2903acb4c0f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3918734e28848f9950c325554313268',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:40:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:40:03Z,use_quota=True,user_id='93ab6f8d054b4e4fa6c92cf156706cfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:40:03 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d5714784-3eaf-421f-a95b-a708e3d51ede tempest-VolumeQuotasAdminTestJSON-1331002922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66f94b23-e076-4ee7-a27d-8283d2402ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:40:03 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d5714784-3eaf-421f-a95b-a708e3d51ede tempest-VolumeQuotasAdminTestJSON-1331002922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66f94b23-e076-4ee7-a27d-8283d2402ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:40:03 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d5714784-3eaf-421f-a95b-a708e3d51ede tempest-VolumeQuotasAdminTestJSON-1331002922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06047666-353f-47bb-8367-1f25733433c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:40:03 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d5714784-3eaf-421f-a95b-a708e3d51ede tempest-VolumeQuotasAdminTestJSON-1331002922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06047666-353f-47bb-8367-1f25733433c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f283d16a-12aa-4a2b-a078-2903acb4c0f3', 'volume_name': 'volume-f283d16a-12aa-4a2b-a078-2903acb4c0f3', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:40:03 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d5714784-3eaf-421f-a95b-a708e3d51ede tempest-VolumeQuotasAdminTestJSON-1331002922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7ae406b-a028-48cf-a599-e48165010b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:40:03 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d5714784-3eaf-421f-a95b-a708e3d51ede tempest-VolumeQuotasAdminTestJSON-1331002922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7ae406b-a028-48cf-a599-e48165010b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:40:03 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d5714784-3eaf-421f-a95b-a708e3d51ede tempest-VolumeQuotasAdminTestJSON-1331002922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c41b020-7889-443b-b156-37e25575ea1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:40:03 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-d5714784-3eaf-421f-a95b-a708e3d51ede tempest-VolumeQuotasAdminTestJSON-1331002922 None] Volume f283d16a-12aa-4a2b-a078-2903acb4c0f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f283d16a-12aa-4a2b-a078-2903acb4c0f3', 'volume_size': 1} Sep 04 22:40:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-d5714784-3eaf-421f-a95b-a708e3d51ede tempest-VolumeQuotasAdminTestJSON-1331002922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:40:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-d5714784-3eaf-421f-a95b-a708e3d51ede tempest-VolumeQuotasAdminTestJSON-1331002922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:40:03 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-d5714784-3eaf-421f-a95b-a708e3d51ede tempest-VolumeQuotasAdminTestJSON-1331002922 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:40:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-886836524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f283d16a-12aa-4a2b-a078-2903acb4c0f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3918734e28848f9950c325554313268',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:40:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:40:03Z,use_quota=True,user_id='93ab6f8d054b4e4fa6c92cf156706cfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:40:03 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-d5714784-3eaf-421f-a95b-a708e3d51ede tempest-VolumeQuotasAdminTestJSON-1331002922 None] Creating volume f283d16a-12aa-4a2b-a078-2903acb4c0f3 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:40:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-d5714784-3eaf-421f-a95b-a708e3d51ede tempest-VolumeQuotasAdminTestJSON-1331002922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:40:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-d5714784-3eaf-421f-a95b-a708e3d51ede tempest-VolumeQuotasAdminTestJSON-1331002922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:40:03 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-d5714784-3eaf-421f-a95b-a708e3d51ede tempest-VolumeQuotasAdminTestJSON-1331002922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:40:03 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-d5714784-3eaf-421f-a95b-a708e3d51ede tempest-VolumeQuotasAdminTestJSON-1331002922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:40:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-d5714784-3eaf-421f-a95b-a708e3d51ede tempest-VolumeQuotasAdminTestJSON-1331002922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:40:03 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-d5714784-3eaf-421f-a95b-a708e3d51ede tempest-VolumeQuotasAdminTestJSON-1331002922 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:40:03 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-d5714784-3eaf-421f-a95b-a708e3d51ede tempest-VolumeQuotasAdminTestJSON-1331002922 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:40:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d5714784-3eaf-421f-a95b-a708e3d51ede tempest-VolumeQuotasAdminTestJSON-1331002922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f283d16a-12aa-4a2b-a078-2903acb4c0f3 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:40:03 devstack sudo[89767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f283d16a-12aa-4a2b-a078-2903acb4c0f3 1073741824 Sep 04 22:40:03 devstack sudo[89767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:40:04 devstack sudo[89767]: pam_unix(sudo:session): session closed for user root Sep 04 22:40:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d5714784-3eaf-421f-a95b-a708e3d51ede tempest-VolumeQuotasAdminTestJSON-1331002922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f283d16a-12aa-4a2b-a078-2903acb4c0f3 1073741824" returned: 0 in 0.814s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:40:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d5714784-3eaf-421f-a95b-a708e3d51ede tempest-VolumeQuotasAdminTestJSON-1331002922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f283d16a-12aa-4a2b-a078-2903acb4c0f3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:40:04 devstack sudo[89776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f283d16a-12aa-4a2b-a078-2903acb4c0f3 Sep 04 22:40:04 devstack sudo[89776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:40:04 devstack sudo[89776]: pam_unix(sudo:session): session closed for user root Sep 04 22:40:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d5714784-3eaf-421f-a95b-a708e3d51ede tempest-VolumeQuotasAdminTestJSON-1331002922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f283d16a-12aa-4a2b-a078-2903acb4c0f3" returned: 0 in 0.571s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:40:04 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-d5714784-3eaf-421f-a95b-a708e3d51ede tempest-VolumeQuotasAdminTestJSON-1331002922 None] <== create_volume: return (1502ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:40:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-d5714784-3eaf-421f-a95b-a708e3d51ede tempest-VolumeQuotasAdminTestJSON-1331002922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.504s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:40:04 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d5714784-3eaf-421f-a95b-a708e3d51ede tempest-VolumeQuotasAdminTestJSON-1331002922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c41b020-7889-443b-b156-37e25575ea1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f283d16a-12aa-4a2b-a078-2903acb4c0f3', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:40:04 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d5714784-3eaf-421f-a95b-a708e3d51ede tempest-VolumeQuotasAdminTestJSON-1331002922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb98d973-1579-4a27-8041-a04fa3704652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:40:04 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-d5714784-3eaf-421f-a95b-a708e3d51ede tempest-VolumeQuotasAdminTestJSON-1331002922 None] Volume volume-f283d16a-12aa-4a2b-a078-2903acb4c0f3 (f283d16a-12aa-4a2b-a078-2903acb4c0f3): created successfully Sep 04 22:40:04 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d5714784-3eaf-421f-a95b-a708e3d51ede tempest-VolumeQuotasAdminTestJSON-1331002922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb98d973-1579-4a27-8041-a04fa3704652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:40:04 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d5714784-3eaf-421f-a95b-a708e3d51ede tempest-VolumeQuotasAdminTestJSON-1331002922 None] Flow 'volume_create_manager' (a406f9cd-9eca-4e0c-8082-a07db34e1a98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:40:04 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-d5714784-3eaf-421f-a95b-a708e3d51ede tempest-VolumeQuotasAdminTestJSON-1331002922 None] Created volume successfully. Sep 04 22:40:05 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-8cc453b5-edc0-46e9-a705-fce9005ab7fb tempest-VolumeQuotasAdminTestJSON-1331002922 None] Acquiring lock "cinder-f283d16a-12aa-4a2b-a078-2903acb4c0f3-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:40:05 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-8cc453b5-edc0-46e9-a705-fce9005ab7fb tempest-VolumeQuotasAdminTestJSON-1331002922 None] Lock "cinder-f283d16a-12aa-4a2b-a078-2903acb4c0f3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:40:05 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-8cc453b5-edc0-46e9-a705-fce9005ab7fb tempest-VolumeQuotasAdminTestJSON-1331002922 None] Acquiring lock "cinder-quobyte-f283d16a-12aa-4a2b-a078-2903acb4c0f3" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:40:05 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-8cc453b5-edc0-46e9-a705-fce9005ab7fb tempest-VolumeQuotasAdminTestJSON-1331002922 None] Lock "cinder-quobyte-f283d16a-12aa-4a2b-a078-2903acb4c0f3" acquired by "delete_volume" :: waited 0.036s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:40:05 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[14741115-bf76-47f6-9f1a-e415273ddcbb]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:40:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-8cc453b5-edc0-46e9-a705-fce9005ab7fb tempest-VolumeQuotasAdminTestJSON-1331002922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f283d16a-12aa-4a2b-a078-2903acb4c0f3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:40:05 devstack sudo[89781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f283d16a-12aa-4a2b-a078-2903acb4c0f3 Sep 04 22:40:05 devstack sudo[89781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:40:06 devstack sudo[89781]: pam_unix(sudo:session): session closed for user root Sep 04 22:40:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-8cc453b5-edc0-46e9-a705-fce9005ab7fb tempest-VolumeQuotasAdminTestJSON-1331002922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f283d16a-12aa-4a2b-a078-2903acb4c0f3" returned: 0 in 0.617s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:40:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-8cc453b5-edc0-46e9-a705-fce9005ab7fb tempest-VolumeQuotasAdminTestJSON-1331002922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f283d16a-12aa-4a2b-a078-2903acb4c0f3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:40:06 devstack sudo[89790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f283d16a-12aa-4a2b-a078-2903acb4c0f3 Sep 04 22:40:06 devstack sudo[89790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:40:07 devstack sudo[89790]: pam_unix(sudo:session): session closed for user root Sep 04 22:40:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-8cc453b5-edc0-46e9-a705-fce9005ab7fb tempest-VolumeQuotasAdminTestJSON-1331002922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f283d16a-12aa-4a2b-a078-2903acb4c0f3" returned: 0 in 1.029s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:40:07 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-8cc453b5-edc0-46e9-a705-fce9005ab7fb tempest-VolumeQuotasAdminTestJSON-1331002922 None] Lock "cinder-quobyte-f283d16a-12aa-4a2b-a078-2903acb4c0f3" released by "delete_volume" :: held 1.743s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:40:07 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-8cc453b5-edc0-46e9-a705-fce9005ab7fb tempest-VolumeQuotasAdminTestJSON-1331002922 None] Created reservations ['9c669c72-bbae-4569-bdc2-c05ef2683dd1', '3ff9f0e6-93f9-4a0d-a37a-3fd6d09af6c3', 'b014c510-0c4a-4770-b46f-52210e656d79', 'b7744ce1-706b-43a2-8e79-8940ff9d4250'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:40:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-8cc453b5-edc0-46e9-a705-fce9005ab7fb tempest-VolumeQuotasAdminTestJSON-1331002922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:40:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-8cc453b5-edc0-46e9-a705-fce9005ab7fb tempest-VolumeQuotasAdminTestJSON-1331002922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:40:07 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-8cc453b5-edc0-46e9-a705-fce9005ab7fb tempest-VolumeQuotasAdminTestJSON-1331002922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:40:07 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-8cc453b5-edc0-46e9-a705-fce9005ab7fb tempest-VolumeQuotasAdminTestJSON-1331002922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:40:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-8cc453b5-edc0-46e9-a705-fce9005ab7fb tempest-VolumeQuotasAdminTestJSON-1331002922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:40:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-8cc453b5-edc0-46e9-a705-fce9005ab7fb tempest-VolumeQuotasAdminTestJSON-1331002922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:40:07 devstack sudo[89852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:40:07 devstack sudo[89852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:40:08 devstack sudo[89852]: pam_unix(sudo:session): session closed for user root Sep 04 22:40:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-8cc453b5-edc0-46e9-a705-fce9005ab7fb tempest-VolumeQuotasAdminTestJSON-1331002922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.933s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:40:08 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-8cc453b5-edc0-46e9-a705-fce9005ab7fb tempest-VolumeQuotasAdminTestJSON-1331002922 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:40:08 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-8cc453b5-edc0-46e9-a705-fce9005ab7fb tempest-VolumeQuotasAdminTestJSON-1331002922 None] Deleted volume successfully. Sep 04 22:40:08 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-8cc453b5-edc0-46e9-a705-fce9005ab7fb tempest-VolumeQuotasAdminTestJSON-1331002922 None] Lock "cinder-f283d16a-12aa-4a2b-a078-2903acb4c0f3-delete_volume" released by "delete_volume" :: held 3.347s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:40:09 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-84d12360-7820-4788-a24d-dd3af6f00a31 tempest-VolumeQuotasAdminTestJSON-1331002922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:40:09 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-84d12360-7820-4788-a24d-dd3af6f00a31 tempest-VolumeQuotasAdminTestJSON-1331002922 None] Flow 'volume_create_manager' (1d67ec15-de02-4e91-860a-a0efc9bcd76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:40:09 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-84d12360-7820-4788-a24d-dd3af6f00a31 tempest-VolumeQuotasAdminTestJSON-1331002922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cc53a76-0cd6-4f88-8ad4-6bafb8f83722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:40:09 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-84d12360-7820-4788-a24d-dd3af6f00a31 tempest-VolumeQuotasAdminTestJSON-1331002922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cc53a76-0cd6-4f88-8ad4-6bafb8f83722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:40:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-461873786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9fa5058-bced-426c-b380-31c71e4b08b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3918734e28848f9950c325554313268',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:40:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:40:10Z,use_quota=True,user_id='93ab6f8d054b4e4fa6c92cf156706cfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:40:09 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-84d12360-7820-4788-a24d-dd3af6f00a31 tempest-VolumeQuotasAdminTestJSON-1331002922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8266903d-8dbd-4cb0-8d5c-d510dcce49d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:40:09 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-84d12360-7820-4788-a24d-dd3af6f00a31 tempest-VolumeQuotasAdminTestJSON-1331002922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8266903d-8dbd-4cb0-8d5c-d510dcce49d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:40:09 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-84d12360-7820-4788-a24d-dd3af6f00a31 tempest-VolumeQuotasAdminTestJSON-1331002922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31aed244-d5cb-44cb-9878-7656b2632d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:40:09 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-84d12360-7820-4788-a24d-dd3af6f00a31 tempest-VolumeQuotasAdminTestJSON-1331002922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31aed244-d5cb-44cb-9878-7656b2632d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9fa5058-bced-426c-b380-31c71e4b08b0', 'volume_name': 'volume-a9fa5058-bced-426c-b380-31c71e4b08b0', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:40:09 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-84d12360-7820-4788-a24d-dd3af6f00a31 tempest-VolumeQuotasAdminTestJSON-1331002922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90e715b1-326a-42aa-ad66-3f15b81cd54f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:40:09 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-84d12360-7820-4788-a24d-dd3af6f00a31 tempest-VolumeQuotasAdminTestJSON-1331002922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90e715b1-326a-42aa-ad66-3f15b81cd54f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:40:09 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-84d12360-7820-4788-a24d-dd3af6f00a31 tempest-VolumeQuotasAdminTestJSON-1331002922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0265a522-0a1c-444d-8010-f813a364d420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:40:09 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-84d12360-7820-4788-a24d-dd3af6f00a31 tempest-VolumeQuotasAdminTestJSON-1331002922 None] Volume a9fa5058-bced-426c-b380-31c71e4b08b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9fa5058-bced-426c-b380-31c71e4b08b0', 'volume_size': 1} Sep 04 22:40:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-84d12360-7820-4788-a24d-dd3af6f00a31 tempest-VolumeQuotasAdminTestJSON-1331002922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:40:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-84d12360-7820-4788-a24d-dd3af6f00a31 tempest-VolumeQuotasAdminTestJSON-1331002922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:40:09 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-84d12360-7820-4788-a24d-dd3af6f00a31 tempest-VolumeQuotasAdminTestJSON-1331002922 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:40:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-461873786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9fa5058-bced-426c-b380-31c71e4b08b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3918734e28848f9950c325554313268',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:40:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:40:10Z,use_quota=True,user_id='93ab6f8d054b4e4fa6c92cf156706cfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:40:09 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-84d12360-7820-4788-a24d-dd3af6f00a31 tempest-VolumeQuotasAdminTestJSON-1331002922 None] Creating volume a9fa5058-bced-426c-b380-31c71e4b08b0 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:40:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-84d12360-7820-4788-a24d-dd3af6f00a31 tempest-VolumeQuotasAdminTestJSON-1331002922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:40:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-84d12360-7820-4788-a24d-dd3af6f00a31 tempest-VolumeQuotasAdminTestJSON-1331002922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:40:09 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-84d12360-7820-4788-a24d-dd3af6f00a31 tempest-VolumeQuotasAdminTestJSON-1331002922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:40:09 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-84d12360-7820-4788-a24d-dd3af6f00a31 tempest-VolumeQuotasAdminTestJSON-1331002922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:40:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-84d12360-7820-4788-a24d-dd3af6f00a31 tempest-VolumeQuotasAdminTestJSON-1331002922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:40:09 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-84d12360-7820-4788-a24d-dd3af6f00a31 tempest-VolumeQuotasAdminTestJSON-1331002922 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:40:09 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-84d12360-7820-4788-a24d-dd3af6f00a31 tempest-VolumeQuotasAdminTestJSON-1331002922 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:40:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-84d12360-7820-4788-a24d-dd3af6f00a31 tempest-VolumeQuotasAdminTestJSON-1331002922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-a9fa5058-bced-426c-b380-31c71e4b08b0 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:40:10 devstack sudo[89869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-a9fa5058-bced-426c-b380-31c71e4b08b0 1073741824 Sep 04 22:40:10 devstack sudo[89869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:40:10 devstack sudo[89869]: pam_unix(sudo:session): session closed for user root Sep 04 22:40:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-84d12360-7820-4788-a24d-dd3af6f00a31 tempest-VolumeQuotasAdminTestJSON-1331002922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-a9fa5058-bced-426c-b380-31c71e4b08b0 1073741824" returned: 0 in 0.935s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:40:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-84d12360-7820-4788-a24d-dd3af6f00a31 tempest-VolumeQuotasAdminTestJSON-1331002922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-a9fa5058-bced-426c-b380-31c71e4b08b0 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:40:11 devstack sudo[89877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-a9fa5058-bced-426c-b380-31c71e4b08b0 Sep 04 22:40:11 devstack sudo[89877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:40:11 devstack sudo[89877]: pam_unix(sudo:session): session closed for user root Sep 04 22:40:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-84d12360-7820-4788-a24d-dd3af6f00a31 tempest-VolumeQuotasAdminTestJSON-1331002922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-a9fa5058-bced-426c-b380-31c71e4b08b0" returned: 0 in 0.655s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:40:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-84d12360-7820-4788-a24d-dd3af6f00a31 tempest-VolumeQuotasAdminTestJSON-1331002922 None] <== create_volume: return (1668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:40:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-84d12360-7820-4788-a24d-dd3af6f00a31 tempest-VolumeQuotasAdminTestJSON-1331002922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.672s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:40:11 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-84d12360-7820-4788-a24d-dd3af6f00a31 tempest-VolumeQuotasAdminTestJSON-1331002922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0265a522-0a1c-444d-8010-f813a364d420) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9fa5058-bced-426c-b380-31c71e4b08b0', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:40:11 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-84d12360-7820-4788-a24d-dd3af6f00a31 tempest-VolumeQuotasAdminTestJSON-1331002922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8bbb6bb-50a1-4a3a-be04-670cefe0694d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:40:11 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-84d12360-7820-4788-a24d-dd3af6f00a31 tempest-VolumeQuotasAdminTestJSON-1331002922 None] Volume volume-a9fa5058-bced-426c-b380-31c71e4b08b0 (a9fa5058-bced-426c-b380-31c71e4b08b0): created successfully Sep 04 22:40:11 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-84d12360-7820-4788-a24d-dd3af6f00a31 tempest-VolumeQuotasAdminTestJSON-1331002922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8bbb6bb-50a1-4a3a-be04-670cefe0694d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:40:11 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-84d12360-7820-4788-a24d-dd3af6f00a31 tempest-VolumeQuotasAdminTestJSON-1331002922 None] Flow 'volume_create_manager' (1d67ec15-de02-4e91-860a-a0efc9bcd76a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:40:11 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-bad52926-0dde-4241-a6b8-b422cbdcd1ea tempest-VolumesAdminNegativeTest-254987273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:40:11 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-bad52926-0dde-4241-a6b8-b422cbdcd1ea tempest-VolumesAdminNegativeTest-254987273 None] Flow 'volume_create_manager' (63ef3f76-8dd7-4704-b4e2-6828904a157e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:40:11 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-bad52926-0dde-4241-a6b8-b422cbdcd1ea tempest-VolumesAdminNegativeTest-254987273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d88619c8-f6ba-4f7d-8875-497fd4b422d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:40:11 devstack cinder-volume[87576]: DEBUG oslo_service.periodic_task [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87576) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 22:40:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:40:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:40:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:40:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:40:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:40:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:40:11 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-84d12360-7820-4788-a24d-dd3af6f00a31 tempest-VolumeQuotasAdminTestJSON-1331002922 None] Created volume successfully. Sep 04 22:40:11 devstack sudo[89882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:40:11 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-bad52926-0dde-4241-a6b8-b422cbdcd1ea tempest-VolumesAdminNegativeTest-254987273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d88619c8-f6ba-4f7d-8875-497fd4b422d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:40:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1047911179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b5d71c1-da76-4306-968b-4dbe7dabd60d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c489cc1f61c4f62bcf258e03639ff07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:40:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:40:12Z,use_quota=True,user_id='e56f7bdd506d4a25b1ad67257dd5e921',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:40:11 devstack sudo[89882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:40:11 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-bad52926-0dde-4241-a6b8-b422cbdcd1ea tempest-VolumesAdminNegativeTest-254987273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (616a2305-bfa6-4e47-bd71-851a6440b3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:40:11 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-bad52926-0dde-4241-a6b8-b422cbdcd1ea tempest-VolumesAdminNegativeTest-254987273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (616a2305-bfa6-4e47-bd71-851a6440b3e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:40:11 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-bad52926-0dde-4241-a6b8-b422cbdcd1ea tempest-VolumesAdminNegativeTest-254987273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae2c1d2b-7737-4da5-9146-4523efeb7873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:40:11 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-bad52926-0dde-4241-a6b8-b422cbdcd1ea tempest-VolumesAdminNegativeTest-254987273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae2c1d2b-7737-4da5-9146-4523efeb7873) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b5d71c1-da76-4306-968b-4dbe7dabd60d', 'volume_name': 'volume-9b5d71c1-da76-4306-968b-4dbe7dabd60d', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:40:11 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-bad52926-0dde-4241-a6b8-b422cbdcd1ea tempest-VolumesAdminNegativeTest-254987273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e8a2250-37a7-428c-b459-fb1699673fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:40:11 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-bad52926-0dde-4241-a6b8-b422cbdcd1ea tempest-VolumesAdminNegativeTest-254987273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e8a2250-37a7-428c-b459-fb1699673fe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:40:11 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-bad52926-0dde-4241-a6b8-b422cbdcd1ea tempest-VolumesAdminNegativeTest-254987273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43e9cea7-1a88-406e-8b25-b41bb6b06925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:40:11 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-bad52926-0dde-4241-a6b8-b422cbdcd1ea tempest-VolumesAdminNegativeTest-254987273 None] Volume 9b5d71c1-da76-4306-968b-4dbe7dabd60d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b5d71c1-da76-4306-968b-4dbe7dabd60d', 'volume_size': 1} Sep 04 22:40:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-bad52926-0dde-4241-a6b8-b422cbdcd1ea tempest-VolumesAdminNegativeTest-254987273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:40:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-bad52926-0dde-4241-a6b8-b422cbdcd1ea tempest-VolumesAdminNegativeTest-254987273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:40:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-bad52926-0dde-4241-a6b8-b422cbdcd1ea tempest-VolumesAdminNegativeTest-254987273 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:40:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1047911179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b5d71c1-da76-4306-968b-4dbe7dabd60d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c489cc1f61c4f62bcf258e03639ff07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:40:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:40:12Z,use_quota=True,user_id='e56f7bdd506d4a25b1ad67257dd5e921',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:40:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-bad52926-0dde-4241-a6b8-b422cbdcd1ea tempest-VolumesAdminNegativeTest-254987273 None] Creating volume 9b5d71c1-da76-4306-968b-4dbe7dabd60d {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:40:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-bad52926-0dde-4241-a6b8-b422cbdcd1ea tempest-VolumesAdminNegativeTest-254987273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:40:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-bad52926-0dde-4241-a6b8-b422cbdcd1ea tempest-VolumesAdminNegativeTest-254987273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:40:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-bad52926-0dde-4241-a6b8-b422cbdcd1ea tempest-VolumesAdminNegativeTest-254987273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:40:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-bad52926-0dde-4241-a6b8-b422cbdcd1ea tempest-VolumesAdminNegativeTest-254987273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:40:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-bad52926-0dde-4241-a6b8-b422cbdcd1ea tempest-VolumesAdminNegativeTest-254987273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:40:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-bad52926-0dde-4241-a6b8-b422cbdcd1ea tempest-VolumesAdminNegativeTest-254987273 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:40:11 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-bad52926-0dde-4241-a6b8-b422cbdcd1ea tempest-VolumesAdminNegativeTest-254987273 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:40:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-bad52926-0dde-4241-a6b8-b422cbdcd1ea tempest-VolumesAdminNegativeTest-254987273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9b5d71c1-da76-4306-968b-4dbe7dabd60d 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:40:11 devstack sudo[89884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9b5d71c1-da76-4306-968b-4dbe7dabd60d 1073741824 Sep 04 22:40:11 devstack sudo[89884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:40:12 devstack sudo[89882]: pam_unix(sudo:session): session closed for user root Sep 04 22:40:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.451s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:40:12 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:40:12 devstack sudo[89884]: pam_unix(sudo:session): session closed for user root Sep 04 22:40:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-bad52926-0dde-4241-a6b8-b422cbdcd1ea tempest-VolumesAdminNegativeTest-254987273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9b5d71c1-da76-4306-968b-4dbe7dabd60d 1073741824" returned: 0 in 0.486s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:40:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-bad52926-0dde-4241-a6b8-b422cbdcd1ea tempest-VolumesAdminNegativeTest-254987273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9b5d71c1-da76-4306-968b-4dbe7dabd60d {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:40:12 devstack sudo[89891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9b5d71c1-da76-4306-968b-4dbe7dabd60d Sep 04 22:40:12 devstack sudo[89891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:40:12 devstack sudo[89891]: pam_unix(sudo:session): session closed for user root Sep 04 22:40:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-bad52926-0dde-4241-a6b8-b422cbdcd1ea tempest-VolumesAdminNegativeTest-254987273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9b5d71c1-da76-4306-968b-4dbe7dabd60d" returned: 0 in 0.257s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:40:12 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-bad52926-0dde-4241-a6b8-b422cbdcd1ea tempest-VolumesAdminNegativeTest-254987273 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:40:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-bad52926-0dde-4241-a6b8-b422cbdcd1ea tempest-VolumesAdminNegativeTest-254987273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:40:12 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-bad52926-0dde-4241-a6b8-b422cbdcd1ea tempest-VolumesAdminNegativeTest-254987273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43e9cea7-1a88-406e-8b25-b41bb6b06925) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b5d71c1-da76-4306-968b-4dbe7dabd60d', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:40:12 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-bad52926-0dde-4241-a6b8-b422cbdcd1ea tempest-VolumesAdminNegativeTest-254987273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8796a340-f479-4802-8115-a142df0541be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:40:12 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-bad52926-0dde-4241-a6b8-b422cbdcd1ea tempest-VolumesAdminNegativeTest-254987273 None] Volume volume-9b5d71c1-da76-4306-968b-4dbe7dabd60d (9b5d71c1-da76-4306-968b-4dbe7dabd60d): created successfully Sep 04 22:40:12 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-bad52926-0dde-4241-a6b8-b422cbdcd1ea tempest-VolumesAdminNegativeTest-254987273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8796a340-f479-4802-8115-a142df0541be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:40:12 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-bad52926-0dde-4241-a6b8-b422cbdcd1ea tempest-VolumesAdminNegativeTest-254987273 None] Flow 'volume_create_manager' (63ef3f76-8dd7-4704-b4e2-6828904a157e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:40:12 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-bad52926-0dde-4241-a6b8-b422cbdcd1ea tempest-VolumesAdminNegativeTest-254987273 None] Created volume successfully. Sep 04 22:40:13 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-a9cba556-f8a7-4102-b018-828fb2099e7f tempest-VolumeQuotasAdminTestJSON-1040865948 None] Transfer volume completed successfully. Sep 04 22:40:14 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-85ddc024-3a34-4140-8837-31df447165f3 tempest-VolumeQuotasAdminTestJSON-1244999755 None] Acquiring lock "cinder-a9fa5058-bced-426c-b380-31c71e4b08b0-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:40:14 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-85ddc024-3a34-4140-8837-31df447165f3 tempest-VolumeQuotasAdminTestJSON-1244999755 None] Lock "cinder-a9fa5058-bced-426c-b380-31c71e4b08b0-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:40:14 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-85ddc024-3a34-4140-8837-31df447165f3 tempest-VolumeQuotasAdminTestJSON-1244999755 None] Acquiring lock "cinder-quobyte-a9fa5058-bced-426c-b380-31c71e4b08b0" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:40:14 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-85ddc024-3a34-4140-8837-31df447165f3 tempest-VolumeQuotasAdminTestJSON-1244999755 None] Lock "cinder-quobyte-a9fa5058-bced-426c-b380-31c71e4b08b0" acquired by "delete_volume" :: waited 0.032s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:40:14 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20da45d-c8e8-45c3-afba-092b72f2b777]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:40:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-85ddc024-3a34-4140-8837-31df447165f3 tempest-VolumeQuotasAdminTestJSON-1244999755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-a9fa5058-bced-426c-b380-31c71e4b08b0 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:40:14 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-9b4b2854-6b20-42d1-bd0f-27a73039709a tempest-VolumesAdminNegativeTest-254987273 None] Acquiring lock "cinder-9b5d71c1-da76-4306-968b-4dbe7dabd60d-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:40:14 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-9b4b2854-6b20-42d1-bd0f-27a73039709a tempest-VolumesAdminNegativeTest-254987273 None] Lock "cinder-9b5d71c1-da76-4306-968b-4dbe7dabd60d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:40:14 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-9b4b2854-6b20-42d1-bd0f-27a73039709a tempest-VolumesAdminNegativeTest-254987273 None] Acquiring lock "cinder-quobyte-9b5d71c1-da76-4306-968b-4dbe7dabd60d" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:40:14 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-9b4b2854-6b20-42d1-bd0f-27a73039709a tempest-VolumesAdminNegativeTest-254987273 None] Lock "cinder-quobyte-9b5d71c1-da76-4306-968b-4dbe7dabd60d" acquired by "delete_volume" :: waited 0.025s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:40:14 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b8c691-97d5-4efd-ae3f-1264973592ec]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:40:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-9b4b2854-6b20-42d1-bd0f-27a73039709a tempest-VolumesAdminNegativeTest-254987273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9b5d71c1-da76-4306-968b-4dbe7dabd60d {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:40:14 devstack sudo[89895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-a9fa5058-bced-426c-b380-31c71e4b08b0 Sep 04 22:40:14 devstack sudo[89895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:40:14 devstack sudo[89896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9b5d71c1-da76-4306-968b-4dbe7dabd60d Sep 04 22:40:14 devstack sudo[89896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:40:14 devstack sudo[89895]: pam_unix(sudo:session): session closed for user root Sep 04 22:40:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-85ddc024-3a34-4140-8837-31df447165f3 tempest-VolumeQuotasAdminTestJSON-1244999755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-a9fa5058-bced-426c-b380-31c71e4b08b0" returned: 0 in 0.529s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:40:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-85ddc024-3a34-4140-8837-31df447165f3 tempest-VolumeQuotasAdminTestJSON-1244999755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-a9fa5058-bced-426c-b380-31c71e4b08b0 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:40:15 devstack sudo[89904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-a9fa5058-bced-426c-b380-31c71e4b08b0 Sep 04 22:40:15 devstack sudo[89904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:40:15 devstack sudo[89896]: pam_unix(sudo:session): session closed for user root Sep 04 22:40:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-9b4b2854-6b20-42d1-bd0f-27a73039709a tempest-VolumesAdminNegativeTest-254987273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9b5d71c1-da76-4306-968b-4dbe7dabd60d" returned: 0 in 0.450s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:40:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-9b4b2854-6b20-42d1-bd0f-27a73039709a tempest-VolumesAdminNegativeTest-254987273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9b5d71c1-da76-4306-968b-4dbe7dabd60d {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:40:15 devstack sudo[89908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9b5d71c1-da76-4306-968b-4dbe7dabd60d Sep 04 22:40:15 devstack sudo[89908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:40:15 devstack sudo[89904]: pam_unix(sudo:session): session closed for user root Sep 04 22:40:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-85ddc024-3a34-4140-8837-31df447165f3 tempest-VolumeQuotasAdminTestJSON-1244999755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-a9fa5058-bced-426c-b380-31c71e4b08b0" returned: 0 in 0.301s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:40:15 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-85ddc024-3a34-4140-8837-31df447165f3 tempest-VolumeQuotasAdminTestJSON-1244999755 None] Lock "cinder-quobyte-a9fa5058-bced-426c-b380-31c71e4b08b0" released by "delete_volume" :: held 0.909s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:40:15 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-85ddc024-3a34-4140-8837-31df447165f3 tempest-VolumeQuotasAdminTestJSON-1244999755 None] Created reservations ['1dd50771-5278-41df-bff7-82440bba0a81', '4fc4c4f6-91b5-4de8-831a-b89fee713661', '541fc116-ab0d-4c95-beb6-f56f4ed96001', '12042e30-f0fd-4b50-9973-83127de5f25e'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:40:15 devstack sudo[89908]: pam_unix(sudo:session): session closed for user root Sep 04 22:40:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-9b4b2854-6b20-42d1-bd0f-27a73039709a tempest-VolumesAdminNegativeTest-254987273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9b5d71c1-da76-4306-968b-4dbe7dabd60d" returned: 0 in 0.324s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:40:15 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-9b4b2854-6b20-42d1-bd0f-27a73039709a tempest-VolumesAdminNegativeTest-254987273 None] Lock "cinder-quobyte-9b5d71c1-da76-4306-968b-4dbe7dabd60d" released by "delete_volume" :: held 0.856s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:40:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-85ddc024-3a34-4140-8837-31df447165f3 tempest-VolumeQuotasAdminTestJSON-1244999755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:40:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-85ddc024-3a34-4140-8837-31df447165f3 tempest-VolumeQuotasAdminTestJSON-1244999755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:40:15 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-85ddc024-3a34-4140-8837-31df447165f3 tempest-VolumeQuotasAdminTestJSON-1244999755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:40:15 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-85ddc024-3a34-4140-8837-31df447165f3 tempest-VolumeQuotasAdminTestJSON-1244999755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:40:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-85ddc024-3a34-4140-8837-31df447165f3 tempest-VolumeQuotasAdminTestJSON-1244999755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:40:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-85ddc024-3a34-4140-8837-31df447165f3 tempest-VolumeQuotasAdminTestJSON-1244999755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:40:15 devstack sudo[89912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:40:15 devstack sudo[89912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:40:15 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-9b4b2854-6b20-42d1-bd0f-27a73039709a tempest-VolumesAdminNegativeTest-254987273 None] Created reservations ['1b35c345-98fc-43a5-a90c-cdb428cc5ce5', '28f50cd8-172b-4486-b64f-6ed4ab96cdef', '9cb33929-a4ea-4fe1-a988-e8d113c96e19', 'c8a0b430-1446-49e6-96a0-92ad4161755d'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:40:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-9b4b2854-6b20-42d1-bd0f-27a73039709a tempest-VolumesAdminNegativeTest-254987273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:40:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-9b4b2854-6b20-42d1-bd0f-27a73039709a tempest-VolumesAdminNegativeTest-254987273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:40:15 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-9b4b2854-6b20-42d1-bd0f-27a73039709a tempest-VolumesAdminNegativeTest-254987273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:40:15 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-9b4b2854-6b20-42d1-bd0f-27a73039709a tempest-VolumesAdminNegativeTest-254987273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:40:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-9b4b2854-6b20-42d1-bd0f-27a73039709a tempest-VolumesAdminNegativeTest-254987273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:40:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-9b4b2854-6b20-42d1-bd0f-27a73039709a tempest-VolumesAdminNegativeTest-254987273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:40:15 devstack sudo[89914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:40:15 devstack sudo[89914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:40:16 devstack sudo[89912]: pam_unix(sudo:session): session closed for user root Sep 04 22:40:16 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-85ddc024-3a34-4140-8837-31df447165f3 tempest-VolumeQuotasAdminTestJSON-1244999755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.671s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:40:16 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-85ddc024-3a34-4140-8837-31df447165f3 tempest-VolumeQuotasAdminTestJSON-1244999755 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:40:16 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-85ddc024-3a34-4140-8837-31df447165f3 tempest-VolumeQuotasAdminTestJSON-1244999755 None] Deleted volume successfully. Sep 04 22:40:16 devstack sudo[89914]: pam_unix(sudo:session): session closed for user root Sep 04 22:40:16 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-9b4b2854-6b20-42d1-bd0f-27a73039709a tempest-VolumesAdminNegativeTest-254987273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.545s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:40:16 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-9b4b2854-6b20-42d1-bd0f-27a73039709a tempest-VolumesAdminNegativeTest-254987273 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:40:16 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-85ddc024-3a34-4140-8837-31df447165f3 tempest-VolumeQuotasAdminTestJSON-1244999755 None] Lock "cinder-a9fa5058-bced-426c-b380-31c71e4b08b0-delete_volume" released by "delete_volume" :: held 2.041s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:40:16 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-9b4b2854-6b20-42d1-bd0f-27a73039709a tempest-VolumesAdminNegativeTest-254987273 None] Deleted volume successfully. Sep 04 22:40:16 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-9b4b2854-6b20-42d1-bd0f-27a73039709a tempest-VolumesAdminNegativeTest-254987273 None] Lock "cinder-9b5d71c1-da76-4306-968b-4dbe7dabd60d-delete_volume" released by "delete_volume" :: held 1.837s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:40:24 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0be6c50-794e-45ff-808a-b8a6597c5136 tempest-VolumesServicesTestJSON-979531906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:40:24 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-c0be6c50-794e-45ff-808a-b8a6597c5136 tempest-VolumesServicesTestJSON-979531906 None] Flow 'volume_create_manager' (741ece20-3793-491e-ab46-da2d47b80f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:40:24 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-c0be6c50-794e-45ff-808a-b8a6597c5136 tempest-VolumesServicesTestJSON-979531906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ca0b099-55e3-479c-8aab-0e5ab85e277b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:40:24 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-c0be6c50-794e-45ff-808a-b8a6597c5136 tempest-VolumesServicesTestJSON-979531906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ca0b099-55e3-479c-8aab-0e5ab85e277b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:40:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1743865448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=304abab6-8d15-4e7c-a7da-0f92938553ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3bdfbffd638402fb34773c630128875',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:40:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:40:24Z,use_quota=True,user_id='7885e6726f814af7b9ffe30bb6739f8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:40:24 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-c0be6c50-794e-45ff-808a-b8a6597c5136 tempest-VolumesServicesTestJSON-979531906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de41e37f-ec2f-4dbf-b59a-76dd0617190a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:40:24 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-c0be6c50-794e-45ff-808a-b8a6597c5136 tempest-VolumesServicesTestJSON-979531906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de41e37f-ec2f-4dbf-b59a-76dd0617190a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:40:24 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-c0be6c50-794e-45ff-808a-b8a6597c5136 tempest-VolumesServicesTestJSON-979531906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (066432a1-8d56-4358-80f7-c415e278c53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:40:24 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-c0be6c50-794e-45ff-808a-b8a6597c5136 tempest-VolumesServicesTestJSON-979531906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (066432a1-8d56-4358-80f7-c415e278c53c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '304abab6-8d15-4e7c-a7da-0f92938553ba', 'volume_name': 'volume-304abab6-8d15-4e7c-a7da-0f92938553ba', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:40:24 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-c0be6c50-794e-45ff-808a-b8a6597c5136 tempest-VolumesServicesTestJSON-979531906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ab43940-9e56-4e45-9173-89120bc8022e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:40:24 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-c0be6c50-794e-45ff-808a-b8a6597c5136 tempest-VolumesServicesTestJSON-979531906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ab43940-9e56-4e45-9173-89120bc8022e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:40:24 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-c0be6c50-794e-45ff-808a-b8a6597c5136 tempest-VolumesServicesTestJSON-979531906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a613b89a-84a7-47ae-a7d6-a68106144544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:40:24 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-c0be6c50-794e-45ff-808a-b8a6597c5136 tempest-VolumesServicesTestJSON-979531906 None] Volume 304abab6-8d15-4e7c-a7da-0f92938553ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-304abab6-8d15-4e7c-a7da-0f92938553ba', 'volume_size': 1} Sep 04 22:40:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-c0be6c50-794e-45ff-808a-b8a6597c5136 tempest-VolumesServicesTestJSON-979531906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:40:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-c0be6c50-794e-45ff-808a-b8a6597c5136 tempest-VolumesServicesTestJSON-979531906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:40:24 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-c0be6c50-794e-45ff-808a-b8a6597c5136 tempest-VolumesServicesTestJSON-979531906 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:40:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1743865448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=304abab6-8d15-4e7c-a7da-0f92938553ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3bdfbffd638402fb34773c630128875',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:40:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:40:24Z,use_quota=True,user_id='7885e6726f814af7b9ffe30bb6739f8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:40:24 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-c0be6c50-794e-45ff-808a-b8a6597c5136 tempest-VolumesServicesTestJSON-979531906 None] Creating volume 304abab6-8d15-4e7c-a7da-0f92938553ba {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:40:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-c0be6c50-794e-45ff-808a-b8a6597c5136 tempest-VolumesServicesTestJSON-979531906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:40:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-c0be6c50-794e-45ff-808a-b8a6597c5136 tempest-VolumesServicesTestJSON-979531906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:40:24 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-c0be6c50-794e-45ff-808a-b8a6597c5136 tempest-VolumesServicesTestJSON-979531906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:40:24 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-c0be6c50-794e-45ff-808a-b8a6597c5136 tempest-VolumesServicesTestJSON-979531906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:40:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-c0be6c50-794e-45ff-808a-b8a6597c5136 tempest-VolumesServicesTestJSON-979531906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:40:24 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-c0be6c50-794e-45ff-808a-b8a6597c5136 tempest-VolumesServicesTestJSON-979531906 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:40:24 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-c0be6c50-794e-45ff-808a-b8a6597c5136 tempest-VolumesServicesTestJSON-979531906 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:40:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c0be6c50-794e-45ff-808a-b8a6597c5136 tempest-VolumesServicesTestJSON-979531906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-304abab6-8d15-4e7c-a7da-0f92938553ba 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:40:24 devstack sudo[90022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-304abab6-8d15-4e7c-a7da-0f92938553ba 1073741824 Sep 04 22:40:24 devstack sudo[90022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:40:25 devstack sudo[90022]: pam_unix(sudo:session): session closed for user root Sep 04 22:40:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c0be6c50-794e-45ff-808a-b8a6597c5136 tempest-VolumesServicesTestJSON-979531906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-304abab6-8d15-4e7c-a7da-0f92938553ba 1073741824" returned: 0 in 0.454s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:40:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c0be6c50-794e-45ff-808a-b8a6597c5136 tempest-VolumesServicesTestJSON-979531906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-304abab6-8d15-4e7c-a7da-0f92938553ba {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:40:25 devstack sudo[90027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-304abab6-8d15-4e7c-a7da-0f92938553ba Sep 04 22:40:25 devstack sudo[90027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:40:25 devstack sudo[90027]: pam_unix(sudo:session): session closed for user root Sep 04 22:40:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c0be6c50-794e-45ff-808a-b8a6597c5136 tempest-VolumesServicesTestJSON-979531906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-304abab6-8d15-4e7c-a7da-0f92938553ba" returned: 0 in 0.241s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:40:25 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-c0be6c50-794e-45ff-808a-b8a6597c5136 tempest-VolumesServicesTestJSON-979531906 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:40:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-c0be6c50-794e-45ff-808a-b8a6597c5136 tempest-VolumesServicesTestJSON-979531906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:40:25 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-c0be6c50-794e-45ff-808a-b8a6597c5136 tempest-VolumesServicesTestJSON-979531906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a613b89a-84a7-47ae-a7d6-a68106144544) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-304abab6-8d15-4e7c-a7da-0f92938553ba', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:40:25 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-c0be6c50-794e-45ff-808a-b8a6597c5136 tempest-VolumesServicesTestJSON-979531906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d953bfa-8d3d-4552-a29e-d37a21c9af31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:40:25 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-c0be6c50-794e-45ff-808a-b8a6597c5136 tempest-VolumesServicesTestJSON-979531906 None] Volume volume-304abab6-8d15-4e7c-a7da-0f92938553ba (304abab6-8d15-4e7c-a7da-0f92938553ba): created successfully Sep 04 22:40:25 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-c0be6c50-794e-45ff-808a-b8a6597c5136 tempest-VolumesServicesTestJSON-979531906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d953bfa-8d3d-4552-a29e-d37a21c9af31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:40:25 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-c0be6c50-794e-45ff-808a-b8a6597c5136 tempest-VolumesServicesTestJSON-979531906 None] Flow 'volume_create_manager' (741ece20-3793-491e-ab46-da2d47b80f65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:40:25 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-c0be6c50-794e-45ff-808a-b8a6597c5136 tempest-VolumesServicesTestJSON-979531906 None] Created volume successfully. Sep 04 22:40:25 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-60591dc4-8e74-42f3-9bcc-0ee9e1ae68ae tempest-VolumesServicesTestJSON-979531906 None] Acquiring lock "cinder-304abab6-8d15-4e7c-a7da-0f92938553ba-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:40:25 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-60591dc4-8e74-42f3-9bcc-0ee9e1ae68ae tempest-VolumesServicesTestJSON-979531906 None] Lock "cinder-304abab6-8d15-4e7c-a7da-0f92938553ba-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:40:25 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-60591dc4-8e74-42f3-9bcc-0ee9e1ae68ae tempest-VolumesServicesTestJSON-979531906 None] Acquiring lock "cinder-quobyte-304abab6-8d15-4e7c-a7da-0f92938553ba" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:40:25 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-60591dc4-8e74-42f3-9bcc-0ee9e1ae68ae tempest-VolumesServicesTestJSON-979531906 None] Lock "cinder-quobyte-304abab6-8d15-4e7c-a7da-0f92938553ba" acquired by "delete_volume" :: waited 0.017s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:40:25 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4e5337-5538-4ef0-9f2c-54c0346c7610]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:40:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-60591dc4-8e74-42f3-9bcc-0ee9e1ae68ae tempest-VolumesServicesTestJSON-979531906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-304abab6-8d15-4e7c-a7da-0f92938553ba {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:40:25 devstack sudo[90031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-304abab6-8d15-4e7c-a7da-0f92938553ba Sep 04 22:40:25 devstack sudo[90031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:40:26 devstack sudo[90031]: pam_unix(sudo:session): session closed for user root Sep 04 22:40:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-60591dc4-8e74-42f3-9bcc-0ee9e1ae68ae tempest-VolumesServicesTestJSON-979531906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-304abab6-8d15-4e7c-a7da-0f92938553ba" returned: 0 in 0.364s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:40:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-60591dc4-8e74-42f3-9bcc-0ee9e1ae68ae tempest-VolumesServicesTestJSON-979531906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-304abab6-8d15-4e7c-a7da-0f92938553ba {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:40:26 devstack sudo[90036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-304abab6-8d15-4e7c-a7da-0f92938553ba Sep 04 22:40:26 devstack sudo[90036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:40:26 devstack sudo[90036]: pam_unix(sudo:session): session closed for user root Sep 04 22:40:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-60591dc4-8e74-42f3-9bcc-0ee9e1ae68ae tempest-VolumesServicesTestJSON-979531906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-304abab6-8d15-4e7c-a7da-0f92938553ba" returned: 0 in 0.263s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:40:26 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-60591dc4-8e74-42f3-9bcc-0ee9e1ae68ae tempest-VolumesServicesTestJSON-979531906 None] Lock "cinder-quobyte-304abab6-8d15-4e7c-a7da-0f92938553ba" released by "delete_volume" :: held 0.706s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:40:26 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-60591dc4-8e74-42f3-9bcc-0ee9e1ae68ae tempest-VolumesServicesTestJSON-979531906 None] Created reservations ['a28477c4-b52a-4ecd-8b54-edc749dd440d', 'd5e0527b-56c3-4d00-8a57-4a480242bb9d', '171d24a4-f0be-4baa-bd5b-3a66d269ee13', '2ce21d7e-5414-4a7c-920b-c6caa8ccc69e'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:40:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-60591dc4-8e74-42f3-9bcc-0ee9e1ae68ae tempest-VolumesServicesTestJSON-979531906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:40:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-60591dc4-8e74-42f3-9bcc-0ee9e1ae68ae tempest-VolumesServicesTestJSON-979531906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:40:26 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-60591dc4-8e74-42f3-9bcc-0ee9e1ae68ae tempest-VolumesServicesTestJSON-979531906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:40:26 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-60591dc4-8e74-42f3-9bcc-0ee9e1ae68ae tempest-VolumesServicesTestJSON-979531906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:40:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-60591dc4-8e74-42f3-9bcc-0ee9e1ae68ae tempest-VolumesServicesTestJSON-979531906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:40:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-60591dc4-8e74-42f3-9bcc-0ee9e1ae68ae tempest-VolumesServicesTestJSON-979531906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:40:26 devstack sudo[90039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:40:26 devstack sudo[90039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:40:26 devstack sudo[90039]: pam_unix(sudo:session): session closed for user root Sep 04 22:40:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-60591dc4-8e74-42f3-9bcc-0ee9e1ae68ae tempest-VolumesServicesTestJSON-979531906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.260s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:40:26 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-60591dc4-8e74-42f3-9bcc-0ee9e1ae68ae tempest-VolumesServicesTestJSON-979531906 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:40:26 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-60591dc4-8e74-42f3-9bcc-0ee9e1ae68ae tempest-VolumesServicesTestJSON-979531906 None] Deleted volume successfully. Sep 04 22:40:26 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-60591dc4-8e74-42f3-9bcc-0ee9e1ae68ae tempest-VolumesServicesTestJSON-979531906 None] Lock "cinder-304abab6-8d15-4e7c-a7da-0f92938553ba-delete_volume" released by "delete_volume" :: held 1.207s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:40:32 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-94a7f63e-a4a8-41d9-a265-75521748d8b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:40:32 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-94a7f63e-a4a8-41d9-a265-75521748d8b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Flow 'volume_create_manager' (741f1049-ae00-4e7f-9eca-c91c19df347a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:40:32 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-94a7f63e-a4a8-41d9-a265-75521748d8b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (787d2519-afd8-4dd9-abed-770d0b8d63ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:40:32 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-94a7f63e-a4a8-41d9-a265-75521748d8b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (787d2519-afd8-4dd9-abed-770d0b8d63ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:40:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-47537236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd097d1f-85e6-4bf7-933d-804a4aa20678,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c736410c8a3467f8b28e4c85859bcd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:40:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:40:33Z,use_quota=True,user_id='65bab4d19ccd494da810b96831591dd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:40:32 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-94a7f63e-a4a8-41d9-a265-75521748d8b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebdb4fb7-4e5b-4f2e-92c4-f80245ebf200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:40:32 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-94a7f63e-a4a8-41d9-a265-75521748d8b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebdb4fb7-4e5b-4f2e-92c4-f80245ebf200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:40:32 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-94a7f63e-a4a8-41d9-a265-75521748d8b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8564e032-1c5a-41b7-9307-b226b35ed91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:40:32 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-94a7f63e-a4a8-41d9-a265-75521748d8b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8564e032-1c5a-41b7-9307-b226b35ed91d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd097d1f-85e6-4bf7-933d-804a4aa20678', 'volume_name': 'volume-bd097d1f-85e6-4bf7-933d-804a4aa20678', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:40:32 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-94a7f63e-a4a8-41d9-a265-75521748d8b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63c34cf6-38a9-4d63-a1e6-ff40e8d45d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:40:32 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-94a7f63e-a4a8-41d9-a265-75521748d8b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63c34cf6-38a9-4d63-a1e6-ff40e8d45d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:40:32 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-94a7f63e-a4a8-41d9-a265-75521748d8b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (222aff0b-80bd-4fcc-8035-8e64ed4c4960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:40:32 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-94a7f63e-a4a8-41d9-a265-75521748d8b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Volume bd097d1f-85e6-4bf7-933d-804a4aa20678: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd097d1f-85e6-4bf7-933d-804a4aa20678', 'volume_size': 1} Sep 04 22:40:32 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-94a7f63e-a4a8-41d9-a265-75521748d8b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:40:32 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-94a7f63e-a4a8-41d9-a265-75521748d8b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:40:32 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-94a7f63e-a4a8-41d9-a265-75521748d8b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:40:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-47537236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd097d1f-85e6-4bf7-933d-804a4aa20678,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c736410c8a3467f8b28e4c85859bcd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:40:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:40:33Z,use_quota=True,user_id='65bab4d19ccd494da810b96831591dd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:40:32 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-94a7f63e-a4a8-41d9-a265-75521748d8b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Creating volume bd097d1f-85e6-4bf7-933d-804a4aa20678 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:40:32 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-94a7f63e-a4a8-41d9-a265-75521748d8b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:40:32 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-94a7f63e-a4a8-41d9-a265-75521748d8b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:40:32 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-94a7f63e-a4a8-41d9-a265-75521748d8b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:40:32 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-94a7f63e-a4a8-41d9-a265-75521748d8b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:40:32 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-94a7f63e-a4a8-41d9-a265-75521748d8b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:40:32 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-94a7f63e-a4a8-41d9-a265-75521748d8b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:40:32 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-94a7f63e-a4a8-41d9-a265-75521748d8b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:40:32 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-94a7f63e-a4a8-41d9-a265-75521748d8b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bd097d1f-85e6-4bf7-933d-804a4aa20678 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:40:32 devstack sudo[90052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bd097d1f-85e6-4bf7-933d-804a4aa20678 1073741824 Sep 04 22:40:32 devstack sudo[90052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:40:33 devstack sudo[90052]: pam_unix(sudo:session): session closed for user root Sep 04 22:40:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-94a7f63e-a4a8-41d9-a265-75521748d8b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bd097d1f-85e6-4bf7-933d-804a4aa20678 1073741824" returned: 0 in 0.551s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:40:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-94a7f63e-a4a8-41d9-a265-75521748d8b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bd097d1f-85e6-4bf7-933d-804a4aa20678 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:40:33 devstack sudo[90058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bd097d1f-85e6-4bf7-933d-804a4aa20678 Sep 04 22:40:33 devstack sudo[90058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:40:33 devstack sudo[90058]: pam_unix(sudo:session): session closed for user root Sep 04 22:40:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-94a7f63e-a4a8-41d9-a265-75521748d8b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bd097d1f-85e6-4bf7-933d-804a4aa20678" returned: 0 in 0.308s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:40:33 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-94a7f63e-a4a8-41d9-a265-75521748d8b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:40:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-94a7f63e-a4a8-41d9-a265-75521748d8b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:40:33 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-94a7f63e-a4a8-41d9-a265-75521748d8b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (222aff0b-80bd-4fcc-8035-8e64ed4c4960) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd097d1f-85e6-4bf7-933d-804a4aa20678', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:40:33 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-94a7f63e-a4a8-41d9-a265-75521748d8b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a93951c0-d7ec-40e2-bd11-0a628f5e3428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:40:33 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-94a7f63e-a4a8-41d9-a265-75521748d8b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Volume volume-bd097d1f-85e6-4bf7-933d-804a4aa20678 (bd097d1f-85e6-4bf7-933d-804a4aa20678): created successfully Sep 04 22:40:33 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-94a7f63e-a4a8-41d9-a265-75521748d8b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a93951c0-d7ec-40e2-bd11-0a628f5e3428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:40:33 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-94a7f63e-a4a8-41d9-a265-75521748d8b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Flow 'volume_create_manager' (741f1049-ae00-4e7f-9eca-c91c19df347a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:40:33 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-94a7f63e-a4a8-41d9-a265-75521748d8b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Created volume successfully. Sep 04 22:40:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-a6edac22-e512-4cd2-ba4d-0f7f21f7abc4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:40:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-a6edac22-e512-4cd2-ba4d-0f7f21f7abc4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:40:35 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-a6edac22-e512-4cd2-ba4d-0f7f21f7abc4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Creating offline snapshot a77fb5fc-ad87-4152-af01-0fdf3cdefa70 of volume bd097d1f-85e6-4bf7-933d-804a4aa20678 {{(pid=87576) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 22:40:35 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85a3bd0-c582-4062-a06e-ee444e8c847f]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:40:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a6edac22-e512-4cd2-ba4d-0f7f21f7abc4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bd097d1f-85e6-4bf7-933d-804a4aa20678 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:40:35 devstack sudo[90122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bd097d1f-85e6-4bf7-933d-804a4aa20678 Sep 04 22:40:35 devstack sudo[90122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:40:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-27220809-48a2-4289-834a-1405a7122904 req-37913735-8cf9-4e3c-86a4-a405571f6969 tempest-TaggedAttachmentsTest-892373650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:40:35 devstack sudo[90122]: pam_unix(sudo:session): session closed for user root Sep 04 22:40:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a6edac22-e512-4cd2-ba4d-0f7f21f7abc4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bd097d1f-85e6-4bf7-933d-804a4aa20678" returned: 0 in 0.507s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:40:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a6edac22-e512-4cd2-ba4d-0f7f21f7abc4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bd097d1f-85e6-4bf7-933d-804a4aa20678,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bd097d1f-85e6-4bf7-933d-804a4aa20678.a77fb5fc-ad87-4152-af01-0fdf3cdefa70 1G {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:40:35 devstack sudo[90132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bd097d1f-85e6-4bf7-933d-804a4aa20678,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bd097d1f-85e6-4bf7-933d-804a4aa20678.a77fb5fc-ad87-4152-af01-0fdf3cdefa70 1G Sep 04 22:40:35 devstack sudo[90132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:40:36 devstack sudo[90132]: pam_unix(sudo:session): session closed for user root Sep 04 22:40:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a6edac22-e512-4cd2-ba4d-0f7f21f7abc4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bd097d1f-85e6-4bf7-933d-804a4aa20678,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bd097d1f-85e6-4bf7-933d-804a4aa20678.a77fb5fc-ad87-4152-af01-0fdf3cdefa70 1G" returned: 0 in 0.638s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:40:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a6edac22-e512-4cd2-ba4d-0f7f21f7abc4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd097d1f-85e6-4bf7-933d-804a4aa20678 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bd097d1f-85e6-4bf7-933d-804a4aa20678.a77fb5fc-ad87-4152-af01-0fdf3cdefa70 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:40:36 devstack sudo[90158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd097d1f-85e6-4bf7-933d-804a4aa20678 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bd097d1f-85e6-4bf7-933d-804a4aa20678.a77fb5fc-ad87-4152-af01-0fdf3cdefa70 Sep 04 22:40:36 devstack sudo[90158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:40:36 devstack sudo[90158]: pam_unix(sudo:session): session closed for user root Sep 04 22:40:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a6edac22-e512-4cd2-ba4d-0f7f21f7abc4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd097d1f-85e6-4bf7-933d-804a4aa20678 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bd097d1f-85e6-4bf7-933d-804a4aa20678.a77fb5fc-ad87-4152-af01-0fdf3cdefa70" returned: 0 in 0.385s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:40:36 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-a6edac22-e512-4cd2-ba4d-0f7f21f7abc4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bd097d1f-85e6-4bf7-933d-804a4aa20678.a77fb5fc-ad87-4152-af01-0fdf3cdefa70 is being set with open permissions: ugo+rw Sep 04 22:40:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a6edac22-e512-4cd2-ba4d-0f7f21f7abc4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bd097d1f-85e6-4bf7-933d-804a4aa20678.a77fb5fc-ad87-4152-af01-0fdf3cdefa70 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:40:36 devstack sudo[90166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bd097d1f-85e6-4bf7-933d-804a4aa20678.a77fb5fc-ad87-4152-af01-0fdf3cdefa70 Sep 04 22:40:36 devstack sudo[90166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:40:37 devstack sudo[90166]: pam_unix(sudo:session): session closed for user root Sep 04 22:40:37 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a6edac22-e512-4cd2-ba4d-0f7f21f7abc4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bd097d1f-85e6-4bf7-933d-804a4aa20678.a77fb5fc-ad87-4152-af01-0fdf3cdefa70" returned: 0 in 0.346s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:40:37 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a6edac22-e512-4cd2-ba4d-0f7f21f7abc4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bd097d1f-85e6-4bf7-933d-804a4aa20678.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:40:37 devstack sudo[90169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bd097d1f-85e6-4bf7-933d-804a4aa20678.info Sep 04 22:40:37 devstack sudo[90169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:40:37 devstack sudo[90169]: pam_unix(sudo:session): session closed for user root Sep 04 22:40:37 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a6edac22-e512-4cd2-ba4d-0f7f21f7abc4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bd097d1f-85e6-4bf7-933d-804a4aa20678.info" returned: 0 in 0.326s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:40:37 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-a6edac22-e512-4cd2-ba4d-0f7f21f7abc4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bd097d1f-85e6-4bf7-933d-804a4aa20678.info is being set with open permissions: ugo+rw Sep 04 22:40:37 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a6edac22-e512-4cd2-ba4d-0f7f21f7abc4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bd097d1f-85e6-4bf7-933d-804a4aa20678.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:40:37 devstack sudo[90172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bd097d1f-85e6-4bf7-933d-804a4aa20678.info Sep 04 22:40:37 devstack sudo[90172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:40:37 devstack sudo[90172]: pam_unix(sudo:session): session closed for user root Sep 04 22:40:37 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a6edac22-e512-4cd2-ba4d-0f7f21f7abc4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bd097d1f-85e6-4bf7-933d-804a4aa20678.info" returned: 0 in 0.304s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:40:37 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-a6edac22-e512-4cd2-ba4d-0f7f21f7abc4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.621s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:40:37 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-27220809-48a2-4289-834a-1405a7122904 req-37913735-8cf9-4e3c-86a4-a405571f6969 tempest-TaggedAttachmentsTest-892373650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.343s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:40:37 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-27220809-48a2-4289-834a-1405a7122904 req-37913735-8cf9-4e3c-86a4-a405571f6969 tempest-TaggedAttachmentsTest-892373650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:40:37 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-a6edac22-e512-4cd2-ba4d-0f7f21f7abc4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Create snapshot completed successfully Sep 04 22:40:37 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-27220809-48a2-4289-834a-1405a7122904 req-37913735-8cf9-4e3c-86a4-a405571f6969 tempest-TaggedAttachmentsTest-892373650 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4', 'name': 'volume-69b65448-6146-4077-9402-a0b6f4e0c6ce', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2d578167-e460-4063-9f4c-e808e0896014', 'enforce_multipath': True} {{(pid=87576) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 22:40:37 devstack cinder-volume[87576]: INFO cinder.volume.manager [req-27220809-48a2-4289-834a-1405a7122904 req-37913735-8cf9-4e3c-86a4-a405571f6969 tempest-TaggedAttachmentsTest-892373650 None] attachment_update completed successfully. Sep 04 22:40:39 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-67d30f19-2f78-4e75-a8ff-5a7098d6a29a tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Acquiring lock "cinder-a77fb5fc-ad87-4152-af01-0fdf3cdefa70-delete_snapshot" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:40:39 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-67d30f19-2f78-4e75-a8ff-5a7098d6a29a tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Lock "cinder-a77fb5fc-ad87-4152-af01-0fdf3cdefa70-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:40:39 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-67d30f19-2f78-4e75-a8ff-5a7098d6a29a tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Acquiring lock "cinder-quobyte-bd097d1f-85e6-4bf7-933d-804a4aa20678" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:40:39 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-67d30f19-2f78-4e75-a8ff-5a7098d6a29a tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Lock "cinder-quobyte-bd097d1f-85e6-4bf7-933d-804a4aa20678" acquired by "delete_snapshot" :: waited 0.065s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:40:39 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-67d30f19-2f78-4e75-a8ff-5a7098d6a29a tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Acquiring lock "cinder-quobyte-a77fb5fc-ad87-4152-af01-0fdf3cdefa70" by "_delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:40:39 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-67d30f19-2f78-4e75-a8ff-5a7098d6a29a tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Lock "cinder-quobyte-a77fb5fc-ad87-4152-af01-0fdf3cdefa70" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:40:39 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-67d30f19-2f78-4e75-a8ff-5a7098d6a29a tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Deleting offline snapshot a77fb5fc-ad87-4152-af01-0fdf3cdefa70 of volume bd097d1f-85e6-4bf7-933d-804a4aa20678 {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 22:40:39 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-67d30f19-2f78-4e75-a8ff-5a7098d6a29a tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] snapshot_file for this snap is: volume-bd097d1f-85e6-4bf7-933d-804a4aa20678.a77fb5fc-ad87-4152-af01-0fdf3cdefa70 {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 22:40:39 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[630a59af-c016-4f2b-a0a5-9e6972c3d884]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:40:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-67d30f19-2f78-4e75-a8ff-5a7098d6a29a tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bd097d1f-85e6-4bf7-933d-804a4aa20678.a77fb5fc-ad87-4152-af01-0fdf3cdefa70 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:40:39 devstack sudo[90560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bd097d1f-85e6-4bf7-933d-804a4aa20678.a77fb5fc-ad87-4152-af01-0fdf3cdefa70 Sep 04 22:40:39 devstack sudo[90560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:40:39 devstack sudo[90560]: pam_unix(sudo:session): session closed for user root Sep 04 22:40:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-67d30f19-2f78-4e75-a8ff-5a7098d6a29a tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bd097d1f-85e6-4bf7-933d-804a4aa20678.a77fb5fc-ad87-4152-af01-0fdf3cdefa70" returned: 0 in 0.555s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:40:39 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-67d30f19-2f78-4e75-a8ff-5a7098d6a29a tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd097d1f-85e6-4bf7-933d-804a4aa20678(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 22:40:39 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9479e1-702e-414b-9dc2-cdca35e82e32]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:40:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-67d30f19-2f78-4e75-a8ff-5a7098d6a29a tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bd097d1f-85e6-4bf7-933d-804a4aa20678 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:40:39 devstack sudo[90569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bd097d1f-85e6-4bf7-933d-804a4aa20678 Sep 04 22:40:39 devstack sudo[90569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:40:40 devstack sudo[90569]: pam_unix(sudo:session): session closed for user root Sep 04 22:40:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-67d30f19-2f78-4e75-a8ff-5a7098d6a29a tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bd097d1f-85e6-4bf7-933d-804a4aa20678" returned: 0 in 0.456s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:40:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-67d30f19-2f78-4e75-a8ff-5a7098d6a29a tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bd097d1f-85e6-4bf7-933d-804a4aa20678.a77fb5fc-ad87-4152-af01-0fdf3cdefa70 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:40:40 devstack sudo[90576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bd097d1f-85e6-4bf7-933d-804a4aa20678.a77fb5fc-ad87-4152-af01-0fdf3cdefa70 Sep 04 22:40:40 devstack sudo[90576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:40:40 devstack sudo[90576]: pam_unix(sudo:session): session closed for user root Sep 04 22:40:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-67d30f19-2f78-4e75-a8ff-5a7098d6a29a tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bd097d1f-85e6-4bf7-933d-804a4aa20678.a77fb5fc-ad87-4152-af01-0fdf3cdefa70" returned: 0 in 0.608s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:40:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-67d30f19-2f78-4e75-a8ff-5a7098d6a29a tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bd097d1f-85e6-4bf7-933d-804a4aa20678.a77fb5fc-ad87-4152-af01-0fdf3cdefa70 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:40:40 devstack sudo[90586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bd097d1f-85e6-4bf7-933d-804a4aa20678.a77fb5fc-ad87-4152-af01-0fdf3cdefa70 Sep 04 22:40:40 devstack sudo[90586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:40:41 devstack sudo[90586]: pam_unix(sudo:session): session closed for user root Sep 04 22:40:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-67d30f19-2f78-4e75-a8ff-5a7098d6a29a tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bd097d1f-85e6-4bf7-933d-804a4aa20678.a77fb5fc-ad87-4152-af01-0fdf3cdefa70" returned: 0 in 0.317s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:40:41 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-67d30f19-2f78-4e75-a8ff-5a7098d6a29a tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Lock "cinder-quobyte-a77fb5fc-ad87-4152-af01-0fdf3cdefa70" released by "_delete_snapshot" :: held 2.159s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:40:41 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-67d30f19-2f78-4e75-a8ff-5a7098d6a29a tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Lock "cinder-quobyte-bd097d1f-85e6-4bf7-933d-804a4aa20678" released by "delete_snapshot" :: held 2.208s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:40:41 devstack cinder-volume[87576]: INFO cinder.volume.manager [req-702c2c1e-eb00-4c0c-858d-79a3a3aaaf55 req-5b0cfe94-f416-4c7a-b1a4-626e1b34434c tempest-TaggedAttachmentsTest-892373650 None] Terminate volume connection completed successfully. Sep 04 22:40:41 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-702c2c1e-eb00-4c0c-858d-79a3a3aaaf55 req-5b0cfe94-f416-4c7a-b1a4-626e1b34434c tempest-TaggedAttachmentsTest-892373650 None] Deleting attachment 2d578167-e460-4063-9f4c-e808e0896014. {{(pid=87576) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 22:40:41 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-67d30f19-2f78-4e75-a8ff-5a7098d6a29a tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Created reservations ['9bbd2b98-007c-412f-909e-e197c6ccd8dc', '8f441a56-47ec-416a-ab09-50ef8b94e755', '40f20dd9-e193-4d68-a435-ddab9f7cf69b', 'e43aa4ea-759b-459e-bcbe-0b011aac63fb'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:40:41 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-67d30f19-2f78-4e75-a8ff-5a7098d6a29a tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Delete snapshot completed successfully. Sep 04 22:40:41 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-67d30f19-2f78-4e75-a8ff-5a7098d6a29a tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Lock "cinder-a77fb5fc-ad87-4152-af01-0fdf3cdefa70-delete_snapshot" released by "delete_snapshot" :: held 2.494s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:40:41 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-9b627943-eb73-44bd-b546-812b3e8d0ec2 tempest-AttachVolumeShelveTestJSON-1171912429 None] Acquiring lock "cinder-58237ec8-e6c7-43ae-a06f-11bad28ef6d8-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:40:41 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-9b627943-eb73-44bd-b546-812b3e8d0ec2 tempest-AttachVolumeShelveTestJSON-1171912429 None] Lock "cinder-58237ec8-e6c7-43ae-a06f-11bad28ef6d8-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:40:41 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-9b627943-eb73-44bd-b546-812b3e8d0ec2 tempest-AttachVolumeShelveTestJSON-1171912429 None] Acquiring lock "cinder-quobyte-58237ec8-e6c7-43ae-a06f-11bad28ef6d8" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:40:41 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-9b627943-eb73-44bd-b546-812b3e8d0ec2 tempest-AttachVolumeShelveTestJSON-1171912429 None] Lock "cinder-quobyte-58237ec8-e6c7-43ae-a06f-11bad28ef6d8" acquired by "delete_volume" :: waited 0.018s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:40:41 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef6012c-263a-4d38-81fa-e5854fb8f30f]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:40:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-9b627943-eb73-44bd-b546-812b3e8d0ec2 tempest-AttachVolumeShelveTestJSON-1171912429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-58237ec8-e6c7-43ae-a06f-11bad28ef6d8 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:40:41 devstack sudo[90616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-58237ec8-e6c7-43ae-a06f-11bad28ef6d8 Sep 04 22:40:41 devstack sudo[90616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:40:42 devstack sudo[90616]: pam_unix(sudo:session): session closed for user root Sep 04 22:40:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-9b627943-eb73-44bd-b546-812b3e8d0ec2 tempest-AttachVolumeShelveTestJSON-1171912429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-58237ec8-e6c7-43ae-a06f-11bad28ef6d8" returned: 0 in 0.526s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:40:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-9b627943-eb73-44bd-b546-812b3e8d0ec2 tempest-AttachVolumeShelveTestJSON-1171912429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-58237ec8-e6c7-43ae-a06f-11bad28ef6d8 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:40:42 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-2f41eaa1-fe7b-45a3-8ca0-a8e624d305bf tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Acquiring lock "cinder-bd097d1f-85e6-4bf7-933d-804a4aa20678-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:40:42 devstack sudo[90623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-58237ec8-e6c7-43ae-a06f-11bad28ef6d8 Sep 04 22:40:42 devstack sudo[90623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:40:42 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-2f41eaa1-fe7b-45a3-8ca0-a8e624d305bf tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Lock "cinder-bd097d1f-85e6-4bf7-933d-804a4aa20678-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:40:42 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-2f41eaa1-fe7b-45a3-8ca0-a8e624d305bf tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Acquiring lock "cinder-quobyte-bd097d1f-85e6-4bf7-933d-804a4aa20678" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:40:42 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-2f41eaa1-fe7b-45a3-8ca0-a8e624d305bf tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Lock "cinder-quobyte-bd097d1f-85e6-4bf7-933d-804a4aa20678" acquired by "delete_volume" :: waited 0.023s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:40:42 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a1a36e1-7edf-47bc-ad15-685ca1840bb3]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:40:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2f41eaa1-fe7b-45a3-8ca0-a8e624d305bf tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bd097d1f-85e6-4bf7-933d-804a4aa20678 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:40:42 devstack sudo[90623]: pam_unix(sudo:session): session closed for user root Sep 04 22:40:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-9b627943-eb73-44bd-b546-812b3e8d0ec2 tempest-AttachVolumeShelveTestJSON-1171912429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-58237ec8-e6c7-43ae-a06f-11bad28ef6d8" returned: 0 in 0.458s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:40:42 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-9b627943-eb73-44bd-b546-812b3e8d0ec2 tempest-AttachVolumeShelveTestJSON-1171912429 None] Lock "cinder-quobyte-58237ec8-e6c7-43ae-a06f-11bad28ef6d8" released by "delete_volume" :: held 1.047s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:40:42 devstack sudo[90638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bd097d1f-85e6-4bf7-933d-804a4aa20678 Sep 04 22:40:42 devstack sudo[90638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:40:42 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-9b627943-eb73-44bd-b546-812b3e8d0ec2 tempest-AttachVolumeShelveTestJSON-1171912429 None] Created reservations ['c5f97c85-dfeb-4031-88fa-c636b1ac8b13', 'd3667f3a-220d-4997-93a4-9f14058261e4', '3577c13c-9842-4df3-94c4-31fc6084245d', 'af7c68d8-3525-48a4-a08c-7f532171f891'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:40:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-9b627943-eb73-44bd-b546-812b3e8d0ec2 tempest-AttachVolumeShelveTestJSON-1171912429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:40:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-9b627943-eb73-44bd-b546-812b3e8d0ec2 tempest-AttachVolumeShelveTestJSON-1171912429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:40:42 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-9b627943-eb73-44bd-b546-812b3e8d0ec2 tempest-AttachVolumeShelveTestJSON-1171912429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:40:42 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-9b627943-eb73-44bd-b546-812b3e8d0ec2 tempest-AttachVolumeShelveTestJSON-1171912429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:40:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-9b627943-eb73-44bd-b546-812b3e8d0ec2 tempest-AttachVolumeShelveTestJSON-1171912429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:40:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-9b627943-eb73-44bd-b546-812b3e8d0ec2 tempest-AttachVolumeShelveTestJSON-1171912429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:40:43 devstack sudo[90644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:40:43 devstack sudo[90644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:40:43 devstack sudo[90638]: pam_unix(sudo:session): session closed for user root Sep 04 22:40:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2f41eaa1-fe7b-45a3-8ca0-a8e624d305bf tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bd097d1f-85e6-4bf7-933d-804a4aa20678" returned: 0 in 0.468s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:40:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2f41eaa1-fe7b-45a3-8ca0-a8e624d305bf tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bd097d1f-85e6-4bf7-933d-804a4aa20678 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:40:43 devstack sudo[90651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bd097d1f-85e6-4bf7-933d-804a4aa20678 Sep 04 22:40:43 devstack sudo[90651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:40:43 devstack sudo[90644]: pam_unix(sudo:session): session closed for user root Sep 04 22:40:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-9b627943-eb73-44bd-b546-812b3e8d0ec2 tempest-AttachVolumeShelveTestJSON-1171912429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.346s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:40:43 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-9b627943-eb73-44bd-b546-812b3e8d0ec2 tempest-AttachVolumeShelveTestJSON-1171912429 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:40:43 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-9b627943-eb73-44bd-b546-812b3e8d0ec2 tempest-AttachVolumeShelveTestJSON-1171912429 None] Deleted volume successfully. Sep 04 22:40:43 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-9b627943-eb73-44bd-b546-812b3e8d0ec2 tempest-AttachVolumeShelveTestJSON-1171912429 None] Lock "cinder-58237ec8-e6c7-43ae-a06f-11bad28ef6d8-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:40:43 devstack sudo[90651]: pam_unix(sudo:session): session closed for user root Sep 04 22:40:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2f41eaa1-fe7b-45a3-8ca0-a8e624d305bf tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bd097d1f-85e6-4bf7-933d-804a4aa20678" returned: 0 in 0.346s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:40:43 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-2f41eaa1-fe7b-45a3-8ca0-a8e624d305bf tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Lock "cinder-quobyte-bd097d1f-85e6-4bf7-933d-804a4aa20678" released by "delete_volume" :: held 0.941s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:40:43 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-2f41eaa1-fe7b-45a3-8ca0-a8e624d305bf tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Created reservations ['44347737-6003-41d2-8abd-eea1e7546ff5', 'e543e50f-2ce4-4145-805c-47af523673b8', 'b6ce0e48-3107-4600-ac01-d2650e1d0bad', '94c981ef-5e76-4bec-a44a-c0b46f7454ec'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:40:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-2f41eaa1-fe7b-45a3-8ca0-a8e624d305bf tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:40:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-2f41eaa1-fe7b-45a3-8ca0-a8e624d305bf tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:40:43 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-2f41eaa1-fe7b-45a3-8ca0-a8e624d305bf tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:40:43 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-2f41eaa1-fe7b-45a3-8ca0-a8e624d305bf tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:40:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-2f41eaa1-fe7b-45a3-8ca0-a8e624d305bf tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:40:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2f41eaa1-fe7b-45a3-8ca0-a8e624d305bf tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:40:43 devstack sudo[90656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:40:43 devstack sudo[90656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:40:43 devstack sudo[90656]: pam_unix(sudo:session): session closed for user root Sep 04 22:40:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2f41eaa1-fe7b-45a3-8ca0-a8e624d305bf tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.301s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:40:43 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-2f41eaa1-fe7b-45a3-8ca0-a8e624d305bf tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:40:43 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-2f41eaa1-fe7b-45a3-8ca0-a8e624d305bf tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Deleted volume successfully. Sep 04 22:40:44 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-2f41eaa1-fe7b-45a3-8ca0-a8e624d305bf tempest-VolumeSnapshotQuotasNegativeTestJSON-1867184738 None] Lock "cinder-bd097d1f-85e6-4bf7-933d-804a4aa20678-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:40:53 devstack cinder-volume[87576]: DEBUG dbcounter [-] [87576] Writing DB stats cinder:UPDATE=74,cinder:SELECT=54,cinder:INSERT=13,cinder:DELETE=6 {{(pid=87576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 22:40:54 devstack cinder-volume[87576]: DEBUG dbcounter [-] [87576] Writing DB stats cinder:SELECT=60,cinder:INSERT=21,cinder:UPDATE=69,cinder:DELETE=6 {{(pid=87576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 22:40:56 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [req-aa8d7b1e-bb43-46c5-85fd-18e9672125ae req-7bdae210-17ce-4ea0-bea5-d46af2f80a43 tempest-VolumesGetTestJSON-515242515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:40:56 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-aa8d7b1e-bb43-46c5-85fd-18e9672125ae req-7bdae210-17ce-4ea0-bea5-d46af2f80a43 tempest-VolumesGetTestJSON-515242515 None] Flow 'volume_create_manager' (ac02acbb-8ccd-497b-b423-ae6b29f5d5a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:40:56 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-aa8d7b1e-bb43-46c5-85fd-18e9672125ae req-7bdae210-17ce-4ea0-bea5-d46af2f80a43 tempest-VolumesGetTestJSON-515242515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0457ee7-4a96-456b-8aed-ee541320780a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:40:56 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-aa8d7b1e-bb43-46c5-85fd-18e9672125ae req-7bdae210-17ce-4ea0-bea5-d46af2f80a43 tempest-VolumesGetTestJSON-515242515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0457ee7-4a96-456b-8aed-ee541320780a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:40:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1675114090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=388618a3-991c-4395-8483-15dd4a9a4405,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b19324f2da7547e1a5694c29e51bcd29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:40:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:40:57Z,use_quota=True,user_id='367851eae4c14b549dbee3b7625af91b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:40:56 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-aa8d7b1e-bb43-46c5-85fd-18e9672125ae req-7bdae210-17ce-4ea0-bea5-d46af2f80a43 tempest-VolumesGetTestJSON-515242515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b59c9477-156c-4029-920f-d80311854a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:40:56 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-aa8d7b1e-bb43-46c5-85fd-18e9672125ae req-7bdae210-17ce-4ea0-bea5-d46af2f80a43 tempest-VolumesGetTestJSON-515242515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b59c9477-156c-4029-920f-d80311854a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:40:56 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-aa8d7b1e-bb43-46c5-85fd-18e9672125ae req-7bdae210-17ce-4ea0-bea5-d46af2f80a43 tempest-VolumesGetTestJSON-515242515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5195e292-6882-46b5-84aa-28ab47f03ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:40:56 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-aa8d7b1e-bb43-46c5-85fd-18e9672125ae req-7bdae210-17ce-4ea0-bea5-d46af2f80a43 tempest-VolumesGetTestJSON-515242515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5195e292-6882-46b5-84aa-28ab47f03ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '388618a3-991c-4395-8483-15dd4a9a4405', 'volume_name': 'volume-388618a3-991c-4395-8483-15dd4a9a4405', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:40:56 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-aa8d7b1e-bb43-46c5-85fd-18e9672125ae req-7bdae210-17ce-4ea0-bea5-d46af2f80a43 tempest-VolumesGetTestJSON-515242515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d7148c7-058e-4233-9c9e-ef1bf9f22766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:40:56 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-aa8d7b1e-bb43-46c5-85fd-18e9672125ae req-7bdae210-17ce-4ea0-bea5-d46af2f80a43 tempest-VolumesGetTestJSON-515242515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d7148c7-058e-4233-9c9e-ef1bf9f22766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:40:56 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-aa8d7b1e-bb43-46c5-85fd-18e9672125ae req-7bdae210-17ce-4ea0-bea5-d46af2f80a43 tempest-VolumesGetTestJSON-515242515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b466be2b-b72e-4ab7-90c0-5dfd47c96bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:40:56 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [req-aa8d7b1e-bb43-46c5-85fd-18e9672125ae req-7bdae210-17ce-4ea0-bea5-d46af2f80a43 tempest-VolumesGetTestJSON-515242515 None] Volume 388618a3-991c-4395-8483-15dd4a9a4405: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-388618a3-991c-4395-8483-15dd4a9a4405', 'volume_size': 1} Sep 04 22:40:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-aa8d7b1e-bb43-46c5-85fd-18e9672125ae req-7bdae210-17ce-4ea0-bea5-d46af2f80a43 tempest-VolumesGetTestJSON-515242515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:40:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-aa8d7b1e-bb43-46c5-85fd-18e9672125ae req-7bdae210-17ce-4ea0-bea5-d46af2f80a43 tempest-VolumesGetTestJSON-515242515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:40:56 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [req-aa8d7b1e-bb43-46c5-85fd-18e9672125ae req-7bdae210-17ce-4ea0-bea5-d46af2f80a43 tempest-VolumesGetTestJSON-515242515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:40:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1675114090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=388618a3-991c-4395-8483-15dd4a9a4405,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b19324f2da7547e1a5694c29e51bcd29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:40:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:40:57Z,use_quota=True,user_id='367851eae4c14b549dbee3b7625af91b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:40:56 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [req-aa8d7b1e-bb43-46c5-85fd-18e9672125ae req-7bdae210-17ce-4ea0-bea5-d46af2f80a43 tempest-VolumesGetTestJSON-515242515 None] Creating volume 388618a3-991c-4395-8483-15dd4a9a4405 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:40:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-aa8d7b1e-bb43-46c5-85fd-18e9672125ae req-7bdae210-17ce-4ea0-bea5-d46af2f80a43 tempest-VolumesGetTestJSON-515242515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:40:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-aa8d7b1e-bb43-46c5-85fd-18e9672125ae req-7bdae210-17ce-4ea0-bea5-d46af2f80a43 tempest-VolumesGetTestJSON-515242515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:40:56 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [req-aa8d7b1e-bb43-46c5-85fd-18e9672125ae req-7bdae210-17ce-4ea0-bea5-d46af2f80a43 tempest-VolumesGetTestJSON-515242515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:40:56 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [req-aa8d7b1e-bb43-46c5-85fd-18e9672125ae req-7bdae210-17ce-4ea0-bea5-d46af2f80a43 tempest-VolumesGetTestJSON-515242515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:40:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-aa8d7b1e-bb43-46c5-85fd-18e9672125ae req-7bdae210-17ce-4ea0-bea5-d46af2f80a43 tempest-VolumesGetTestJSON-515242515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:40:56 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [req-aa8d7b1e-bb43-46c5-85fd-18e9672125ae req-7bdae210-17ce-4ea0-bea5-d46af2f80a43 tempest-VolumesGetTestJSON-515242515 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:40:56 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [req-aa8d7b1e-bb43-46c5-85fd-18e9672125ae req-7bdae210-17ce-4ea0-bea5-d46af2f80a43 tempest-VolumesGetTestJSON-515242515 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:40:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [req-aa8d7b1e-bb43-46c5-85fd-18e9672125ae req-7bdae210-17ce-4ea0-bea5-d46af2f80a43 tempest-VolumesGetTestJSON-515242515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-388618a3-991c-4395-8483-15dd4a9a4405 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:40:56 devstack sudo[90711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-388618a3-991c-4395-8483-15dd4a9a4405 1073741824 Sep 04 22:40:56 devstack sudo[90711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:40:57 devstack sudo[90711]: pam_unix(sudo:session): session closed for user root Sep 04 22:40:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [req-aa8d7b1e-bb43-46c5-85fd-18e9672125ae req-7bdae210-17ce-4ea0-bea5-d46af2f80a43 tempest-VolumesGetTestJSON-515242515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-388618a3-991c-4395-8483-15dd4a9a4405 1073741824" returned: 0 in 0.530s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:40:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [req-aa8d7b1e-bb43-46c5-85fd-18e9672125ae req-7bdae210-17ce-4ea0-bea5-d46af2f80a43 tempest-VolumesGetTestJSON-515242515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-388618a3-991c-4395-8483-15dd4a9a4405 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:40:57 devstack sudo[90717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-388618a3-991c-4395-8483-15dd4a9a4405 Sep 04 22:40:57 devstack sudo[90717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:40:57 devstack sudo[90717]: pam_unix(sudo:session): session closed for user root Sep 04 22:40:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [req-aa8d7b1e-bb43-46c5-85fd-18e9672125ae req-7bdae210-17ce-4ea0-bea5-d46af2f80a43 tempest-VolumesGetTestJSON-515242515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-388618a3-991c-4395-8483-15dd4a9a4405" returned: 0 in 0.289s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:40:57 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [req-aa8d7b1e-bb43-46c5-85fd-18e9672125ae req-7bdae210-17ce-4ea0-bea5-d46af2f80a43 tempest-VolumesGetTestJSON-515242515 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:40:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-aa8d7b1e-bb43-46c5-85fd-18e9672125ae req-7bdae210-17ce-4ea0-bea5-d46af2f80a43 tempest-VolumesGetTestJSON-515242515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:40:57 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-aa8d7b1e-bb43-46c5-85fd-18e9672125ae req-7bdae210-17ce-4ea0-bea5-d46af2f80a43 tempest-VolumesGetTestJSON-515242515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b466be2b-b72e-4ab7-90c0-5dfd47c96bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-388618a3-991c-4395-8483-15dd4a9a4405', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:40:57 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-aa8d7b1e-bb43-46c5-85fd-18e9672125ae req-7bdae210-17ce-4ea0-bea5-d46af2f80a43 tempest-VolumesGetTestJSON-515242515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1b3f945-cf70-4c24-a27a-89e25d818057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:40:57 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [req-aa8d7b1e-bb43-46c5-85fd-18e9672125ae req-7bdae210-17ce-4ea0-bea5-d46af2f80a43 tempest-VolumesGetTestJSON-515242515 None] Volume volume-388618a3-991c-4395-8483-15dd4a9a4405 (388618a3-991c-4395-8483-15dd4a9a4405): created successfully Sep 04 22:40:57 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-aa8d7b1e-bb43-46c5-85fd-18e9672125ae req-7bdae210-17ce-4ea0-bea5-d46af2f80a43 tempest-VolumesGetTestJSON-515242515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1b3f945-cf70-4c24-a27a-89e25d818057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:40:57 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-aa8d7b1e-bb43-46c5-85fd-18e9672125ae req-7bdae210-17ce-4ea0-bea5-d46af2f80a43 tempest-VolumesGetTestJSON-515242515 None] Flow 'volume_create_manager' (ac02acbb-8ccd-497b-b423-ae6b29f5d5a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:40:57 devstack cinder-volume[87576]: INFO cinder.volume.manager [req-aa8d7b1e-bb43-46c5-85fd-18e9672125ae req-7bdae210-17ce-4ea0-bea5-d46af2f80a43 tempest-VolumesGetTestJSON-515242515 None] Created volume successfully. Sep 04 22:40:58 devstack cinder-volume[87576]: DEBUG cinder.coordination [req-7d63fbc2-e8ed-46cf-8ae7-e512712e784b req-e2542fb6-0139-467a-bd95-05546875fd9d tempest-VolumesGetTestJSON-515242515 None] Acquiring lock "cinder-388618a3-991c-4395-8483-15dd4a9a4405-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:40:58 devstack cinder-volume[87576]: DEBUG cinder.coordination [req-7d63fbc2-e8ed-46cf-8ae7-e512712e784b req-e2542fb6-0139-467a-bd95-05546875fd9d tempest-VolumesGetTestJSON-515242515 None] Lock "cinder-388618a3-991c-4395-8483-15dd4a9a4405-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:40:58 devstack cinder-volume[87576]: DEBUG cinder.coordination [req-7d63fbc2-e8ed-46cf-8ae7-e512712e784b req-e2542fb6-0139-467a-bd95-05546875fd9d tempest-VolumesGetTestJSON-515242515 None] Acquiring lock "cinder-quobyte-388618a3-991c-4395-8483-15dd4a9a4405" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:40:58 devstack cinder-volume[87576]: DEBUG cinder.coordination [req-7d63fbc2-e8ed-46cf-8ae7-e512712e784b req-e2542fb6-0139-467a-bd95-05546875fd9d tempest-VolumesGetTestJSON-515242515 None] Lock "cinder-quobyte-388618a3-991c-4395-8483-15dd4a9a4405" acquired by "delete_volume" :: waited 0.036s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:40:58 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[be87d779-daf2-4822-8b2c-7204d7736509]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:40:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [req-7d63fbc2-e8ed-46cf-8ae7-e512712e784b req-e2542fb6-0139-467a-bd95-05546875fd9d tempest-VolumesGetTestJSON-515242515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-388618a3-991c-4395-8483-15dd4a9a4405 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:40:58 devstack sudo[90723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-388618a3-991c-4395-8483-15dd4a9a4405 Sep 04 22:40:58 devstack sudo[90723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:40:59 devstack sudo[90723]: pam_unix(sudo:session): session closed for user root Sep 04 22:40:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [req-7d63fbc2-e8ed-46cf-8ae7-e512712e784b req-e2542fb6-0139-467a-bd95-05546875fd9d tempest-VolumesGetTestJSON-515242515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-388618a3-991c-4395-8483-15dd4a9a4405" returned: 0 in 0.542s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:40:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [req-7d63fbc2-e8ed-46cf-8ae7-e512712e784b req-e2542fb6-0139-467a-bd95-05546875fd9d tempest-VolumesGetTestJSON-515242515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-388618a3-991c-4395-8483-15dd4a9a4405 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:40:59 devstack sudo[90730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-388618a3-991c-4395-8483-15dd4a9a4405 Sep 04 22:40:59 devstack sudo[90730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:40:59 devstack sudo[90730]: pam_unix(sudo:session): session closed for user root Sep 04 22:40:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [req-7d63fbc2-e8ed-46cf-8ae7-e512712e784b req-e2542fb6-0139-467a-bd95-05546875fd9d tempest-VolumesGetTestJSON-515242515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-388618a3-991c-4395-8483-15dd4a9a4405" returned: 0 in 0.354s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:40:59 devstack cinder-volume[87576]: DEBUG cinder.coordination [req-7d63fbc2-e8ed-46cf-8ae7-e512712e784b req-e2542fb6-0139-467a-bd95-05546875fd9d tempest-VolumesGetTestJSON-515242515 None] Lock "cinder-quobyte-388618a3-991c-4395-8483-15dd4a9a4405" released by "delete_volume" :: held 0.967s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:40:59 devstack cinder-volume[87576]: DEBUG cinder.quota [req-7d63fbc2-e8ed-46cf-8ae7-e512712e784b req-e2542fb6-0139-467a-bd95-05546875fd9d tempest-VolumesGetTestJSON-515242515 None] Created reservations ['b3765d6b-cccd-427d-b023-3f30bccc8335', '0ae48b30-99e9-4d36-b590-a1b9c5d4f156', '7ed1b775-f376-4951-9e21-aae79e5d4d9d', '33f0e3a9-2d81-4ea5-8c82-abb5aa3e3f53'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:40:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-7d63fbc2-e8ed-46cf-8ae7-e512712e784b req-e2542fb6-0139-467a-bd95-05546875fd9d tempest-VolumesGetTestJSON-515242515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:40:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-7d63fbc2-e8ed-46cf-8ae7-e512712e784b req-e2542fb6-0139-467a-bd95-05546875fd9d tempest-VolumesGetTestJSON-515242515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:40:59 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [req-7d63fbc2-e8ed-46cf-8ae7-e512712e784b req-e2542fb6-0139-467a-bd95-05546875fd9d tempest-VolumesGetTestJSON-515242515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:40:59 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [req-7d63fbc2-e8ed-46cf-8ae7-e512712e784b req-e2542fb6-0139-467a-bd95-05546875fd9d tempest-VolumesGetTestJSON-515242515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:40:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-7d63fbc2-e8ed-46cf-8ae7-e512712e784b req-e2542fb6-0139-467a-bd95-05546875fd9d tempest-VolumesGetTestJSON-515242515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:40:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [req-7d63fbc2-e8ed-46cf-8ae7-e512712e784b req-e2542fb6-0139-467a-bd95-05546875fd9d tempest-VolumesGetTestJSON-515242515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:40:59 devstack sudo[90734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:40:59 devstack sudo[90734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:41:00 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-b37dcec9-961d-4760-87bd-eea3e9ea61db tempest-TaggedAttachmentsTest-892373650 None] Acquiring lock "cinder-69b65448-6146-4077-9402-a0b6f4e0c6ce-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:41:00 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-b37dcec9-961d-4760-87bd-eea3e9ea61db tempest-TaggedAttachmentsTest-892373650 None] Lock "cinder-69b65448-6146-4077-9402-a0b6f4e0c6ce-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:41:00 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-b37dcec9-961d-4760-87bd-eea3e9ea61db tempest-TaggedAttachmentsTest-892373650 None] Acquiring lock "cinder-quobyte-69b65448-6146-4077-9402-a0b6f4e0c6ce" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:41:00 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-b37dcec9-961d-4760-87bd-eea3e9ea61db tempest-TaggedAttachmentsTest-892373650 None] Lock "cinder-quobyte-69b65448-6146-4077-9402-a0b6f4e0c6ce" acquired by "delete_volume" :: waited 0.027s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:41:00 devstack sudo[90734]: pam_unix(sudo:session): session closed for user root Sep 04 22:41:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [req-7d63fbc2-e8ed-46cf-8ae7-e512712e784b req-e2542fb6-0139-467a-bd95-05546875fd9d tempest-VolumesGetTestJSON-515242515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.476s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:41:00 devstack cinder-volume[87576]: DEBUG cinder.manager [req-7d63fbc2-e8ed-46cf-8ae7-e512712e784b req-e2542fb6-0139-467a-bd95-05546875fd9d tempest-VolumesGetTestJSON-515242515 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:41:00 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea955da3-5768-4599-b48d-53f9ceb987b2]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:41:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b37dcec9-961d-4760-87bd-eea3e9ea61db tempest-TaggedAttachmentsTest-892373650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-69b65448-6146-4077-9402-a0b6f4e0c6ce {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:41:00 devstack cinder-volume[87576]: INFO cinder.volume.manager [req-7d63fbc2-e8ed-46cf-8ae7-e512712e784b req-e2542fb6-0139-467a-bd95-05546875fd9d tempest-VolumesGetTestJSON-515242515 None] Deleted volume successfully. Sep 04 22:41:00 devstack cinder-volume[87576]: DEBUG cinder.coordination [req-7d63fbc2-e8ed-46cf-8ae7-e512712e784b req-e2542fb6-0139-467a-bd95-05546875fd9d tempest-VolumesGetTestJSON-515242515 None] Lock "cinder-388618a3-991c-4395-8483-15dd4a9a4405-delete_volume" released by "delete_volume" :: held 1.937s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:41:00 devstack sudo[90738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-69b65448-6146-4077-9402-a0b6f4e0c6ce Sep 04 22:41:00 devstack sudo[90738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:41:00 devstack sudo[90738]: pam_unix(sudo:session): session closed for user root Sep 04 22:41:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b37dcec9-961d-4760-87bd-eea3e9ea61db tempest-TaggedAttachmentsTest-892373650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-69b65448-6146-4077-9402-a0b6f4e0c6ce" returned: 0 in 0.481s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:41:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b37dcec9-961d-4760-87bd-eea3e9ea61db tempest-TaggedAttachmentsTest-892373650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-69b65448-6146-4077-9402-a0b6f4e0c6ce {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:41:00 devstack sudo[90754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-69b65448-6146-4077-9402-a0b6f4e0c6ce Sep 04 22:41:00 devstack sudo[90754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:41:01 devstack sudo[90754]: pam_unix(sudo:session): session closed for user root Sep 04 22:41:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b37dcec9-961d-4760-87bd-eea3e9ea61db tempest-TaggedAttachmentsTest-892373650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-69b65448-6146-4077-9402-a0b6f4e0c6ce" returned: 0 in 0.312s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:41:01 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-b37dcec9-961d-4760-87bd-eea3e9ea61db tempest-TaggedAttachmentsTest-892373650 None] Lock "cinder-quobyte-69b65448-6146-4077-9402-a0b6f4e0c6ce" released by "delete_volume" :: held 0.882s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:41:01 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-b37dcec9-961d-4760-87bd-eea3e9ea61db tempest-TaggedAttachmentsTest-892373650 None] Created reservations ['c359e8a6-3041-4301-9e22-37dd3aec75da', '933836d3-f233-4fec-9f99-8105ededca43', '986b2189-c8be-4bb3-ba9b-f7f8fb9fd8f8', 'adb9f8be-60c2-4e4b-9f73-de110fad63b6'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:41:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-b37dcec9-961d-4760-87bd-eea3e9ea61db tempest-TaggedAttachmentsTest-892373650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:41:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-b37dcec9-961d-4760-87bd-eea3e9ea61db tempest-TaggedAttachmentsTest-892373650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:41:01 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-b37dcec9-961d-4760-87bd-eea3e9ea61db tempest-TaggedAttachmentsTest-892373650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:41:01 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-b37dcec9-961d-4760-87bd-eea3e9ea61db tempest-TaggedAttachmentsTest-892373650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:41:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-b37dcec9-961d-4760-87bd-eea3e9ea61db tempest-TaggedAttachmentsTest-892373650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:41:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b37dcec9-961d-4760-87bd-eea3e9ea61db tempest-TaggedAttachmentsTest-892373650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:41:01 devstack sudo[90762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:41:01 devstack sudo[90762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:41:01 devstack sudo[90762]: pam_unix(sudo:session): session closed for user root Sep 04 22:41:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b37dcec9-961d-4760-87bd-eea3e9ea61db tempest-TaggedAttachmentsTest-892373650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.339s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:41:01 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-b37dcec9-961d-4760-87bd-eea3e9ea61db tempest-TaggedAttachmentsTest-892373650 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:41:01 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-b37dcec9-961d-4760-87bd-eea3e9ea61db tempest-TaggedAttachmentsTest-892373650 None] Deleted volume successfully. Sep 04 22:41:01 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-b37dcec9-961d-4760-87bd-eea3e9ea61db tempest-TaggedAttachmentsTest-892373650 None] Lock "cinder-69b65448-6146-4077-9402-a0b6f4e0c6ce-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:41:03 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c945312-989e-405c-b521-eac110a0298f tempest-SnapshotMetadataTestJSON-471375127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:41:03 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3c945312-989e-405c-b521-eac110a0298f tempest-SnapshotMetadataTestJSON-471375127 None] Flow 'volume_create_manager' (10090e18-9ce2-44c0-a11f-4b3ac15d7330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:41:03 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3c945312-989e-405c-b521-eac110a0298f tempest-SnapshotMetadataTestJSON-471375127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71de159c-ef21-4878-8380-673138434380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:41:03 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3c945312-989e-405c-b521-eac110a0298f tempest-SnapshotMetadataTestJSON-471375127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71de159c-ef21-4878-8380-673138434380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:41:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-89190829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=718ba7df-b854-4c17-bfcb-9e3435daef11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9deef41877154f998b94ad008a4f7455',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:41:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:41:03Z,use_quota=True,user_id='13ce9d3b20d8495595742a6d7481a0e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:41:03 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3c945312-989e-405c-b521-eac110a0298f tempest-SnapshotMetadataTestJSON-471375127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b6a4181-559e-40ef-8e9f-1bd785bdcfde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:41:03 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3c945312-989e-405c-b521-eac110a0298f tempest-SnapshotMetadataTestJSON-471375127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b6a4181-559e-40ef-8e9f-1bd785bdcfde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:41:03 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3c945312-989e-405c-b521-eac110a0298f tempest-SnapshotMetadataTestJSON-471375127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0406b2d8-43dd-4e9e-91f5-cc282276f263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:41:03 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3c945312-989e-405c-b521-eac110a0298f tempest-SnapshotMetadataTestJSON-471375127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0406b2d8-43dd-4e9e-91f5-cc282276f263) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '718ba7df-b854-4c17-bfcb-9e3435daef11', 'volume_name': 'volume-718ba7df-b854-4c17-bfcb-9e3435daef11', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:41:03 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3c945312-989e-405c-b521-eac110a0298f tempest-SnapshotMetadataTestJSON-471375127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00595bf7-b001-4157-903b-2e304067785e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:41:03 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3c945312-989e-405c-b521-eac110a0298f tempest-SnapshotMetadataTestJSON-471375127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00595bf7-b001-4157-903b-2e304067785e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:41:03 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3c945312-989e-405c-b521-eac110a0298f tempest-SnapshotMetadataTestJSON-471375127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b9c011a-0073-48cf-af29-2ae4a3da7eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:41:03 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-3c945312-989e-405c-b521-eac110a0298f tempest-SnapshotMetadataTestJSON-471375127 None] Volume 718ba7df-b854-4c17-bfcb-9e3435daef11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-718ba7df-b854-4c17-bfcb-9e3435daef11', 'volume_size': 1} Sep 04 22:41:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-3c945312-989e-405c-b521-eac110a0298f tempest-SnapshotMetadataTestJSON-471375127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:41:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-3c945312-989e-405c-b521-eac110a0298f tempest-SnapshotMetadataTestJSON-471375127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:41:03 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-3c945312-989e-405c-b521-eac110a0298f tempest-SnapshotMetadataTestJSON-471375127 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:41:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-89190829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=718ba7df-b854-4c17-bfcb-9e3435daef11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9deef41877154f998b94ad008a4f7455',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:41:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:41:03Z,use_quota=True,user_id='13ce9d3b20d8495595742a6d7481a0e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:41:03 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-3c945312-989e-405c-b521-eac110a0298f tempest-SnapshotMetadataTestJSON-471375127 None] Creating volume 718ba7df-b854-4c17-bfcb-9e3435daef11 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:41:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-3c945312-989e-405c-b521-eac110a0298f tempest-SnapshotMetadataTestJSON-471375127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:41:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-3c945312-989e-405c-b521-eac110a0298f tempest-SnapshotMetadataTestJSON-471375127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:41:03 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-3c945312-989e-405c-b521-eac110a0298f tempest-SnapshotMetadataTestJSON-471375127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:41:03 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-3c945312-989e-405c-b521-eac110a0298f tempest-SnapshotMetadataTestJSON-471375127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:41:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-3c945312-989e-405c-b521-eac110a0298f tempest-SnapshotMetadataTestJSON-471375127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:41:03 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-3c945312-989e-405c-b521-eac110a0298f tempest-SnapshotMetadataTestJSON-471375127 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:41:03 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-3c945312-989e-405c-b521-eac110a0298f tempest-SnapshotMetadataTestJSON-471375127 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:41:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3c945312-989e-405c-b521-eac110a0298f tempest-SnapshotMetadataTestJSON-471375127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-718ba7df-b854-4c17-bfcb-9e3435daef11 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:41:03 devstack sudo[90769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-718ba7df-b854-4c17-bfcb-9e3435daef11 1073741824 Sep 04 22:41:03 devstack sudo[90769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:41:03 devstack sudo[90769]: pam_unix(sudo:session): session closed for user root Sep 04 22:41:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3c945312-989e-405c-b521-eac110a0298f tempest-SnapshotMetadataTestJSON-471375127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-718ba7df-b854-4c17-bfcb-9e3435daef11 1073741824" returned: 0 in 0.611s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:41:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3c945312-989e-405c-b521-eac110a0298f tempest-SnapshotMetadataTestJSON-471375127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-718ba7df-b854-4c17-bfcb-9e3435daef11 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:41:04 devstack sudo[90775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-718ba7df-b854-4c17-bfcb-9e3435daef11 Sep 04 22:41:04 devstack sudo[90775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:41:04 devstack sudo[90775]: pam_unix(sudo:session): session closed for user root Sep 04 22:41:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3c945312-989e-405c-b521-eac110a0298f tempest-SnapshotMetadataTestJSON-471375127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-718ba7df-b854-4c17-bfcb-9e3435daef11" returned: 0 in 0.583s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:41:04 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-3c945312-989e-405c-b521-eac110a0298f tempest-SnapshotMetadataTestJSON-471375127 None] <== create_volume: return (1258ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:41:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-3c945312-989e-405c-b521-eac110a0298f tempest-SnapshotMetadataTestJSON-471375127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.264s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:41:04 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3c945312-989e-405c-b521-eac110a0298f tempest-SnapshotMetadataTestJSON-471375127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b9c011a-0073-48cf-af29-2ae4a3da7eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-718ba7df-b854-4c17-bfcb-9e3435daef11', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:41:04 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3c945312-989e-405c-b521-eac110a0298f tempest-SnapshotMetadataTestJSON-471375127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb8ded6e-3448-475c-b629-c897b02297d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:41:04 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-3c945312-989e-405c-b521-eac110a0298f tempest-SnapshotMetadataTestJSON-471375127 None] Volume volume-718ba7df-b854-4c17-bfcb-9e3435daef11 (718ba7df-b854-4c17-bfcb-9e3435daef11): created successfully Sep 04 22:41:04 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3c945312-989e-405c-b521-eac110a0298f tempest-SnapshotMetadataTestJSON-471375127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb8ded6e-3448-475c-b629-c897b02297d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:41:04 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3c945312-989e-405c-b521-eac110a0298f tempest-SnapshotMetadataTestJSON-471375127 None] Flow 'volume_create_manager' (10090e18-9ce2-44c0-a11f-4b3ac15d7330) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:41:04 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-3c945312-989e-405c-b521-eac110a0298f tempest-SnapshotMetadataTestJSON-471375127 None] Created volume successfully. Sep 04 22:41:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-60ed1d8a-1c00-4901-b51d-83f344f34eb8 tempest-SnapshotMetadataTestJSON-471375127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:41:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-60ed1d8a-1c00-4901-b51d-83f344f34eb8 tempest-SnapshotMetadataTestJSON-471375127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:41:05 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-60ed1d8a-1c00-4901-b51d-83f344f34eb8 tempest-SnapshotMetadataTestJSON-471375127 None] Creating offline snapshot fc3445de-044d-4a41-8a93-42a0238c14dd of volume 718ba7df-b854-4c17-bfcb-9e3435daef11 {{(pid=87576) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 22:41:06 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[9947f393-644b-49e8-bbf5-4048663cd6f9]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:41:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-60ed1d8a-1c00-4901-b51d-83f344f34eb8 tempest-SnapshotMetadataTestJSON-471375127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-718ba7df-b854-4c17-bfcb-9e3435daef11 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:41:06 devstack sudo[90850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-718ba7df-b854-4c17-bfcb-9e3435daef11 Sep 04 22:41:06 devstack sudo[90850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:41:06 devstack sudo[90850]: pam_unix(sudo:session): session closed for user root Sep 04 22:41:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-60ed1d8a-1c00-4901-b51d-83f344f34eb8 tempest-SnapshotMetadataTestJSON-471375127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-718ba7df-b854-4c17-bfcb-9e3435daef11" returned: 0 in 0.602s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:41:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-60ed1d8a-1c00-4901-b51d-83f344f34eb8 tempest-SnapshotMetadataTestJSON-471375127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-718ba7df-b854-4c17-bfcb-9e3435daef11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-718ba7df-b854-4c17-bfcb-9e3435daef11.fc3445de-044d-4a41-8a93-42a0238c14dd 1G {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:41:06 devstack sudo[90855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-718ba7df-b854-4c17-bfcb-9e3435daef11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-718ba7df-b854-4c17-bfcb-9e3435daef11.fc3445de-044d-4a41-8a93-42a0238c14dd 1G Sep 04 22:41:06 devstack sudo[90855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:41:07 devstack sudo[90855]: pam_unix(sudo:session): session closed for user root Sep 04 22:41:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-60ed1d8a-1c00-4901-b51d-83f344f34eb8 tempest-SnapshotMetadataTestJSON-471375127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-718ba7df-b854-4c17-bfcb-9e3435daef11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-718ba7df-b854-4c17-bfcb-9e3435daef11.fc3445de-044d-4a41-8a93-42a0238c14dd 1G" returned: 0 in 0.788s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:41:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-60ed1d8a-1c00-4901-b51d-83f344f34eb8 tempest-SnapshotMetadataTestJSON-471375127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-718ba7df-b854-4c17-bfcb-9e3435daef11 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-718ba7df-b854-4c17-bfcb-9e3435daef11.fc3445de-044d-4a41-8a93-42a0238c14dd {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:41:07 devstack sudo[90862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-718ba7df-b854-4c17-bfcb-9e3435daef11 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-718ba7df-b854-4c17-bfcb-9e3435daef11.fc3445de-044d-4a41-8a93-42a0238c14dd Sep 04 22:41:07 devstack sudo[90862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:41:07 devstack sudo[90862]: pam_unix(sudo:session): session closed for user root Sep 04 22:41:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-60ed1d8a-1c00-4901-b51d-83f344f34eb8 tempest-SnapshotMetadataTestJSON-471375127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-718ba7df-b854-4c17-bfcb-9e3435daef11 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-718ba7df-b854-4c17-bfcb-9e3435daef11.fc3445de-044d-4a41-8a93-42a0238c14dd" returned: 0 in 0.448s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:41:07 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-60ed1d8a-1c00-4901-b51d-83f344f34eb8 tempest-SnapshotMetadataTestJSON-471375127 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-718ba7df-b854-4c17-bfcb-9e3435daef11.fc3445de-044d-4a41-8a93-42a0238c14dd is being set with open permissions: ugo+rw Sep 04 22:41:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-60ed1d8a-1c00-4901-b51d-83f344f34eb8 tempest-SnapshotMetadataTestJSON-471375127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-718ba7df-b854-4c17-bfcb-9e3435daef11.fc3445de-044d-4a41-8a93-42a0238c14dd {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:41:07 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-11c3d1a1-ab80-4edd-89be-3fa4f3398b65 tempest-VolumesTestJSON-2040854454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:41:07 devstack sudo[90868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-718ba7df-b854-4c17-bfcb-9e3435daef11.fc3445de-044d-4a41-8a93-42a0238c14dd Sep 04 22:41:07 devstack sudo[90868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:41:07 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-11c3d1a1-ab80-4edd-89be-3fa4f3398b65 tempest-VolumesTestJSON-2040854454 None] Flow 'volume_create_manager' (69ddac6b-7bdf-46ee-b060-ae0e7102b394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:41:07 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-11c3d1a1-ab80-4edd-89be-3fa4f3398b65 tempest-VolumesTestJSON-2040854454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f4ab96f-18ca-4772-9761-a0864618cac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:41:07 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-11c3d1a1-ab80-4edd-89be-3fa4f3398b65 tempest-VolumesTestJSON-2040854454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f4ab96f-18ca-4772-9761-a0864618cac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:41:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-653475870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1081fa4-c5c6-4847-a5a0-e2ebb5439bb5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='485ee99fc28942c6a455590b0a9e8b42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:41:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:41:08Z,use_quota=True,user_id='32fdc85b2df84de68bd05e58bb3e99dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:41:07 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-11c3d1a1-ab80-4edd-89be-3fa4f3398b65 tempest-VolumesTestJSON-2040854454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77a5782e-44ab-4296-bb60-06c0e9bbe246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:41:07 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-11c3d1a1-ab80-4edd-89be-3fa4f3398b65 tempest-VolumesTestJSON-2040854454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77a5782e-44ab-4296-bb60-06c0e9bbe246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:41:07 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-11c3d1a1-ab80-4edd-89be-3fa4f3398b65 tempest-VolumesTestJSON-2040854454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5f522c4-9905-4870-a7f6-25615e210af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:41:07 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-11c3d1a1-ab80-4edd-89be-3fa4f3398b65 tempest-VolumesTestJSON-2040854454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5f522c4-9905-4870-a7f6-25615e210af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1081fa4-c5c6-4847-a5a0-e2ebb5439bb5', 'volume_name': 'volume-e1081fa4-c5c6-4847-a5a0-e2ebb5439bb5', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:41:07 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-11c3d1a1-ab80-4edd-89be-3fa4f3398b65 tempest-VolumesTestJSON-2040854454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c54fa4b-5ab8-4796-bc36-e1f94fd18b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:41:07 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-11c3d1a1-ab80-4edd-89be-3fa4f3398b65 tempest-VolumesTestJSON-2040854454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c54fa4b-5ab8-4796-bc36-e1f94fd18b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:41:07 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-11c3d1a1-ab80-4edd-89be-3fa4f3398b65 tempest-VolumesTestJSON-2040854454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7562757-0566-4f9c-9548-9329d7f2817b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:41:07 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-11c3d1a1-ab80-4edd-89be-3fa4f3398b65 tempest-VolumesTestJSON-2040854454 None] Volume e1081fa4-c5c6-4847-a5a0-e2ebb5439bb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1081fa4-c5c6-4847-a5a0-e2ebb5439bb5', 'volume_size': 1} Sep 04 22:41:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-11c3d1a1-ab80-4edd-89be-3fa4f3398b65 tempest-VolumesTestJSON-2040854454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:41:08 devstack sudo[90868]: pam_unix(sudo:session): session closed for user root Sep 04 22:41:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-60ed1d8a-1c00-4901-b51d-83f344f34eb8 tempest-SnapshotMetadataTestJSON-471375127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-718ba7df-b854-4c17-bfcb-9e3435daef11.fc3445de-044d-4a41-8a93-42a0238c14dd" returned: 0 in 0.307s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:41:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-60ed1d8a-1c00-4901-b51d-83f344f34eb8 tempest-SnapshotMetadataTestJSON-471375127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-718ba7df-b854-4c17-bfcb-9e3435daef11.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:41:08 devstack sudo[90871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-718ba7df-b854-4c17-bfcb-9e3435daef11.info Sep 04 22:41:08 devstack sudo[90871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:41:08 devstack sudo[90871]: pam_unix(sudo:session): session closed for user root Sep 04 22:41:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-60ed1d8a-1c00-4901-b51d-83f344f34eb8 tempest-SnapshotMetadataTestJSON-471375127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-718ba7df-b854-4c17-bfcb-9e3435daef11.info" returned: 0 in 0.496s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:41:08 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-60ed1d8a-1c00-4901-b51d-83f344f34eb8 tempest-SnapshotMetadataTestJSON-471375127 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-718ba7df-b854-4c17-bfcb-9e3435daef11.info is being set with open permissions: ugo+rw Sep 04 22:41:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-60ed1d8a-1c00-4901-b51d-83f344f34eb8 tempest-SnapshotMetadataTestJSON-471375127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-718ba7df-b854-4c17-bfcb-9e3435daef11.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:41:08 devstack sudo[90875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-718ba7df-b854-4c17-bfcb-9e3435daef11.info Sep 04 22:41:08 devstack sudo[90875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:41:09 devstack sudo[90875]: pam_unix(sudo:session): session closed for user root Sep 04 22:41:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-60ed1d8a-1c00-4901-b51d-83f344f34eb8 tempest-SnapshotMetadataTestJSON-471375127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-718ba7df-b854-4c17-bfcb-9e3435daef11.info" returned: 0 in 0.364s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:41:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-60ed1d8a-1c00-4901-b51d-83f344f34eb8 tempest-SnapshotMetadataTestJSON-471375127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.179s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:41:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-11c3d1a1-ab80-4edd-89be-3fa4f3398b65 tempest-VolumesTestJSON-2040854454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.168s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:41:09 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-11c3d1a1-ab80-4edd-89be-3fa4f3398b65 tempest-VolumesTestJSON-2040854454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:41:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-653475870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1081fa4-c5c6-4847-a5a0-e2ebb5439bb5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='485ee99fc28942c6a455590b0a9e8b42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:41:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:41:08Z,use_quota=True,user_id='32fdc85b2df84de68bd05e58bb3e99dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:41:09 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-11c3d1a1-ab80-4edd-89be-3fa4f3398b65 tempest-VolumesTestJSON-2040854454 None] Creating volume e1081fa4-c5c6-4847-a5a0-e2ebb5439bb5 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:41:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-11c3d1a1-ab80-4edd-89be-3fa4f3398b65 tempest-VolumesTestJSON-2040854454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:41:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-11c3d1a1-ab80-4edd-89be-3fa4f3398b65 tempest-VolumesTestJSON-2040854454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:41:09 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-11c3d1a1-ab80-4edd-89be-3fa4f3398b65 tempest-VolumesTestJSON-2040854454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:41:09 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-11c3d1a1-ab80-4edd-89be-3fa4f3398b65 tempest-VolumesTestJSON-2040854454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:41:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-11c3d1a1-ab80-4edd-89be-3fa4f3398b65 tempest-VolumesTestJSON-2040854454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:41:09 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-11c3d1a1-ab80-4edd-89be-3fa4f3398b65 tempest-VolumesTestJSON-2040854454 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:41:09 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-11c3d1a1-ab80-4edd-89be-3fa4f3398b65 tempest-VolumesTestJSON-2040854454 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:41:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-11c3d1a1-ab80-4edd-89be-3fa4f3398b65 tempest-VolumesTestJSON-2040854454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1081fa4-c5c6-4847-a5a0-e2ebb5439bb5 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:41:09 devstack sudo[90879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1081fa4-c5c6-4847-a5a0-e2ebb5439bb5 1073741824 Sep 04 22:41:09 devstack sudo[90879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:41:09 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-60ed1d8a-1c00-4901-b51d-83f344f34eb8 tempest-SnapshotMetadataTestJSON-471375127 None] Create snapshot completed successfully Sep 04 22:41:09 devstack sudo[90879]: pam_unix(sudo:session): session closed for user root Sep 04 22:41:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-11c3d1a1-ab80-4edd-89be-3fa4f3398b65 tempest-VolumesTestJSON-2040854454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1081fa4-c5c6-4847-a5a0-e2ebb5439bb5 1073741824" returned: 0 in 0.609s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:41:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-11c3d1a1-ab80-4edd-89be-3fa4f3398b65 tempest-VolumesTestJSON-2040854454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1081fa4-c5c6-4847-a5a0-e2ebb5439bb5 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:41:09 devstack sudo[90887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1081fa4-c5c6-4847-a5a0-e2ebb5439bb5 Sep 04 22:41:09 devstack sudo[90887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:41:10 devstack sudo[90887]: pam_unix(sudo:session): session closed for user root Sep 04 22:41:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-11c3d1a1-ab80-4edd-89be-3fa4f3398b65 tempest-VolumesTestJSON-2040854454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1081fa4-c5c6-4847-a5a0-e2ebb5439bb5" returned: 0 in 0.327s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:41:10 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-11c3d1a1-ab80-4edd-89be-3fa4f3398b65 tempest-VolumesTestJSON-2040854454 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:41:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-11c3d1a1-ab80-4edd-89be-3fa4f3398b65 tempest-VolumesTestJSON-2040854454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:41:10 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-11c3d1a1-ab80-4edd-89be-3fa4f3398b65 tempest-VolumesTestJSON-2040854454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7562757-0566-4f9c-9548-9329d7f2817b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1081fa4-c5c6-4847-a5a0-e2ebb5439bb5', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:41:10 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-11c3d1a1-ab80-4edd-89be-3fa4f3398b65 tempest-VolumesTestJSON-2040854454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adb7da9d-73d6-4ebc-9e7c-9d42fca23515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:41:10 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-11c3d1a1-ab80-4edd-89be-3fa4f3398b65 tempest-VolumesTestJSON-2040854454 None] Volume volume-e1081fa4-c5c6-4847-a5a0-e2ebb5439bb5 (e1081fa4-c5c6-4847-a5a0-e2ebb5439bb5): created successfully Sep 04 22:41:10 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-11c3d1a1-ab80-4edd-89be-3fa4f3398b65 tempest-VolumesTestJSON-2040854454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adb7da9d-73d6-4ebc-9e7c-9d42fca23515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:41:10 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-11c3d1a1-ab80-4edd-89be-3fa4f3398b65 tempest-VolumesTestJSON-2040854454 None] Flow 'volume_create_manager' (69ddac6b-7bdf-46ee-b060-ae0e7102b394) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:41:10 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-11c3d1a1-ab80-4edd-89be-3fa4f3398b65 tempest-VolumesTestJSON-2040854454 None] Created volume successfully. Sep 04 22:41:11 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d162ffe1-3f4e-45a8-be37-81b616a73d39 tempest-SnapshotMetadataTestJSON-471375127 None] Acquiring lock "cinder-fc3445de-044d-4a41-8a93-42a0238c14dd-delete_snapshot" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:41:11 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d162ffe1-3f4e-45a8-be37-81b616a73d39 tempest-SnapshotMetadataTestJSON-471375127 None] Lock "cinder-fc3445de-044d-4a41-8a93-42a0238c14dd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:41:11 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d162ffe1-3f4e-45a8-be37-81b616a73d39 tempest-SnapshotMetadataTestJSON-471375127 None] Acquiring lock "cinder-quobyte-718ba7df-b854-4c17-bfcb-9e3435daef11" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:41:11 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d162ffe1-3f4e-45a8-be37-81b616a73d39 tempest-SnapshotMetadataTestJSON-471375127 None] Lock "cinder-quobyte-718ba7df-b854-4c17-bfcb-9e3435daef11" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:41:11 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d162ffe1-3f4e-45a8-be37-81b616a73d39 tempest-SnapshotMetadataTestJSON-471375127 None] Acquiring lock "cinder-quobyte-fc3445de-044d-4a41-8a93-42a0238c14dd" by "_delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:41:11 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d162ffe1-3f4e-45a8-be37-81b616a73d39 tempest-SnapshotMetadataTestJSON-471375127 None] Lock "cinder-quobyte-fc3445de-044d-4a41-8a93-42a0238c14dd" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:41:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-d162ffe1-3f4e-45a8-be37-81b616a73d39 tempest-SnapshotMetadataTestJSON-471375127 None] Deleting offline snapshot fc3445de-044d-4a41-8a93-42a0238c14dd of volume 718ba7df-b854-4c17-bfcb-9e3435daef11 {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 22:41:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-d162ffe1-3f4e-45a8-be37-81b616a73d39 tempest-SnapshotMetadataTestJSON-471375127 None] snapshot_file for this snap is: volume-718ba7df-b854-4c17-bfcb-9e3435daef11.fc3445de-044d-4a41-8a93-42a0238c14dd {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 22:41:11 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8589d7b-8748-47df-96c3-86fc46b7d46e]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:41:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d162ffe1-3f4e-45a8-be37-81b616a73d39 tempest-SnapshotMetadataTestJSON-471375127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-718ba7df-b854-4c17-bfcb-9e3435daef11.fc3445de-044d-4a41-8a93-42a0238c14dd {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:41:11 devstack sudo[90890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-718ba7df-b854-4c17-bfcb-9e3435daef11.fc3445de-044d-4a41-8a93-42a0238c14dd Sep 04 22:41:11 devstack sudo[90890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:41:11 devstack sudo[90890]: pam_unix(sudo:session): session closed for user root Sep 04 22:41:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d162ffe1-3f4e-45a8-be37-81b616a73d39 tempest-SnapshotMetadataTestJSON-471375127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-718ba7df-b854-4c17-bfcb-9e3435daef11.fc3445de-044d-4a41-8a93-42a0238c14dd" returned: 0 in 0.594s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:41:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-d162ffe1-3f4e-45a8-be37-81b616a73d39 tempest-SnapshotMetadataTestJSON-471375127 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-718ba7df-b854-4c17-bfcb-9e3435daef11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 22:41:11 devstack cinder-volume[87576]: DEBUG oslo_service.periodic_task [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87576) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 22:41:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:41:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:41:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:41:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:41:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:41:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:41:11 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f38d296-b379-4885-80d1-96bbf0e26861]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:41:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d162ffe1-3f4e-45a8-be37-81b616a73d39 tempest-SnapshotMetadataTestJSON-471375127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-718ba7df-b854-4c17-bfcb-9e3435daef11 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:41:11 devstack sudo[90896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:41:11 devstack sudo[90896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:41:11 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-af26b6ed-eeb0-4ee8-9e09-435d9a23d244 tempest-VolumesTestJSON-2040854454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:41:11 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-af26b6ed-eeb0-4ee8-9e09-435d9a23d244 tempest-VolumesTestJSON-2040854454 None] Flow 'volume_create_manager' (b008ccf0-2395-429d-b024-8e680a1200cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:41:11 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-af26b6ed-eeb0-4ee8-9e09-435d9a23d244 tempest-VolumesTestJSON-2040854454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03dd541d-1635-4e6d-b8c8-1967c682c328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:41:11 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-af26b6ed-eeb0-4ee8-9e09-435d9a23d244 tempest-VolumesTestJSON-2040854454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03dd541d-1635-4e6d-b8c8-1967c682c328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:41:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-690658245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=549dde58-a0bb-4fcd-b0f0-8873ed4f40b2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='485ee99fc28942c6a455590b0a9e8b42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:41:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:41:12Z,use_quota=True,user_id='32fdc85b2df84de68bd05e58bb3e99dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:41:11 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-af26b6ed-eeb0-4ee8-9e09-435d9a23d244 tempest-VolumesTestJSON-2040854454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (065d4a89-3b41-4f07-9031-c25d3cde44d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:41:11 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-af26b6ed-eeb0-4ee8-9e09-435d9a23d244 tempest-VolumesTestJSON-2040854454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (065d4a89-3b41-4f07-9031-c25d3cde44d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:41:11 devstack sudo[90897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-718ba7df-b854-4c17-bfcb-9e3435daef11 Sep 04 22:41:11 devstack sudo[90897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:41:11 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-af26b6ed-eeb0-4ee8-9e09-435d9a23d244 tempest-VolumesTestJSON-2040854454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (544ae9bc-f694-4c5f-a295-89619e02307f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:41:12 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-af26b6ed-eeb0-4ee8-9e09-435d9a23d244 tempest-VolumesTestJSON-2040854454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (544ae9bc-f694-4c5f-a295-89619e02307f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '549dde58-a0bb-4fcd-b0f0-8873ed4f40b2', 'volume_name': 'volume-549dde58-a0bb-4fcd-b0f0-8873ed4f40b2', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:41:12 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-af26b6ed-eeb0-4ee8-9e09-435d9a23d244 tempest-VolumesTestJSON-2040854454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d0f3c0f-460f-4ed7-94f1-077733bc7556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:41:12 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-af26b6ed-eeb0-4ee8-9e09-435d9a23d244 tempest-VolumesTestJSON-2040854454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d0f3c0f-460f-4ed7-94f1-077733bc7556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:41:12 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-af26b6ed-eeb0-4ee8-9e09-435d9a23d244 tempest-VolumesTestJSON-2040854454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e05927a-65aa-417b-af1e-f9ef6ae5764e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:41:12 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-af26b6ed-eeb0-4ee8-9e09-435d9a23d244 tempest-VolumesTestJSON-2040854454 None] Volume 549dde58-a0bb-4fcd-b0f0-8873ed4f40b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-549dde58-a0bb-4fcd-b0f0-8873ed4f40b2', 'volume_size': 1} Sep 04 22:41:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-af26b6ed-eeb0-4ee8-9e09-435d9a23d244 tempest-VolumesTestJSON-2040854454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:41:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-af26b6ed-eeb0-4ee8-9e09-435d9a23d244 tempest-VolumesTestJSON-2040854454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:41:12 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-af26b6ed-eeb0-4ee8-9e09-435d9a23d244 tempest-VolumesTestJSON-2040854454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:41:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-690658245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=549dde58-a0bb-4fcd-b0f0-8873ed4f40b2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='485ee99fc28942c6a455590b0a9e8b42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:41:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:41:12Z,use_quota=True,user_id='32fdc85b2df84de68bd05e58bb3e99dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:41:12 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-af26b6ed-eeb0-4ee8-9e09-435d9a23d244 tempest-VolumesTestJSON-2040854454 None] Creating volume 549dde58-a0bb-4fcd-b0f0-8873ed4f40b2 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:41:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-af26b6ed-eeb0-4ee8-9e09-435d9a23d244 tempest-VolumesTestJSON-2040854454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:41:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-af26b6ed-eeb0-4ee8-9e09-435d9a23d244 tempest-VolumesTestJSON-2040854454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:41:12 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-af26b6ed-eeb0-4ee8-9e09-435d9a23d244 tempest-VolumesTestJSON-2040854454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:41:12 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-af26b6ed-eeb0-4ee8-9e09-435d9a23d244 tempest-VolumesTestJSON-2040854454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:41:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-af26b6ed-eeb0-4ee8-9e09-435d9a23d244 tempest-VolumesTestJSON-2040854454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:41:12 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-af26b6ed-eeb0-4ee8-9e09-435d9a23d244 tempest-VolumesTestJSON-2040854454 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:41:12 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-af26b6ed-eeb0-4ee8-9e09-435d9a23d244 tempest-VolumesTestJSON-2040854454 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:41:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-af26b6ed-eeb0-4ee8-9e09-435d9a23d244 tempest-VolumesTestJSON-2040854454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-549dde58-a0bb-4fcd-b0f0-8873ed4f40b2 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:41:12 devstack sudo[90900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-549dde58-a0bb-4fcd-b0f0-8873ed4f40b2 1073741824 Sep 04 22:41:12 devstack sudo[90900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:41:12 devstack sudo[90896]: pam_unix(sudo:session): session closed for user root Sep 04 22:41:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.397s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:41:12 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:41:12 devstack cinder-volume[87576]: DEBUG oslo_service.periodic_task [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Running periodic task VolumeManager._thread_info {{(pid=87576) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 22:41:12 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] thread count: 8 {{(pid=87576) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 22:41:12 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] thread info: [<_MainThread(MainThread, started 125730416963712)>, , , , , , , ] {{(pid=87576) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 22:41:12 devstack sudo[90897]: pam_unix(sudo:session): session closed for user root Sep 04 22:41:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d162ffe1-3f4e-45a8-be37-81b616a73d39 tempest-SnapshotMetadataTestJSON-471375127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-718ba7df-b854-4c17-bfcb-9e3435daef11" returned: 0 in 0.527s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:41:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d162ffe1-3f4e-45a8-be37-81b616a73d39 tempest-SnapshotMetadataTestJSON-471375127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-718ba7df-b854-4c17-bfcb-9e3435daef11.fc3445de-044d-4a41-8a93-42a0238c14dd {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:41:12 devstack sudo[90908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-718ba7df-b854-4c17-bfcb-9e3435daef11.fc3445de-044d-4a41-8a93-42a0238c14dd Sep 04 22:41:12 devstack sudo[90908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:41:12 devstack sudo[90900]: pam_unix(sudo:session): session closed for user root Sep 04 22:41:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-af26b6ed-eeb0-4ee8-9e09-435d9a23d244 tempest-VolumesTestJSON-2040854454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-549dde58-a0bb-4fcd-b0f0-8873ed4f40b2 1073741824" returned: 0 in 0.593s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:41:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-af26b6ed-eeb0-4ee8-9e09-435d9a23d244 tempest-VolumesTestJSON-2040854454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-549dde58-a0bb-4fcd-b0f0-8873ed4f40b2 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:41:12 devstack sudo[90917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-549dde58-a0bb-4fcd-b0f0-8873ed4f40b2 Sep 04 22:41:12 devstack sudo[90917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:41:12 devstack sudo[90908]: pam_unix(sudo:session): session closed for user root Sep 04 22:41:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d162ffe1-3f4e-45a8-be37-81b616a73d39 tempest-SnapshotMetadataTestJSON-471375127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-718ba7df-b854-4c17-bfcb-9e3435daef11.fc3445de-044d-4a41-8a93-42a0238c14dd" returned: 0 in 0.493s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:41:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d162ffe1-3f4e-45a8-be37-81b616a73d39 tempest-SnapshotMetadataTestJSON-471375127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-718ba7df-b854-4c17-bfcb-9e3435daef11.fc3445de-044d-4a41-8a93-42a0238c14dd {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:41:12 devstack sudo[90919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-718ba7df-b854-4c17-bfcb-9e3435daef11.fc3445de-044d-4a41-8a93-42a0238c14dd Sep 04 22:41:12 devstack sudo[90919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:41:13 devstack sudo[90917]: pam_unix(sudo:session): session closed for user root Sep 04 22:41:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-af26b6ed-eeb0-4ee8-9e09-435d9a23d244 tempest-VolumesTestJSON-2040854454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-549dde58-a0bb-4fcd-b0f0-8873ed4f40b2" returned: 0 in 0.354s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:41:13 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-af26b6ed-eeb0-4ee8-9e09-435d9a23d244 tempest-VolumesTestJSON-2040854454 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:41:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-af26b6ed-eeb0-4ee8-9e09-435d9a23d244 tempest-VolumesTestJSON-2040854454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:41:13 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-af26b6ed-eeb0-4ee8-9e09-435d9a23d244 tempest-VolumesTestJSON-2040854454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e05927a-65aa-417b-af1e-f9ef6ae5764e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-549dde58-a0bb-4fcd-b0f0-8873ed4f40b2', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:41:13 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-af26b6ed-eeb0-4ee8-9e09-435d9a23d244 tempest-VolumesTestJSON-2040854454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb681a81-9353-481d-92ff-8a304a5527d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:41:13 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-af26b6ed-eeb0-4ee8-9e09-435d9a23d244 tempest-VolumesTestJSON-2040854454 None] Volume volume-549dde58-a0bb-4fcd-b0f0-8873ed4f40b2 (549dde58-a0bb-4fcd-b0f0-8873ed4f40b2): created successfully Sep 04 22:41:13 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-af26b6ed-eeb0-4ee8-9e09-435d9a23d244 tempest-VolumesTestJSON-2040854454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb681a81-9353-481d-92ff-8a304a5527d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:41:13 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-af26b6ed-eeb0-4ee8-9e09-435d9a23d244 tempest-VolumesTestJSON-2040854454 None] Flow 'volume_create_manager' (b008ccf0-2395-429d-b024-8e680a1200cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:41:13 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-af26b6ed-eeb0-4ee8-9e09-435d9a23d244 tempest-VolumesTestJSON-2040854454 None] Created volume successfully. Sep 04 22:41:13 devstack sudo[90919]: pam_unix(sudo:session): session closed for user root Sep 04 22:41:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d162ffe1-3f4e-45a8-be37-81b616a73d39 tempest-SnapshotMetadataTestJSON-471375127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-718ba7df-b854-4c17-bfcb-9e3435daef11.fc3445de-044d-4a41-8a93-42a0238c14dd" returned: 0 in 0.334s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:41:13 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d162ffe1-3f4e-45a8-be37-81b616a73d39 tempest-SnapshotMetadataTestJSON-471375127 None] Lock "cinder-quobyte-fc3445de-044d-4a41-8a93-42a0238c14dd" released by "_delete_snapshot" :: held 2.132s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:41:13 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d162ffe1-3f4e-45a8-be37-81b616a73d39 tempest-SnapshotMetadataTestJSON-471375127 None] Lock "cinder-quobyte-718ba7df-b854-4c17-bfcb-9e3435daef11" released by "delete_snapshot" :: held 2.163s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:41:13 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-d162ffe1-3f4e-45a8-be37-81b616a73d39 tempest-SnapshotMetadataTestJSON-471375127 None] Created reservations ['aca6baa7-fe3b-45e2-9527-e7bdec8f12ec', '7b6c38f1-a810-4f3e-9655-c8722c6c423c', '0845c3c9-d4bb-4fea-ba2e-dd2d2cbc8c7e', 'eaffb854-2089-4a71-8255-1b34418b7ea3'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:41:13 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-d162ffe1-3f4e-45a8-be37-81b616a73d39 tempest-SnapshotMetadataTestJSON-471375127 None] Delete snapshot completed successfully. Sep 04 22:41:13 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d162ffe1-3f4e-45a8-be37-81b616a73d39 tempest-SnapshotMetadataTestJSON-471375127 None] Lock "cinder-fc3445de-044d-4a41-8a93-42a0238c14dd-delete_snapshot" released by "delete_snapshot" :: held 2.331s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:41:14 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-e9d160d9-6482-4fb9-a515-0de6badd1848 tempest-SnapshotMetadataTestJSON-471375127 None] Acquiring lock "cinder-718ba7df-b854-4c17-bfcb-9e3435daef11-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:41:14 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-e9d160d9-6482-4fb9-a515-0de6badd1848 tempest-SnapshotMetadataTestJSON-471375127 None] Lock "cinder-718ba7df-b854-4c17-bfcb-9e3435daef11-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:41:14 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6541778-d202-4ba1-a533-6bc6d461dc51 tempest-VolumesTestJSON-2040854454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:41:14 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-b6541778-d202-4ba1-a533-6bc6d461dc51 tempest-VolumesTestJSON-2040854454 None] Flow 'volume_create_manager' (533f110b-9285-4446-91dc-661e4b2e1517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:41:14 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-b6541778-d202-4ba1-a533-6bc6d461dc51 tempest-VolumesTestJSON-2040854454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18071c29-201f-4fe1-b60c-a34cb7955e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:41:14 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-e9d160d9-6482-4fb9-a515-0de6badd1848 tempest-SnapshotMetadataTestJSON-471375127 None] Acquiring lock "cinder-quobyte-718ba7df-b854-4c17-bfcb-9e3435daef11" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:41:14 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-b6541778-d202-4ba1-a533-6bc6d461dc51 tempest-VolumesTestJSON-2040854454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18071c29-201f-4fe1-b60c-a34cb7955e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1309964483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f27d42d-bb7f-4959-8313-1c153eab63c5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='485ee99fc28942c6a455590b0a9e8b42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:41:14Z,use_quota=True,user_id='32fdc85b2df84de68bd05e58bb3e99dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:41:14 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-b6541778-d202-4ba1-a533-6bc6d461dc51 tempest-VolumesTestJSON-2040854454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93bd5899-0690-49de-8620-65fcb454a278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:41:14 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-b6541778-d202-4ba1-a533-6bc6d461dc51 tempest-VolumesTestJSON-2040854454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93bd5899-0690-49de-8620-65fcb454a278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:41:14 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-b6541778-d202-4ba1-a533-6bc6d461dc51 tempest-VolumesTestJSON-2040854454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65fc02f7-ba0a-45a2-a6cf-8ddd60a07e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:41:14 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-b6541778-d202-4ba1-a533-6bc6d461dc51 tempest-VolumesTestJSON-2040854454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65fc02f7-ba0a-45a2-a6cf-8ddd60a07e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f27d42d-bb7f-4959-8313-1c153eab63c5', 'volume_name': 'volume-7f27d42d-bb7f-4959-8313-1c153eab63c5', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:41:14 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-b6541778-d202-4ba1-a533-6bc6d461dc51 tempest-VolumesTestJSON-2040854454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bca7b03a-473e-45dd-af65-f684b96dc558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:41:14 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-b6541778-d202-4ba1-a533-6bc6d461dc51 tempest-VolumesTestJSON-2040854454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bca7b03a-473e-45dd-af65-f684b96dc558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:41:14 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-b6541778-d202-4ba1-a533-6bc6d461dc51 tempest-VolumesTestJSON-2040854454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f599432-7470-4375-9aa8-4efe7e74657d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:41:14 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-b6541778-d202-4ba1-a533-6bc6d461dc51 tempest-VolumesTestJSON-2040854454 None] Volume 7f27d42d-bb7f-4959-8313-1c153eab63c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f27d42d-bb7f-4959-8313-1c153eab63c5', 'volume_size': 1} Sep 04 22:41:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-b6541778-d202-4ba1-a533-6bc6d461dc51 tempest-VolumesTestJSON-2040854454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:41:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-b6541778-d202-4ba1-a533-6bc6d461dc51 tempest-VolumesTestJSON-2040854454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:41:14 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-b6541778-d202-4ba1-a533-6bc6d461dc51 tempest-VolumesTestJSON-2040854454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1309964483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f27d42d-bb7f-4959-8313-1c153eab63c5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='485ee99fc28942c6a455590b0a9e8b42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:41:14Z,use_quota=True,user_id='32fdc85b2df84de68bd05e58bb3e99dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:41:14 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-b6541778-d202-4ba1-a533-6bc6d461dc51 tempest-VolumesTestJSON-2040854454 None] Creating volume 7f27d42d-bb7f-4959-8313-1c153eab63c5 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:41:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-b6541778-d202-4ba1-a533-6bc6d461dc51 tempest-VolumesTestJSON-2040854454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:41:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-b6541778-d202-4ba1-a533-6bc6d461dc51 tempest-VolumesTestJSON-2040854454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:41:14 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-b6541778-d202-4ba1-a533-6bc6d461dc51 tempest-VolumesTestJSON-2040854454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:41:14 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-b6541778-d202-4ba1-a533-6bc6d461dc51 tempest-VolumesTestJSON-2040854454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:41:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-b6541778-d202-4ba1-a533-6bc6d461dc51 tempest-VolumesTestJSON-2040854454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:41:14 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-b6541778-d202-4ba1-a533-6bc6d461dc51 tempest-VolumesTestJSON-2040854454 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:41:14 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-b6541778-d202-4ba1-a533-6bc6d461dc51 tempest-VolumesTestJSON-2040854454 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:41:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b6541778-d202-4ba1-a533-6bc6d461dc51 tempest-VolumesTestJSON-2040854454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7f27d42d-bb7f-4959-8313-1c153eab63c5 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:41:14 devstack sudo[90924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7f27d42d-bb7f-4959-8313-1c153eab63c5 1073741824 Sep 04 22:41:14 devstack sudo[90924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:41:14 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-e9d160d9-6482-4fb9-a515-0de6badd1848 tempest-SnapshotMetadataTestJSON-471375127 None] Lock "cinder-quobyte-718ba7df-b854-4c17-bfcb-9e3435daef11" acquired by "delete_volume" :: waited 0.096s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:41:14 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[c135c2f8-220c-4a37-bbaf-e6b6d370124f]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:41:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e9d160d9-6482-4fb9-a515-0de6badd1848 tempest-SnapshotMetadataTestJSON-471375127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-718ba7df-b854-4c17-bfcb-9e3435daef11 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:41:14 devstack sudo[90926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-718ba7df-b854-4c17-bfcb-9e3435daef11 Sep 04 22:41:14 devstack sudo[90926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:41:15 devstack sudo[90924]: pam_unix(sudo:session): session closed for user root Sep 04 22:41:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b6541778-d202-4ba1-a533-6bc6d461dc51 tempest-VolumesTestJSON-2040854454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7f27d42d-bb7f-4959-8313-1c153eab63c5 1073741824" returned: 0 in 0.566s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:41:15 devstack sudo[90926]: pam_unix(sudo:session): session closed for user root Sep 04 22:41:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e9d160d9-6482-4fb9-a515-0de6badd1848 tempest-SnapshotMetadataTestJSON-471375127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-718ba7df-b854-4c17-bfcb-9e3435daef11" returned: 0 in 0.525s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:41:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e9d160d9-6482-4fb9-a515-0de6badd1848 tempest-SnapshotMetadataTestJSON-471375127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-718ba7df-b854-4c17-bfcb-9e3435daef11 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:41:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b6541778-d202-4ba1-a533-6bc6d461dc51 tempest-VolumesTestJSON-2040854454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7f27d42d-bb7f-4959-8313-1c153eab63c5 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:41:15 devstack sudo[90937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-718ba7df-b854-4c17-bfcb-9e3435daef11 Sep 04 22:41:15 devstack sudo[90937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:41:15 devstack sudo[90938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7f27d42d-bb7f-4959-8313-1c153eab63c5 Sep 04 22:41:15 devstack sudo[90938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:41:15 devstack sudo[90938]: pam_unix(sudo:session): session closed for user root Sep 04 22:41:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b6541778-d202-4ba1-a533-6bc6d461dc51 tempest-VolumesTestJSON-2040854454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7f27d42d-bb7f-4959-8313-1c153eab63c5" returned: 0 in 0.364s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:41:15 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-b6541778-d202-4ba1-a533-6bc6d461dc51 tempest-VolumesTestJSON-2040854454 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:41:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-b6541778-d202-4ba1-a533-6bc6d461dc51 tempest-VolumesTestJSON-2040854454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:41:15 devstack sudo[90937]: pam_unix(sudo:session): session closed for user root Sep 04 22:41:15 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-b6541778-d202-4ba1-a533-6bc6d461dc51 tempest-VolumesTestJSON-2040854454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f599432-7470-4375-9aa8-4efe7e74657d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f27d42d-bb7f-4959-8313-1c153eab63c5', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:41:15 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-b6541778-d202-4ba1-a533-6bc6d461dc51 tempest-VolumesTestJSON-2040854454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0f5d72e-a1bd-4c2a-ab4a-4ba54b60362e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:41:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e9d160d9-6482-4fb9-a515-0de6badd1848 tempest-SnapshotMetadataTestJSON-471375127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-718ba7df-b854-4c17-bfcb-9e3435daef11" returned: 0 in 0.421s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:41:15 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-e9d160d9-6482-4fb9-a515-0de6badd1848 tempest-SnapshotMetadataTestJSON-471375127 None] Lock "cinder-quobyte-718ba7df-b854-4c17-bfcb-9e3435daef11" released by "delete_volume" :: held 1.028s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:41:15 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-b6541778-d202-4ba1-a533-6bc6d461dc51 tempest-VolumesTestJSON-2040854454 None] Volume volume-7f27d42d-bb7f-4959-8313-1c153eab63c5 (7f27d42d-bb7f-4959-8313-1c153eab63c5): created successfully Sep 04 22:41:15 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-b6541778-d202-4ba1-a533-6bc6d461dc51 tempest-VolumesTestJSON-2040854454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0f5d72e-a1bd-4c2a-ab4a-4ba54b60362e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:41:15 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-b6541778-d202-4ba1-a533-6bc6d461dc51 tempest-VolumesTestJSON-2040854454 None] Flow 'volume_create_manager' (533f110b-9285-4446-91dc-661e4b2e1517) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:41:15 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-b6541778-d202-4ba1-a533-6bc6d461dc51 tempest-VolumesTestJSON-2040854454 None] Created volume successfully. Sep 04 22:41:15 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-e9d160d9-6482-4fb9-a515-0de6badd1848 tempest-SnapshotMetadataTestJSON-471375127 None] Created reservations ['9bc4b952-eadc-4999-910e-a887e2d5ddd8', '14ac1e5c-4662-4ef1-8f54-05d15b632718', '10b13b11-e058-407c-b85b-1c50489a401c', '272a4700-407b-48f2-8e0d-a0a4d824aad5'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:41:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-e9d160d9-6482-4fb9-a515-0de6badd1848 tempest-SnapshotMetadataTestJSON-471375127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:41:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-e9d160d9-6482-4fb9-a515-0de6badd1848 tempest-SnapshotMetadataTestJSON-471375127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:41:15 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-e9d160d9-6482-4fb9-a515-0de6badd1848 tempest-SnapshotMetadataTestJSON-471375127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:41:15 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-e9d160d9-6482-4fb9-a515-0de6badd1848 tempest-SnapshotMetadataTestJSON-471375127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:41:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-e9d160d9-6482-4fb9-a515-0de6badd1848 tempest-SnapshotMetadataTestJSON-471375127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:41:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e9d160d9-6482-4fb9-a515-0de6badd1848 tempest-SnapshotMetadataTestJSON-471375127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:41:15 devstack sudo[90943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:41:15 devstack sudo[90943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:41:16 devstack sudo[90943]: pam_unix(sudo:session): session closed for user root Sep 04 22:41:16 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e9d160d9-6482-4fb9-a515-0de6badd1848 tempest-SnapshotMetadataTestJSON-471375127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.268s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:41:16 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-e9d160d9-6482-4fb9-a515-0de6badd1848 tempest-SnapshotMetadataTestJSON-471375127 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:41:16 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-e9d160d9-6482-4fb9-a515-0de6badd1848 tempest-SnapshotMetadataTestJSON-471375127 None] Deleted volume successfully. Sep 04 22:41:16 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-e9d160d9-6482-4fb9-a515-0de6badd1848 tempest-SnapshotMetadataTestJSON-471375127 None] Lock "cinder-718ba7df-b854-4c17-bfcb-9e3435daef11-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:41:18 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-98c410e5-e682-4452-b587-b76c0833d7d9 tempest-VolumesTestJSON-2040854454 None] Acquiring lock "cinder-7f27d42d-bb7f-4959-8313-1c153eab63c5-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:41:18 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-98c410e5-e682-4452-b587-b76c0833d7d9 tempest-VolumesTestJSON-2040854454 None] Lock "cinder-7f27d42d-bb7f-4959-8313-1c153eab63c5-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:41:18 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-98c410e5-e682-4452-b587-b76c0833d7d9 tempest-VolumesTestJSON-2040854454 None] Acquiring lock "cinder-quobyte-7f27d42d-bb7f-4959-8313-1c153eab63c5" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:41:18 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-98c410e5-e682-4452-b587-b76c0833d7d9 tempest-VolumesTestJSON-2040854454 None] Lock "cinder-quobyte-7f27d42d-bb7f-4959-8313-1c153eab63c5" acquired by "delete_volume" :: waited 0.038s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:41:18 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a48662-9e77-493c-afeb-711be3ba58d9]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:41:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-98c410e5-e682-4452-b587-b76c0833d7d9 tempest-VolumesTestJSON-2040854454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7f27d42d-bb7f-4959-8313-1c153eab63c5 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:41:18 devstack sudo[90946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7f27d42d-bb7f-4959-8313-1c153eab63c5 Sep 04 22:41:18 devstack sudo[90946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:41:18 devstack sudo[90946]: pam_unix(sudo:session): session closed for user root Sep 04 22:41:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-98c410e5-e682-4452-b587-b76c0833d7d9 tempest-VolumesTestJSON-2040854454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7f27d42d-bb7f-4959-8313-1c153eab63c5" returned: 0 in 0.582s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:41:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-98c410e5-e682-4452-b587-b76c0833d7d9 tempest-VolumesTestJSON-2040854454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7f27d42d-bb7f-4959-8313-1c153eab63c5 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:41:18 devstack sudo[90972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7f27d42d-bb7f-4959-8313-1c153eab63c5 Sep 04 22:41:18 devstack sudo[90972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:41:19 devstack sudo[90972]: pam_unix(sudo:session): session closed for user root Sep 04 22:41:19 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-98c410e5-e682-4452-b587-b76c0833d7d9 tempest-VolumesTestJSON-2040854454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7f27d42d-bb7f-4959-8313-1c153eab63c5" returned: 0 in 0.297s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:41:19 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-98c410e5-e682-4452-b587-b76c0833d7d9 tempest-VolumesTestJSON-2040854454 None] Lock "cinder-quobyte-7f27d42d-bb7f-4959-8313-1c153eab63c5" released by "delete_volume" :: held 0.979s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:41:19 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-98c410e5-e682-4452-b587-b76c0833d7d9 tempest-VolumesTestJSON-2040854454 None] Created reservations ['6be25d06-b24e-469e-9e9e-a7f97b63ce77', '4d2ea769-2054-4a06-b279-b8e8d1685d3f', '900ce2b7-5456-42d4-9c76-4724449bc7ce', 'e6167f2a-2cf7-4776-999c-30bea136fc02'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:41:19 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-98c410e5-e682-4452-b587-b76c0833d7d9 tempest-VolumesTestJSON-2040854454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:41:19 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-98c410e5-e682-4452-b587-b76c0833d7d9 tempest-VolumesTestJSON-2040854454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:41:19 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-98c410e5-e682-4452-b587-b76c0833d7d9 tempest-VolumesTestJSON-2040854454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:41:19 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-98c410e5-e682-4452-b587-b76c0833d7d9 tempest-VolumesTestJSON-2040854454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:41:19 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-98c410e5-e682-4452-b587-b76c0833d7d9 tempest-VolumesTestJSON-2040854454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:41:19 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-98c410e5-e682-4452-b587-b76c0833d7d9 tempest-VolumesTestJSON-2040854454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:41:19 devstack sudo[90975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:41:19 devstack sudo[90975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:41:19 devstack sudo[90975]: pam_unix(sudo:session): session closed for user root Sep 04 22:41:19 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-98c410e5-e682-4452-b587-b76c0833d7d9 tempest-VolumesTestJSON-2040854454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.292s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:41:19 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-98c410e5-e682-4452-b587-b76c0833d7d9 tempest-VolumesTestJSON-2040854454 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:41:19 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-98c410e5-e682-4452-b587-b76c0833d7d9 tempest-VolumesTestJSON-2040854454 None] Deleted volume successfully. Sep 04 22:41:19 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-98c410e5-e682-4452-b587-b76c0833d7d9 tempest-VolumesTestJSON-2040854454 None] Lock "cinder-7f27d42d-bb7f-4959-8313-1c153eab63c5-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:41:20 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-0d0dc9e0-cae6-44d0-87e3-ba288c817ceb tempest-VolumesTestJSON-2040854454 None] Acquiring lock "cinder-549dde58-a0bb-4fcd-b0f0-8873ed4f40b2-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:41:20 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-0d0dc9e0-cae6-44d0-87e3-ba288c817ceb tempest-VolumesTestJSON-2040854454 None] Lock "cinder-549dde58-a0bb-4fcd-b0f0-8873ed4f40b2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:41:20 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-0d0dc9e0-cae6-44d0-87e3-ba288c817ceb tempest-VolumesTestJSON-2040854454 None] Acquiring lock "cinder-quobyte-549dde58-a0bb-4fcd-b0f0-8873ed4f40b2" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:41:20 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-0d0dc9e0-cae6-44d0-87e3-ba288c817ceb tempest-VolumesTestJSON-2040854454 None] Lock "cinder-quobyte-549dde58-a0bb-4fcd-b0f0-8873ed4f40b2" acquired by "delete_volume" :: waited 0.027s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:41:20 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8af990-af0a-48d5-8178-742c86173c42]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:41:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0d0dc9e0-cae6-44d0-87e3-ba288c817ceb tempest-VolumesTestJSON-2040854454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-549dde58-a0bb-4fcd-b0f0-8873ed4f40b2 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:41:20 devstack sudo[90978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-549dde58-a0bb-4fcd-b0f0-8873ed4f40b2 Sep 04 22:41:20 devstack sudo[90978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:41:20 devstack sudo[90978]: pam_unix(sudo:session): session closed for user root Sep 04 22:41:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0d0dc9e0-cae6-44d0-87e3-ba288c817ceb tempest-VolumesTestJSON-2040854454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-549dde58-a0bb-4fcd-b0f0-8873ed4f40b2" returned: 0 in 0.459s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:41:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0d0dc9e0-cae6-44d0-87e3-ba288c817ceb tempest-VolumesTestJSON-2040854454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-549dde58-a0bb-4fcd-b0f0-8873ed4f40b2 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:41:20 devstack sudo[90983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-549dde58-a0bb-4fcd-b0f0-8873ed4f40b2 Sep 04 22:41:20 devstack sudo[90983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:41:20 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d9ab316-c7f5-490b-9a27-f5042b6da3a9 tempest-VolumesMetadataTest-420102196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:41:20 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-4d9ab316-c7f5-490b-9a27-f5042b6da3a9 tempest-VolumesMetadataTest-420102196 None] Flow 'volume_create_manager' (04d8ca75-3911-4914-a5d9-c5f75e099d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:41:20 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-4d9ab316-c7f5-490b-9a27-f5042b6da3a9 tempest-VolumesMetadataTest-420102196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a2db2ad-697d-4794-92f9-ae182534a9f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:41:20 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-4d9ab316-c7f5-490b-9a27-f5042b6da3a9 tempest-VolumesMetadataTest-420102196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a2db2ad-697d-4794-92f9-ae182534a9f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:41:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-211287483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63d47d51-a003-496b-9589-310482f68935,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4a96c7d464445659583d4771ca6604c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:41:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:41:21Z,use_quota=True,user_id='22dfe194b16b4f13886f6e8db01e43a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:41:20 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-4d9ab316-c7f5-490b-9a27-f5042b6da3a9 tempest-VolumesMetadataTest-420102196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8530fca3-1a7a-482a-a215-5080597a74f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:41:20 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-4d9ab316-c7f5-490b-9a27-f5042b6da3a9 tempest-VolumesMetadataTest-420102196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8530fca3-1a7a-482a-a215-5080597a74f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:41:20 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-4d9ab316-c7f5-490b-9a27-f5042b6da3a9 tempest-VolumesMetadataTest-420102196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7e71a06-b656-493b-ba96-2d4d114a013e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:41:20 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-4d9ab316-c7f5-490b-9a27-f5042b6da3a9 tempest-VolumesMetadataTest-420102196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7e71a06-b656-493b-ba96-2d4d114a013e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63d47d51-a003-496b-9589-310482f68935', 'volume_name': 'volume-63d47d51-a003-496b-9589-310482f68935', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:41:20 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-4d9ab316-c7f5-490b-9a27-f5042b6da3a9 tempest-VolumesMetadataTest-420102196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba687d43-6fc3-4d43-9594-29fd75c47fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:41:20 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-4d9ab316-c7f5-490b-9a27-f5042b6da3a9 tempest-VolumesMetadataTest-420102196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba687d43-6fc3-4d43-9594-29fd75c47fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:41:20 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-4d9ab316-c7f5-490b-9a27-f5042b6da3a9 tempest-VolumesMetadataTest-420102196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4683a19c-775e-4a45-950a-5dc7d20e832f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:41:20 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-4d9ab316-c7f5-490b-9a27-f5042b6da3a9 tempest-VolumesMetadataTest-420102196 None] Volume 63d47d51-a003-496b-9589-310482f68935: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63d47d51-a003-496b-9589-310482f68935', 'volume_size': 1} Sep 04 22:41:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-4d9ab316-c7f5-490b-9a27-f5042b6da3a9 tempest-VolumesMetadataTest-420102196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:41:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-4d9ab316-c7f5-490b-9a27-f5042b6da3a9 tempest-VolumesMetadataTest-420102196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:41:20 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-4d9ab316-c7f5-490b-9a27-f5042b6da3a9 tempest-VolumesMetadataTest-420102196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:41:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-211287483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63d47d51-a003-496b-9589-310482f68935,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4a96c7d464445659583d4771ca6604c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:41:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:41:21Z,use_quota=True,user_id='22dfe194b16b4f13886f6e8db01e43a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:41:20 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-4d9ab316-c7f5-490b-9a27-f5042b6da3a9 tempest-VolumesMetadataTest-420102196 None] Creating volume 63d47d51-a003-496b-9589-310482f68935 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:41:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-4d9ab316-c7f5-490b-9a27-f5042b6da3a9 tempest-VolumesMetadataTest-420102196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:41:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-4d9ab316-c7f5-490b-9a27-f5042b6da3a9 tempest-VolumesMetadataTest-420102196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:41:20 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-4d9ab316-c7f5-490b-9a27-f5042b6da3a9 tempest-VolumesMetadataTest-420102196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:41:20 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-4d9ab316-c7f5-490b-9a27-f5042b6da3a9 tempest-VolumesMetadataTest-420102196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:41:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-4d9ab316-c7f5-490b-9a27-f5042b6da3a9 tempest-VolumesMetadataTest-420102196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:41:20 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-4d9ab316-c7f5-490b-9a27-f5042b6da3a9 tempest-VolumesMetadataTest-420102196 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:41:20 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-4d9ab316-c7f5-490b-9a27-f5042b6da3a9 tempest-VolumesMetadataTest-420102196 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:41:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4d9ab316-c7f5-490b-9a27-f5042b6da3a9 tempest-VolumesMetadataTest-420102196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-63d47d51-a003-496b-9589-310482f68935 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:41:21 devstack sudo[90985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-63d47d51-a003-496b-9589-310482f68935 1073741824 Sep 04 22:41:21 devstack sudo[90985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:41:21 devstack sudo[90983]: pam_unix(sudo:session): session closed for user root Sep 04 22:41:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0d0dc9e0-cae6-44d0-87e3-ba288c817ceb tempest-VolumesTestJSON-2040854454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-549dde58-a0bb-4fcd-b0f0-8873ed4f40b2" returned: 0 in 0.250s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:41:21 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-0d0dc9e0-cae6-44d0-87e3-ba288c817ceb tempest-VolumesTestJSON-2040854454 None] Lock "cinder-quobyte-549dde58-a0bb-4fcd-b0f0-8873ed4f40b2" released by "delete_volume" :: held 0.755s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:41:21 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-0d0dc9e0-cae6-44d0-87e3-ba288c817ceb tempest-VolumesTestJSON-2040854454 None] Created reservations ['44958f10-5097-4752-8905-55b4a279567a', 'f701b5ba-6888-4d89-ae2d-e255929aeb5e', '482fca43-fbc4-4c2b-83f2-b4fc837f80c7', '77511954-1ecd-420c-a918-f7e209c5089c'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:41:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-0d0dc9e0-cae6-44d0-87e3-ba288c817ceb tempest-VolumesTestJSON-2040854454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:41:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-0d0dc9e0-cae6-44d0-87e3-ba288c817ceb tempest-VolumesTestJSON-2040854454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:41:21 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-0d0dc9e0-cae6-44d0-87e3-ba288c817ceb tempest-VolumesTestJSON-2040854454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:41:21 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-0d0dc9e0-cae6-44d0-87e3-ba288c817ceb tempest-VolumesTestJSON-2040854454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:41:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-0d0dc9e0-cae6-44d0-87e3-ba288c817ceb tempest-VolumesTestJSON-2040854454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:41:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0d0dc9e0-cae6-44d0-87e3-ba288c817ceb tempest-VolumesTestJSON-2040854454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:41:21 devstack sudo[90991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:41:21 devstack sudo[90991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:41:21 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-0bf91634-1a01-4360-a16e-b0aed9951a5a tempest-VolumesTestJSON-2040854454 None] Acquiring lock "cinder-e1081fa4-c5c6-4847-a5a0-e2ebb5439bb5-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:41:21 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-0bf91634-1a01-4360-a16e-b0aed9951a5a tempest-VolumesTestJSON-2040854454 None] Lock "cinder-e1081fa4-c5c6-4847-a5a0-e2ebb5439bb5-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:41:21 devstack sudo[90985]: pam_unix(sudo:session): session closed for user root Sep 04 22:41:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4d9ab316-c7f5-490b-9a27-f5042b6da3a9 tempest-VolumesMetadataTest-420102196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-63d47d51-a003-496b-9589-310482f68935 1073741824" returned: 0 in 0.520s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:41:21 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-0bf91634-1a01-4360-a16e-b0aed9951a5a tempest-VolumesTestJSON-2040854454 None] Acquiring lock "cinder-quobyte-e1081fa4-c5c6-4847-a5a0-e2ebb5439bb5" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:41:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4d9ab316-c7f5-490b-9a27-f5042b6da3a9 tempest-VolumesMetadataTest-420102196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-63d47d51-a003-496b-9589-310482f68935 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:41:21 devstack sudo[90991]: pam_unix(sudo:session): session closed for user root Sep 04 22:41:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0d0dc9e0-cae6-44d0-87e3-ba288c817ceb tempest-VolumesTestJSON-2040854454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.363s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:41:21 devstack sudo[90995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-63d47d51-a003-496b-9589-310482f68935 Sep 04 22:41:21 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-0d0dc9e0-cae6-44d0-87e3-ba288c817ceb tempest-VolumesTestJSON-2040854454 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:41:21 devstack sudo[90995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:41:21 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-0bf91634-1a01-4360-a16e-b0aed9951a5a tempest-VolumesTestJSON-2040854454 None] Lock "cinder-quobyte-e1081fa4-c5c6-4847-a5a0-e2ebb5439bb5" acquired by "delete_volume" :: waited 0.044s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:41:21 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-0d0dc9e0-cae6-44d0-87e3-ba288c817ceb tempest-VolumesTestJSON-2040854454 None] Deleted volume successfully. Sep 04 22:41:21 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fade4c2-6e49-4a51-ae78-185ae8e85fc3]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:41:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0bf91634-1a01-4360-a16e-b0aed9951a5a tempest-VolumesTestJSON-2040854454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1081fa4-c5c6-4847-a5a0-e2ebb5439bb5 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:41:21 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-0d0dc9e0-cae6-44d0-87e3-ba288c817ceb tempest-VolumesTestJSON-2040854454 None] Lock "cinder-549dde58-a0bb-4fcd-b0f0-8873ed4f40b2-delete_volume" released by "delete_volume" :: held 1.414s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:41:21 devstack sudo[90997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1081fa4-c5c6-4847-a5a0-e2ebb5439bb5 Sep 04 22:41:21 devstack sudo[90997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:41:21 devstack sudo[90995]: pam_unix(sudo:session): session closed for user root Sep 04 22:41:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4d9ab316-c7f5-490b-9a27-f5042b6da3a9 tempest-VolumesMetadataTest-420102196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-63d47d51-a003-496b-9589-310482f68935" returned: 0 in 0.304s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:41:21 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-4d9ab316-c7f5-490b-9a27-f5042b6da3a9 tempest-VolumesMetadataTest-420102196 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:41:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-4d9ab316-c7f5-490b-9a27-f5042b6da3a9 tempest-VolumesMetadataTest-420102196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:41:21 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-4d9ab316-c7f5-490b-9a27-f5042b6da3a9 tempest-VolumesMetadataTest-420102196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4683a19c-775e-4a45-950a-5dc7d20e832f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63d47d51-a003-496b-9589-310482f68935', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:41:21 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-4d9ab316-c7f5-490b-9a27-f5042b6da3a9 tempest-VolumesMetadataTest-420102196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1922a98-37b2-44d4-b699-294de614fc7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:41:21 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-4d9ab316-c7f5-490b-9a27-f5042b6da3a9 tempest-VolumesMetadataTest-420102196 None] Volume volume-63d47d51-a003-496b-9589-310482f68935 (63d47d51-a003-496b-9589-310482f68935): created successfully Sep 04 22:41:21 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-4d9ab316-c7f5-490b-9a27-f5042b6da3a9 tempest-VolumesMetadataTest-420102196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1922a98-37b2-44d4-b699-294de614fc7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:41:21 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-4d9ab316-c7f5-490b-9a27-f5042b6da3a9 tempest-VolumesMetadataTest-420102196 None] Flow 'volume_create_manager' (04d8ca75-3911-4914-a5d9-c5f75e099d8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:41:21 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-4d9ab316-c7f5-490b-9a27-f5042b6da3a9 tempest-VolumesMetadataTest-420102196 None] Created volume successfully. Sep 04 22:41:22 devstack sudo[90997]: pam_unix(sudo:session): session closed for user root Sep 04 22:41:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0bf91634-1a01-4360-a16e-b0aed9951a5a tempest-VolumesTestJSON-2040854454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1081fa4-c5c6-4847-a5a0-e2ebb5439bb5" returned: 0 in 0.429s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:41:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0bf91634-1a01-4360-a16e-b0aed9951a5a tempest-VolumesTestJSON-2040854454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1081fa4-c5c6-4847-a5a0-e2ebb5439bb5 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:41:22 devstack sudo[91006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1081fa4-c5c6-4847-a5a0-e2ebb5439bb5 Sep 04 22:41:22 devstack sudo[91006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:41:22 devstack sudo[91006]: pam_unix(sudo:session): session closed for user root Sep 04 22:41:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0bf91634-1a01-4360-a16e-b0aed9951a5a tempest-VolumesTestJSON-2040854454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e1081fa4-c5c6-4847-a5a0-e2ebb5439bb5" returned: 0 in 0.254s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:41:22 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-0bf91634-1a01-4360-a16e-b0aed9951a5a tempest-VolumesTestJSON-2040854454 None] Lock "cinder-quobyte-e1081fa4-c5c6-4847-a5a0-e2ebb5439bb5" released by "delete_volume" :: held 0.745s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:41:22 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-0bf91634-1a01-4360-a16e-b0aed9951a5a tempest-VolumesTestJSON-2040854454 None] Created reservations ['2f61c53e-977e-46b7-8610-7a637ba233eb', '7965d6cb-47d7-46bb-8baa-a8a369e9d1f2', '1cd4215d-9066-46b1-8a2b-86a06426aa45', '47d098ce-2e48-45de-a5e7-bf7f3c34647a'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:41:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-0bf91634-1a01-4360-a16e-b0aed9951a5a tempest-VolumesTestJSON-2040854454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:41:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-0bf91634-1a01-4360-a16e-b0aed9951a5a tempest-VolumesTestJSON-2040854454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:41:22 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-0bf91634-1a01-4360-a16e-b0aed9951a5a tempest-VolumesTestJSON-2040854454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:41:22 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-0bf91634-1a01-4360-a16e-b0aed9951a5a tempest-VolumesTestJSON-2040854454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:41:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-0bf91634-1a01-4360-a16e-b0aed9951a5a tempest-VolumesTestJSON-2040854454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:41:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0bf91634-1a01-4360-a16e-b0aed9951a5a tempest-VolumesTestJSON-2040854454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:41:22 devstack sudo[91043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:41:22 devstack sudo[91043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:41:22 devstack sudo[91043]: pam_unix(sudo:session): session closed for user root Sep 04 22:41:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0bf91634-1a01-4360-a16e-b0aed9951a5a tempest-VolumesTestJSON-2040854454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.294s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:41:22 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-0bf91634-1a01-4360-a16e-b0aed9951a5a tempest-VolumesTestJSON-2040854454 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:41:22 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-0bf91634-1a01-4360-a16e-b0aed9951a5a tempest-VolumesTestJSON-2040854454 None] Deleted volume successfully. Sep 04 22:41:22 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-0bf91634-1a01-4360-a16e-b0aed9951a5a tempest-VolumesTestJSON-2040854454 None] Lock "cinder-e1081fa4-c5c6-4847-a5a0-e2ebb5439bb5-delete_volume" released by "delete_volume" :: held 1.375s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:41:23 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-710e18ae-625d-4973-b5c8-ada7d5809d67 tempest-VolumesMetadataTest-420102196 None] Acquiring lock "cinder-63d47d51-a003-496b-9589-310482f68935-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:41:23 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-710e18ae-625d-4973-b5c8-ada7d5809d67 tempest-VolumesMetadataTest-420102196 None] Lock "cinder-63d47d51-a003-496b-9589-310482f68935-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:41:23 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-710e18ae-625d-4973-b5c8-ada7d5809d67 tempest-VolumesMetadataTest-420102196 None] Acquiring lock "cinder-quobyte-63d47d51-a003-496b-9589-310482f68935" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:41:23 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-710e18ae-625d-4973-b5c8-ada7d5809d67 tempest-VolumesMetadataTest-420102196 None] Lock "cinder-quobyte-63d47d51-a003-496b-9589-310482f68935" acquired by "delete_volume" :: waited 0.016s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:41:23 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5752bd8-18c6-4cb9-8674-c323ed1c9d55]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:41:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-710e18ae-625d-4973-b5c8-ada7d5809d67 tempest-VolumesMetadataTest-420102196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-63d47d51-a003-496b-9589-310482f68935 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:41:24 devstack sudo[91046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-63d47d51-a003-496b-9589-310482f68935 Sep 04 22:41:24 devstack sudo[91046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:41:24 devstack sudo[91046]: pam_unix(sudo:session): session closed for user root Sep 04 22:41:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-710e18ae-625d-4973-b5c8-ada7d5809d67 tempest-VolumesMetadataTest-420102196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-63d47d51-a003-496b-9589-310482f68935" returned: 0 in 0.634s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:41:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-710e18ae-625d-4973-b5c8-ada7d5809d67 tempest-VolumesMetadataTest-420102196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-63d47d51-a003-496b-9589-310482f68935 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:41:24 devstack sudo[91051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-63d47d51-a003-496b-9589-310482f68935 Sep 04 22:41:24 devstack sudo[91051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:41:24 devstack sudo[91051]: pam_unix(sudo:session): session closed for user root Sep 04 22:41:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-710e18ae-625d-4973-b5c8-ada7d5809d67 tempest-VolumesMetadataTest-420102196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-63d47d51-a003-496b-9589-310482f68935" returned: 0 in 0.376s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:41:25 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-710e18ae-625d-4973-b5c8-ada7d5809d67 tempest-VolumesMetadataTest-420102196 None] Lock "cinder-quobyte-63d47d51-a003-496b-9589-310482f68935" released by "delete_volume" :: held 1.070s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:41:25 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-710e18ae-625d-4973-b5c8-ada7d5809d67 tempest-VolumesMetadataTest-420102196 None] Created reservations ['dc04bde7-565c-42ad-b8d2-8e487a293b56', '65be6dee-eb71-4c0e-bbbe-6be8e22bb251', 'e8adfa8a-c88a-45a4-9526-32fb6b9fd592', 'fe426b3c-0438-4667-9532-8784042eddfa'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:41:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-710e18ae-625d-4973-b5c8-ada7d5809d67 tempest-VolumesMetadataTest-420102196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:41:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-710e18ae-625d-4973-b5c8-ada7d5809d67 tempest-VolumesMetadataTest-420102196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:41:25 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-710e18ae-625d-4973-b5c8-ada7d5809d67 tempest-VolumesMetadataTest-420102196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:41:25 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-710e18ae-625d-4973-b5c8-ada7d5809d67 tempest-VolumesMetadataTest-420102196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:41:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-710e18ae-625d-4973-b5c8-ada7d5809d67 tempest-VolumesMetadataTest-420102196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:41:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-710e18ae-625d-4973-b5c8-ada7d5809d67 tempest-VolumesMetadataTest-420102196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:41:25 devstack sudo[91054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:41:25 devstack sudo[91054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:41:25 devstack sudo[91054]: pam_unix(sudo:session): session closed for user root Sep 04 22:41:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-710e18ae-625d-4973-b5c8-ada7d5809d67 tempest-VolumesMetadataTest-420102196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.385s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:41:25 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-710e18ae-625d-4973-b5c8-ada7d5809d67 tempest-VolumesMetadataTest-420102196 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:41:25 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-710e18ae-625d-4973-b5c8-ada7d5809d67 tempest-VolumesMetadataTest-420102196 None] Deleted volume successfully. Sep 04 22:41:25 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-710e18ae-625d-4973-b5c8-ada7d5809d67 tempest-VolumesMetadataTest-420102196 None] Lock "cinder-63d47d51-a003-496b-9589-310482f68935-delete_volume" released by "delete_volume" :: held 1.803s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:41:28 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-6da9afbf-5ea2-435d-b50f-7005eb9d7591 tempest-GroupSnapshotsTest-65893310 None] Group tempest-GroupSnapshotsTest-Group-909676768: creating Sep 04 22:41:28 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-6da9afbf-5ea2-435d-b50f-7005eb9d7591 tempest-GroupSnapshotsTest-65893310 None] Group tempest-GroupSnapshotsTest-Group-909676768: created successfully Sep 04 22:41:28 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-6da9afbf-5ea2-435d-b50f-7005eb9d7591 tempest-GroupSnapshotsTest-65893310 None] Create group completed successfully. Sep 04 22:41:30 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-debaa69b-d3e1-499f-b2f5-4fcb6b8c34f1 tempest-GroupSnapshotsTest-65893310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:41:30 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-debaa69b-d3e1-499f-b2f5-4fcb6b8c34f1 tempest-GroupSnapshotsTest-65893310 None] Flow 'volume_create_manager' (ae299e7a-6480-4d3c-b9eb-f021f9733414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:41:30 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-debaa69b-d3e1-499f-b2f5-4fcb6b8c34f1 tempest-GroupSnapshotsTest-65893310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd321e6b-3000-483b-a6e1-961cdacb3550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:41:30 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-debaa69b-d3e1-499f-b2f5-4fcb6b8c34f1 tempest-GroupSnapshotsTest-65893310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd321e6b-3000-483b-a6e1-961cdacb3550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:41:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1947691565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=95b0a65a-5fcd-4d89-bc5d-6c92eecf8349,host='devstack@QuobyteHD#QuobyteHD',id=635f8e92-9779-43e0-98a1-750c49fde2b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9461c1200b2c4eaa9020b032a95fc8b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:41:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:41:30Z,use_quota=True,user_id='ad160e737c8f4a2ea86584b02930cad0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0e1cab3-5832-47b0-a885-1ffda2988d4c),volume_type_id=f0e1cab3-5832-47b0-a885-1ffda2988d4c)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:41:30 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-debaa69b-d3e1-499f-b2f5-4fcb6b8c34f1 tempest-GroupSnapshotsTest-65893310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a698537b-f368-4fef-a36f-df966c6f9c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:41:30 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-debaa69b-d3e1-499f-b2f5-4fcb6b8c34f1 tempest-GroupSnapshotsTest-65893310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a698537b-f368-4fef-a36f-df966c6f9c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:41:30 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-debaa69b-d3e1-499f-b2f5-4fcb6b8c34f1 tempest-GroupSnapshotsTest-65893310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (289491ab-b118-41cb-af92-34fd72471d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:41:30 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-debaa69b-d3e1-499f-b2f5-4fcb6b8c34f1 tempest-GroupSnapshotsTest-65893310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (289491ab-b118-41cb-af92-34fd72471d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '635f8e92-9779-43e0-98a1-750c49fde2b0', 'volume_name': 'volume-635f8e92-9779-43e0-98a1-750c49fde2b0', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:41:30 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-debaa69b-d3e1-499f-b2f5-4fcb6b8c34f1 tempest-GroupSnapshotsTest-65893310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6431eb76-9798-44e0-a74d-91d941e1d70c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:41:30 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-debaa69b-d3e1-499f-b2f5-4fcb6b8c34f1 tempest-GroupSnapshotsTest-65893310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6431eb76-9798-44e0-a74d-91d941e1d70c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:41:30 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-debaa69b-d3e1-499f-b2f5-4fcb6b8c34f1 tempest-GroupSnapshotsTest-65893310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66249161-898c-4b3c-9522-bdbb007cdfc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:41:30 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-debaa69b-d3e1-499f-b2f5-4fcb6b8c34f1 tempest-GroupSnapshotsTest-65893310 None] Volume 635f8e92-9779-43e0-98a1-750c49fde2b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-635f8e92-9779-43e0-98a1-750c49fde2b0', 'volume_size': 1} Sep 04 22:41:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-debaa69b-d3e1-499f-b2f5-4fcb6b8c34f1 tempest-GroupSnapshotsTest-65893310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:41:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-debaa69b-d3e1-499f-b2f5-4fcb6b8c34f1 tempest-GroupSnapshotsTest-65893310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:41:30 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-debaa69b-d3e1-499f-b2f5-4fcb6b8c34f1 tempest-GroupSnapshotsTest-65893310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=95b0a65a-5fcd-4d89-bc5d-6c92eecf8349,created_at=2026-09-04T20:41:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1947691565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=95b0a65a-5fcd-4d89-bc5d-6c92eecf8349,host='devstack@QuobyteHD#QuobyteHD',id=635f8e92-9779-43e0-98a1-750c49fde2b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9461c1200b2c4eaa9020b032a95fc8b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:41:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:41:30Z,use_quota=True,user_id='ad160e737c8f4a2ea86584b02930cad0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0e1cab3-5832-47b0-a885-1ffda2988d4c),volume_type_id=f0e1cab3-5832-47b0-a885-1ffda2988d4c)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:41:30 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-debaa69b-d3e1-499f-b2f5-4fcb6b8c34f1 tempest-GroupSnapshotsTest-65893310 None] Creating volume 635f8e92-9779-43e0-98a1-750c49fde2b0 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:41:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-debaa69b-d3e1-499f-b2f5-4fcb6b8c34f1 tempest-GroupSnapshotsTest-65893310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:41:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-debaa69b-d3e1-499f-b2f5-4fcb6b8c34f1 tempest-GroupSnapshotsTest-65893310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:41:30 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-debaa69b-d3e1-499f-b2f5-4fcb6b8c34f1 tempest-GroupSnapshotsTest-65893310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:41:30 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-debaa69b-d3e1-499f-b2f5-4fcb6b8c34f1 tempest-GroupSnapshotsTest-65893310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:41:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-debaa69b-d3e1-499f-b2f5-4fcb6b8c34f1 tempest-GroupSnapshotsTest-65893310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:41:30 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-debaa69b-d3e1-499f-b2f5-4fcb6b8c34f1 tempest-GroupSnapshotsTest-65893310 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:41:30 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-debaa69b-d3e1-499f-b2f5-4fcb6b8c34f1 tempest-GroupSnapshotsTest-65893310 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:41:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-debaa69b-d3e1-499f-b2f5-4fcb6b8c34f1 tempest-GroupSnapshotsTest-65893310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-635f8e92-9779-43e0-98a1-750c49fde2b0 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:41:30 devstack sudo[91060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-635f8e92-9779-43e0-98a1-750c49fde2b0 1073741824 Sep 04 22:41:30 devstack sudo[91060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:41:30 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-56a156f8-e5b3-4775-bae2-25a271793e7b tempest-ServerActionsTestOtherA-1336516134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:41:30 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-56a156f8-e5b3-4775-bae2-25a271793e7b tempest-ServerActionsTestOtherA-1336516134 None] Flow 'volume_create_manager' (d26af36d-82af-49a0-bf4c-3a2d6a6eadac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:41:30 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-56a156f8-e5b3-4775-bae2-25a271793e7b tempest-ServerActionsTestOtherA-1336516134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (365f9079-94e0-4e5e-b7f5-7ad35454b2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:41:30 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-56a156f8-e5b3-4775-bae2-25a271793e7b tempest-ServerActionsTestOtherA-1336516134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (365f9079-94e0-4e5e-b7f5-7ad35454b2ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:41:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-590532031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=281ffbed-1bd7-47c6-80d4-f79b85b22826,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fdc6bad46ef4979817afa54137f7e3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:41:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:41:30Z,use_quota=True,user_id='84e4821e04cd47f3b97da2e72e0586f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:41:30 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-56a156f8-e5b3-4775-bae2-25a271793e7b tempest-ServerActionsTestOtherA-1336516134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2f39928-5c5a-4486-84b7-7761c1202500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:41:30 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-56a156f8-e5b3-4775-bae2-25a271793e7b tempest-ServerActionsTestOtherA-1336516134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2f39928-5c5a-4486-84b7-7761c1202500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:41:30 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-56a156f8-e5b3-4775-bae2-25a271793e7b tempest-ServerActionsTestOtherA-1336516134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2f62d3f-d9ec-401c-aae5-eb052d82e3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:41:30 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-56a156f8-e5b3-4775-bae2-25a271793e7b tempest-ServerActionsTestOtherA-1336516134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2f62d3f-d9ec-401c-aae5-eb052d82e3c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '281ffbed-1bd7-47c6-80d4-f79b85b22826', 'volume_name': 'volume-281ffbed-1bd7-47c6-80d4-f79b85b22826', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:41:30 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-56a156f8-e5b3-4775-bae2-25a271793e7b tempest-ServerActionsTestOtherA-1336516134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fdfb0b2-5a13-48dd-912b-f2a4d5003cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:41:30 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-56a156f8-e5b3-4775-bae2-25a271793e7b tempest-ServerActionsTestOtherA-1336516134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fdfb0b2-5a13-48dd-912b-f2a4d5003cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:41:30 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-56a156f8-e5b3-4775-bae2-25a271793e7b tempest-ServerActionsTestOtherA-1336516134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b2b39be-1689-4660-a67a-cb478000a065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:41:30 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-56a156f8-e5b3-4775-bae2-25a271793e7b tempest-ServerActionsTestOtherA-1336516134 None] Volume 281ffbed-1bd7-47c6-80d4-f79b85b22826: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-281ffbed-1bd7-47c6-80d4-f79b85b22826', 'volume_size': 1} Sep 04 22:41:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-56a156f8-e5b3-4775-bae2-25a271793e7b tempest-ServerActionsTestOtherA-1336516134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:41:31 devstack sudo[91060]: pam_unix(sudo:session): session closed for user root Sep 04 22:41:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-debaa69b-d3e1-499f-b2f5-4fcb6b8c34f1 tempest-GroupSnapshotsTest-65893310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-635f8e92-9779-43e0-98a1-750c49fde2b0 1073741824" returned: 0 in 0.705s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:41:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-debaa69b-d3e1-499f-b2f5-4fcb6b8c34f1 tempest-GroupSnapshotsTest-65893310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-635f8e92-9779-43e0-98a1-750c49fde2b0 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:41:31 devstack sudo[91069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-635f8e92-9779-43e0-98a1-750c49fde2b0 Sep 04 22:41:31 devstack sudo[91069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:41:31 devstack sudo[91069]: pam_unix(sudo:session): session closed for user root Sep 04 22:41:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-debaa69b-d3e1-499f-b2f5-4fcb6b8c34f1 tempest-GroupSnapshotsTest-65893310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-635f8e92-9779-43e0-98a1-750c49fde2b0" returned: 0 in 0.541s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:41:31 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-debaa69b-d3e1-499f-b2f5-4fcb6b8c34f1 tempest-GroupSnapshotsTest-65893310 None] <== create_volume: return (1303ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:41:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-debaa69b-d3e1-499f-b2f5-4fcb6b8c34f1 tempest-GroupSnapshotsTest-65893310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.307s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:41:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-56a156f8-e5b3-4775-bae2-25a271793e7b tempest-ServerActionsTestOtherA-1336516134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.033s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:41:31 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-56a156f8-e5b3-4775-bae2-25a271793e7b tempest-ServerActionsTestOtherA-1336516134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:41:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-590532031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=281ffbed-1bd7-47c6-80d4-f79b85b22826,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fdc6bad46ef4979817afa54137f7e3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:41:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:41:30Z,use_quota=True,user_id='84e4821e04cd47f3b97da2e72e0586f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:41:31 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-56a156f8-e5b3-4775-bae2-25a271793e7b tempest-ServerActionsTestOtherA-1336516134 None] Creating volume 281ffbed-1bd7-47c6-80d4-f79b85b22826 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:41:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-56a156f8-e5b3-4775-bae2-25a271793e7b tempest-ServerActionsTestOtherA-1336516134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:41:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-56a156f8-e5b3-4775-bae2-25a271793e7b tempest-ServerActionsTestOtherA-1336516134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:41:31 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-56a156f8-e5b3-4775-bae2-25a271793e7b tempest-ServerActionsTestOtherA-1336516134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:41:31 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-56a156f8-e5b3-4775-bae2-25a271793e7b tempest-ServerActionsTestOtherA-1336516134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:41:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-56a156f8-e5b3-4775-bae2-25a271793e7b tempest-ServerActionsTestOtherA-1336516134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:41:31 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-56a156f8-e5b3-4775-bae2-25a271793e7b tempest-ServerActionsTestOtherA-1336516134 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:41:31 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-56a156f8-e5b3-4775-bae2-25a271793e7b tempest-ServerActionsTestOtherA-1336516134 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:41:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-56a156f8-e5b3-4775-bae2-25a271793e7b tempest-ServerActionsTestOtherA-1336516134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-281ffbed-1bd7-47c6-80d4-f79b85b22826 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:41:31 devstack sudo[91072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-281ffbed-1bd7-47c6-80d4-f79b85b22826 1073741824 Sep 04 22:41:31 devstack sudo[91072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:41:31 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-debaa69b-d3e1-499f-b2f5-4fcb6b8c34f1 tempest-GroupSnapshotsTest-65893310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66249161-898c-4b3c-9522-bdbb007cdfc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-635f8e92-9779-43e0-98a1-750c49fde2b0', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:41:31 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-debaa69b-d3e1-499f-b2f5-4fcb6b8c34f1 tempest-GroupSnapshotsTest-65893310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f17d524-257a-4f30-949c-963331c4deef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:41:31 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-debaa69b-d3e1-499f-b2f5-4fcb6b8c34f1 tempest-GroupSnapshotsTest-65893310 None] Volume volume-635f8e92-9779-43e0-98a1-750c49fde2b0 (635f8e92-9779-43e0-98a1-750c49fde2b0): created successfully Sep 04 22:41:31 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-debaa69b-d3e1-499f-b2f5-4fcb6b8c34f1 tempest-GroupSnapshotsTest-65893310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f17d524-257a-4f30-949c-963331c4deef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:41:31 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-debaa69b-d3e1-499f-b2f5-4fcb6b8c34f1 tempest-GroupSnapshotsTest-65893310 None] Flow 'volume_create_manager' (ae299e7a-6480-4d3c-b9eb-f021f9733414) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:41:31 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-debaa69b-d3e1-499f-b2f5-4fcb6b8c34f1 tempest-GroupSnapshotsTest-65893310 None] Created volume successfully. Sep 04 22:41:32 devstack sudo[91072]: pam_unix(sudo:session): session closed for user root Sep 04 22:41:32 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-56a156f8-e5b3-4775-bae2-25a271793e7b tempest-ServerActionsTestOtherA-1336516134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-281ffbed-1bd7-47c6-80d4-f79b85b22826 1073741824" returned: 0 in 0.685s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:41:32 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-56a156f8-e5b3-4775-bae2-25a271793e7b tempest-ServerActionsTestOtherA-1336516134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-281ffbed-1bd7-47c6-80d4-f79b85b22826 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:41:32 devstack sudo[91083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-281ffbed-1bd7-47c6-80d4-f79b85b22826 Sep 04 22:41:32 devstack sudo[91083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:41:33 devstack sudo[91083]: pam_unix(sudo:session): session closed for user root Sep 04 22:41:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-56a156f8-e5b3-4775-bae2-25a271793e7b tempest-ServerActionsTestOtherA-1336516134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-281ffbed-1bd7-47c6-80d4-f79b85b22826" returned: 0 in 0.628s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:41:33 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-56a156f8-e5b3-4775-bae2-25a271793e7b tempest-ServerActionsTestOtherA-1336516134 None] <== create_volume: return (1418ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:41:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-56a156f8-e5b3-4775-bae2-25a271793e7b tempest-ServerActionsTestOtherA-1336516134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.428s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:41:33 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-56a156f8-e5b3-4775-bae2-25a271793e7b tempest-ServerActionsTestOtherA-1336516134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b2b39be-1689-4660-a67a-cb478000a065) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-281ffbed-1bd7-47c6-80d4-f79b85b22826', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:41:33 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-56a156f8-e5b3-4775-bae2-25a271793e7b tempest-ServerActionsTestOtherA-1336516134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96ba77b6-2787-49d8-9501-1aa97c176035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:41:33 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-a29439b3-49b7-48b0-bbcf-c68843b0c0a1 tempest-GroupSnapshotsTest-65893310 None] GroupSnapshot 72dc012f-eb12-43ad-b145-fd67308a2ad8: creating. Sep 04 22:41:33 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-56a156f8-e5b3-4775-bae2-25a271793e7b tempest-ServerActionsTestOtherA-1336516134 None] Volume volume-281ffbed-1bd7-47c6-80d4-f79b85b22826 (281ffbed-1bd7-47c6-80d4-f79b85b22826): created successfully Sep 04 22:41:33 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-56a156f8-e5b3-4775-bae2-25a271793e7b tempest-ServerActionsTestOtherA-1336516134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96ba77b6-2787-49d8-9501-1aa97c176035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:41:33 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-56a156f8-e5b3-4775-bae2-25a271793e7b tempest-ServerActionsTestOtherA-1336516134 None] Flow 'volume_create_manager' (d26af36d-82af-49a0-bf4c-3a2d6a6eadac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:41:33 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-56a156f8-e5b3-4775-bae2-25a271793e7b tempest-ServerActionsTestOtherA-1336516134 None] Created volume successfully. Sep 04 22:41:33 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-a29439b3-49b7-48b0-bbcf-c68843b0c0a1 tempest-GroupSnapshotsTest-65893310 None] Group snapshot 72dc012f-eb12-43ad-b145-fd67308a2ad8: creating. {{(pid=87576) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 04 22:41:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-a29439b3-49b7-48b0-bbcf-c68843b0c0a1 tempest-GroupSnapshotsTest-65893310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:41:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-a29439b3-49b7-48b0-bbcf-c68843b0c0a1 tempest-GroupSnapshotsTest-65893310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:41:33 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-a29439b3-49b7-48b0-bbcf-c68843b0c0a1 tempest-GroupSnapshotsTest-65893310 None] Creating offline snapshot 8714b2e6-4637-4025-abca-5519c5cbd2ec of volume 635f8e92-9779-43e0-98a1-750c49fde2b0 {{(pid=87576) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 22:41:33 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3ffd21-e389-4f89-ab0a-3744ad9be3ea]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:41:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a29439b3-49b7-48b0-bbcf-c68843b0c0a1 tempest-GroupSnapshotsTest-65893310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-635f8e92-9779-43e0-98a1-750c49fde2b0 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:41:33 devstack sudo[91088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-635f8e92-9779-43e0-98a1-750c49fde2b0 Sep 04 22:41:33 devstack sudo[91088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:41:34 devstack sudo[91088]: pam_unix(sudo:session): session closed for user root Sep 04 22:41:34 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a29439b3-49b7-48b0-bbcf-c68843b0c0a1 tempest-GroupSnapshotsTest-65893310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-635f8e92-9779-43e0-98a1-750c49fde2b0" returned: 0 in 0.787s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:41:34 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a29439b3-49b7-48b0-bbcf-c68843b0c0a1 tempest-GroupSnapshotsTest-65893310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-635f8e92-9779-43e0-98a1-750c49fde2b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-635f8e92-9779-43e0-98a1-750c49fde2b0.8714b2e6-4637-4025-abca-5519c5cbd2ec 1G {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:41:34 devstack sudo[91099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-635f8e92-9779-43e0-98a1-750c49fde2b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-635f8e92-9779-43e0-98a1-750c49fde2b0.8714b2e6-4637-4025-abca-5519c5cbd2ec 1G Sep 04 22:41:34 devstack sudo[91099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:41:34 devstack sudo[91099]: pam_unix(sudo:session): session closed for user root Sep 04 22:41:34 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a29439b3-49b7-48b0-bbcf-c68843b0c0a1 tempest-GroupSnapshotsTest-65893310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-635f8e92-9779-43e0-98a1-750c49fde2b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-635f8e92-9779-43e0-98a1-750c49fde2b0.8714b2e6-4637-4025-abca-5519c5cbd2ec 1G" returned: 0 in 0.784s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:41:34 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a29439b3-49b7-48b0-bbcf-c68843b0c0a1 tempest-GroupSnapshotsTest-65893310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-635f8e92-9779-43e0-98a1-750c49fde2b0 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-635f8e92-9779-43e0-98a1-750c49fde2b0.8714b2e6-4637-4025-abca-5519c5cbd2ec {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:41:34 devstack sudo[91118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-635f8e92-9779-43e0-98a1-750c49fde2b0 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-635f8e92-9779-43e0-98a1-750c49fde2b0.8714b2e6-4637-4025-abca-5519c5cbd2ec Sep 04 22:41:34 devstack sudo[91118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:41:35 devstack sudo[91118]: pam_unix(sudo:session): session closed for user root Sep 04 22:41:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a29439b3-49b7-48b0-bbcf-c68843b0c0a1 tempest-GroupSnapshotsTest-65893310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-635f8e92-9779-43e0-98a1-750c49fde2b0 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-635f8e92-9779-43e0-98a1-750c49fde2b0.8714b2e6-4637-4025-abca-5519c5cbd2ec" returned: 0 in 0.462s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:41:35 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-a29439b3-49b7-48b0-bbcf-c68843b0c0a1 tempest-GroupSnapshotsTest-65893310 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-635f8e92-9779-43e0-98a1-750c49fde2b0.8714b2e6-4637-4025-abca-5519c5cbd2ec is being set with open permissions: ugo+rw: NotImplementedError Sep 04 22:41:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a29439b3-49b7-48b0-bbcf-c68843b0c0a1 tempest-GroupSnapshotsTest-65893310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-635f8e92-9779-43e0-98a1-750c49fde2b0.8714b2e6-4637-4025-abca-5519c5cbd2ec {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:41:35 devstack sudo[91127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-635f8e92-9779-43e0-98a1-750c49fde2b0.8714b2e6-4637-4025-abca-5519c5cbd2ec Sep 04 22:41:35 devstack sudo[91127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:41:35 devstack sudo[91127]: pam_unix(sudo:session): session closed for user root Sep 04 22:41:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a29439b3-49b7-48b0-bbcf-c68843b0c0a1 tempest-GroupSnapshotsTest-65893310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-635f8e92-9779-43e0-98a1-750c49fde2b0.8714b2e6-4637-4025-abca-5519c5cbd2ec" returned: 0 in 0.399s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:41:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a29439b3-49b7-48b0-bbcf-c68843b0c0a1 tempest-GroupSnapshotsTest-65893310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-635f8e92-9779-43e0-98a1-750c49fde2b0.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:41:35 devstack sudo[91139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-635f8e92-9779-43e0-98a1-750c49fde2b0.info Sep 04 22:41:35 devstack sudo[91139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:41:36 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b8089b4-927f-46b8-9bd3-88b40a06796c tempest-VolumesTransfersTest-553609294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:41:36 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3b8089b4-927f-46b8-9bd3-88b40a06796c tempest-VolumesTransfersTest-553609294 None] Flow 'volume_create_manager' (565c860e-fd7d-41ab-9476-5a3e02a45ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:41:36 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3b8089b4-927f-46b8-9bd3-88b40a06796c tempest-VolumesTransfersTest-553609294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeed6cbe-2c18-49cd-8d80-f5594184d696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:41:36 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3b8089b4-927f-46b8-9bd3-88b40a06796c tempest-VolumesTransfersTest-553609294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeed6cbe-2c18-49cd-8d80-f5594184d696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:41:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-415164180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7be875fb-47dd-4497-9f19-ed0950225b01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21bfefdd423b4642ba0d6c990d66ae61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:41:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:41:36Z,use_quota=True,user_id='2f776374599d482ca94fed4c2a3df107',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:41:36 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3b8089b4-927f-46b8-9bd3-88b40a06796c tempest-VolumesTransfersTest-553609294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d8d5fea-384f-4017-ac66-1192519bfc06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:41:36 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3b8089b4-927f-46b8-9bd3-88b40a06796c tempest-VolumesTransfersTest-553609294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d8d5fea-384f-4017-ac66-1192519bfc06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:41:36 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3b8089b4-927f-46b8-9bd3-88b40a06796c tempest-VolumesTransfersTest-553609294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ff802cd-8d22-4409-bba3-e11666b4d07c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:41:36 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3b8089b4-927f-46b8-9bd3-88b40a06796c tempest-VolumesTransfersTest-553609294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ff802cd-8d22-4409-bba3-e11666b4d07c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7be875fb-47dd-4497-9f19-ed0950225b01', 'volume_name': 'volume-7be875fb-47dd-4497-9f19-ed0950225b01', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:41:36 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3b8089b4-927f-46b8-9bd3-88b40a06796c tempest-VolumesTransfersTest-553609294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a6080b3-dc60-4916-a274-63119537fa19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:41:36 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3b8089b4-927f-46b8-9bd3-88b40a06796c tempest-VolumesTransfersTest-553609294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a6080b3-dc60-4916-a274-63119537fa19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:41:36 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3b8089b4-927f-46b8-9bd3-88b40a06796c tempest-VolumesTransfersTest-553609294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca8b08b8-9e2c-4b31-a679-d22b7c8201db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:41:36 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-3b8089b4-927f-46b8-9bd3-88b40a06796c tempest-VolumesTransfersTest-553609294 None] Volume 7be875fb-47dd-4497-9f19-ed0950225b01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7be875fb-47dd-4497-9f19-ed0950225b01', 'volume_size': 1} Sep 04 22:41:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-3b8089b4-927f-46b8-9bd3-88b40a06796c tempest-VolumesTransfersTest-553609294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:41:36 devstack sudo[91139]: pam_unix(sudo:session): session closed for user root Sep 04 22:41:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a29439b3-49b7-48b0-bbcf-c68843b0c0a1 tempest-GroupSnapshotsTest-65893310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-635f8e92-9779-43e0-98a1-750c49fde2b0.info" returned: 0 in 0.467s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:41:36 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-a29439b3-49b7-48b0-bbcf-c68843b0c0a1 tempest-GroupSnapshotsTest-65893310 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-635f8e92-9779-43e0-98a1-750c49fde2b0.info is being set with open permissions: ugo+rw: NotImplementedError Sep 04 22:41:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a29439b3-49b7-48b0-bbcf-c68843b0c0a1 tempest-GroupSnapshotsTest-65893310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-635f8e92-9779-43e0-98a1-750c49fde2b0.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:41:36 devstack sudo[91145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-635f8e92-9779-43e0-98a1-750c49fde2b0.info Sep 04 22:41:36 devstack sudo[91145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:41:36 devstack sudo[91145]: pam_unix(sudo:session): session closed for user root Sep 04 22:41:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a29439b3-49b7-48b0-bbcf-c68843b0c0a1 tempest-GroupSnapshotsTest-65893310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-635f8e92-9779-43e0-98a1-750c49fde2b0.info" returned: 0 in 0.307s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:41:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-a29439b3-49b7-48b0-bbcf-c68843b0c0a1 tempest-GroupSnapshotsTest-65893310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.369s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:41:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-3b8089b4-927f-46b8-9bd3-88b40a06796c tempest-VolumesTransfersTest-553609294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.407s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:41:36 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-3b8089b4-927f-46b8-9bd3-88b40a06796c tempest-VolumesTransfersTest-553609294 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:41:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-415164180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7be875fb-47dd-4497-9f19-ed0950225b01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21bfefdd423b4642ba0d6c990d66ae61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:41:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:41:36Z,use_quota=True,user_id='2f776374599d482ca94fed4c2a3df107',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:41:36 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-3b8089b4-927f-46b8-9bd3-88b40a06796c tempest-VolumesTransfersTest-553609294 None] Creating volume 7be875fb-47dd-4497-9f19-ed0950225b01 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:41:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-3b8089b4-927f-46b8-9bd3-88b40a06796c tempest-VolumesTransfersTest-553609294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:41:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-3b8089b4-927f-46b8-9bd3-88b40a06796c tempest-VolumesTransfersTest-553609294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:41:36 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-3b8089b4-927f-46b8-9bd3-88b40a06796c tempest-VolumesTransfersTest-553609294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:41:36 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-3b8089b4-927f-46b8-9bd3-88b40a06796c tempest-VolumesTransfersTest-553609294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:41:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-3b8089b4-927f-46b8-9bd3-88b40a06796c tempest-VolumesTransfersTest-553609294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:41:36 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-3b8089b4-927f-46b8-9bd3-88b40a06796c tempest-VolumesTransfersTest-553609294 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:41:36 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-3b8089b4-927f-46b8-9bd3-88b40a06796c tempest-VolumesTransfersTest-553609294 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:41:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3b8089b4-927f-46b8-9bd3-88b40a06796c tempest-VolumesTransfersTest-553609294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7be875fb-47dd-4497-9f19-ed0950225b01 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:41:36 devstack sudo[91149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7be875fb-47dd-4497-9f19-ed0950225b01 1073741824 Sep 04 22:41:36 devstack sudo[91149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:41:36 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-a29439b3-49b7-48b0-bbcf-c68843b0c0a1 tempest-GroupSnapshotsTest-65893310 None] group_snapshot 72dc012f-eb12-43ad-b145-fd67308a2ad8: created successfully Sep 04 22:41:37 devstack sudo[91149]: pam_unix(sudo:session): session closed for user root Sep 04 22:41:37 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3b8089b4-927f-46b8-9bd3-88b40a06796c tempest-VolumesTransfersTest-553609294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7be875fb-47dd-4497-9f19-ed0950225b01 1073741824" returned: 0 in 0.595s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:41:37 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3b8089b4-927f-46b8-9bd3-88b40a06796c tempest-VolumesTransfersTest-553609294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7be875fb-47dd-4497-9f19-ed0950225b01 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:41:37 devstack sudo[91159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7be875fb-47dd-4497-9f19-ed0950225b01 Sep 04 22:41:37 devstack sudo[91159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:41:37 devstack sudo[91159]: pam_unix(sudo:session): session closed for user root Sep 04 22:41:38 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3b8089b4-927f-46b8-9bd3-88b40a06796c tempest-VolumesTransfersTest-553609294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7be875fb-47dd-4497-9f19-ed0950225b01" returned: 0 in 0.636s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:41:38 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-3b8089b4-927f-46b8-9bd3-88b40a06796c tempest-VolumesTransfersTest-553609294 None] <== create_volume: return (1290ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:41:38 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-3b8089b4-927f-46b8-9bd3-88b40a06796c tempest-VolumesTransfersTest-553609294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.296s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:41:38 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3b8089b4-927f-46b8-9bd3-88b40a06796c tempest-VolumesTransfersTest-553609294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca8b08b8-9e2c-4b31-a679-d22b7c8201db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7be875fb-47dd-4497-9f19-ed0950225b01', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:41:38 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3b8089b4-927f-46b8-9bd3-88b40a06796c tempest-VolumesTransfersTest-553609294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b3e0f97-af27-4366-a02d-ba2ca275bbdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:41:38 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-3b8089b4-927f-46b8-9bd3-88b40a06796c tempest-VolumesTransfersTest-553609294 None] Volume volume-7be875fb-47dd-4497-9f19-ed0950225b01 (7be875fb-47dd-4497-9f19-ed0950225b01): created successfully Sep 04 22:41:38 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3b8089b4-927f-46b8-9bd3-88b40a06796c tempest-VolumesTransfersTest-553609294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b3e0f97-af27-4366-a02d-ba2ca275bbdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:41:38 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3b8089b4-927f-46b8-9bd3-88b40a06796c tempest-VolumesTransfersTest-553609294 None] Flow 'volume_create_manager' (565c860e-fd7d-41ab-9476-5a3e02a45ec4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:41:38 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-3b8089b4-927f-46b8-9bd3-88b40a06796c tempest-VolumesTransfersTest-553609294 None] Created volume successfully. Sep 04 22:41:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-20c4ab28-211b-4257-a951-bb06cac2759f tempest-GroupSnapshotsTest-65893310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:41:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-20c4ab28-211b-4257-a951-bb06cac2759f tempest-GroupSnapshotsTest-65893310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:41:39 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-20c4ab28-211b-4257-a951-bb06cac2759f tempest-GroupSnapshotsTest-65893310 None] Acquiring lock "cinder-quobyte-8714b2e6-4637-4025-abca-5519c5cbd2ec-f05f07a4-f059-460f-895e-2450fc1e0874" by "_create_volume_from_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:41:39 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-20c4ab28-211b-4257-a951-bb06cac2759f tempest-GroupSnapshotsTest-65893310 None] Lock "cinder-quobyte-8714b2e6-4637-4025-abca-5519c5cbd2ec-f05f07a4-f059-460f-895e-2450fc1e0874" acquired by "_create_volume_from_snapshot" :: waited 0.047s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:41:39 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-20c4ab28-211b-4257-a951-bb06cac2759f tempest-GroupSnapshotsTest-65893310 None] Creating volume f05f07a4-f059-460f-895e-2450fc1e0874 from snapshot 8714b2e6-4637-4025-abca-5519c5cbd2ec {{(pid=87576) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 04 22:41:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-20c4ab28-211b-4257-a951-bb06cac2759f tempest-GroupSnapshotsTest-65893310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:41:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-20c4ab28-211b-4257-a951-bb06cac2759f tempest-GroupSnapshotsTest-65893310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:41:39 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-20c4ab28-211b-4257-a951-bb06cac2759f tempest-GroupSnapshotsTest-65893310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:41:39 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-20c4ab28-211b-4257-a951-bb06cac2759f tempest-GroupSnapshotsTest-65893310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:41:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-20c4ab28-211b-4257-a951-bb06cac2759f tempest-GroupSnapshotsTest-65893310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:41:39 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-20c4ab28-211b-4257-a951-bb06cac2759f tempest-GroupSnapshotsTest-65893310 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:41:39 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-20c4ab28-211b-4257-a951-bb06cac2759f tempest-GroupSnapshotsTest-65893310 None] Acquiring lock "cinder-quobyte-f05f07a4-f059-460f-895e-2450fc1e0874" by "_copy_volume_from_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:41:39 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-20c4ab28-211b-4257-a951-bb06cac2759f tempest-GroupSnapshotsTest-65893310 None] Lock "cinder-quobyte-f05f07a4-f059-460f-895e-2450fc1e0874" acquired by "_copy_volume_from_snapshot" :: waited 0.060s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:41:39 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-20c4ab28-211b-4257-a951-bb06cac2759f tempest-GroupSnapshotsTest-65893310 None] snapshot: 8714b2e6-4637-4025-abca-5519c5cbd2ec, volume: f05f07a4-f059-460f-895e-2450fc1e0874, {{(pid=87576) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 04 22:41:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-20c4ab28-211b-4257-a951-bb06cac2759f tempest-GroupSnapshotsTest-65893310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:41:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-20c4ab28-211b-4257-a951-bb06cac2759f tempest-GroupSnapshotsTest-65893310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:41:39 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-20c4ab28-211b-4257-a951-bb06cac2759f tempest-GroupSnapshotsTest-65893310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:41:39 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-20c4ab28-211b-4257-a951-bb06cac2759f tempest-GroupSnapshotsTest-65893310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:41:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-20c4ab28-211b-4257-a951-bb06cac2759f tempest-GroupSnapshotsTest-65893310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:41:39 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3f8438-e200-461f-ae37-6d98cc24b715]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:41:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-20c4ab28-211b-4257-a951-bb06cac2759f tempest-GroupSnapshotsTest-65893310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-635f8e92-9779-43e0-98a1-750c49fde2b0.8714b2e6-4637-4025-abca-5519c5cbd2ec {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:41:40 devstack sudo[91232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-635f8e92-9779-43e0-98a1-750c49fde2b0.8714b2e6-4637-4025-abca-5519c5cbd2ec Sep 04 22:41:40 devstack sudo[91232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:41:40 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-760d39bc-d7d3-449a-9b7e-3537d4769918 tempest-VolumesTransfersTest-80677211 None] Transfer volume completed successfully. Sep 04 22:41:40 devstack sudo[91232]: pam_unix(sudo:session): session closed for user root Sep 04 22:41:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-20c4ab28-211b-4257-a951-bb06cac2759f tempest-GroupSnapshotsTest-65893310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-635f8e92-9779-43e0-98a1-750c49fde2b0.8714b2e6-4637-4025-abca-5519c5cbd2ec" returned: 0 in 1.234s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:41:40 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-20c4ab28-211b-4257-a951-bb06cac2759f tempest-GroupSnapshotsTest-65893310 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-635f8e92-9779-43e0-98a1-750c49fde2b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 22:41:41 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64349e5-e04b-4fc1-a652-38596735d575]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:41:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-20c4ab28-211b-4257-a951-bb06cac2759f tempest-GroupSnapshotsTest-65893310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-635f8e92-9779-43e0-98a1-750c49fde2b0 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:41:41 devstack sudo[91249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-635f8e92-9779-43e0-98a1-750c49fde2b0 Sep 04 22:41:41 devstack sudo[91249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:41:42 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-e32a284d-d351-4980-aa30-5c335aa414a2 tempest-VolumesTransfersTest-1721111580 None] Acquiring lock "cinder-7be875fb-47dd-4497-9f19-ed0950225b01-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:41:42 devstack sudo[91249]: pam_unix(sudo:session): session closed for user root Sep 04 22:41:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-20c4ab28-211b-4257-a951-bb06cac2759f tempest-GroupSnapshotsTest-65893310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-635f8e92-9779-43e0-98a1-750c49fde2b0" returned: 0 in 1.116s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:41:42 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-20c4ab28-211b-4257-a951-bb06cac2759f tempest-GroupSnapshotsTest-65893310 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-635f8e92-9779-43e0-98a1-750c49fde2b0 {{(pid=87576) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 04 22:41:42 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-20c4ab28-211b-4257-a951-bb06cac2759f tempest-GroupSnapshotsTest-65893310 None] Creating direct copy from snapshot {{(pid=87576) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 04 22:41:42 devstack cinder-volume[87576]: DEBUG cinder.utils [None req-20c4ab28-211b-4257-a951-bb06cac2759f tempest-GroupSnapshotsTest-65893310 None] Path /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f05f07a4-f059-460f-895e-2450fc1e0874 not found in is_blk_device check {{(pid=87576) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 04 22:41:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-20c4ab28-211b-4257-a951-bb06cac2759f tempest-GroupSnapshotsTest-65893310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-635f8e92-9779-43e0-98a1-750c49fde2b0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f05f07a4-f059-460f-895e-2450fc1e0874 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:41:42 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-e32a284d-d351-4980-aa30-5c335aa414a2 tempest-VolumesTransfersTest-1721111580 None] Lock "cinder-7be875fb-47dd-4497-9f19-ed0950225b01-delete_volume" acquired by "delete_volume" :: waited 0.145s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:41:42 devstack sudo[91281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-635f8e92-9779-43e0-98a1-750c49fde2b0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f05f07a4-f059-460f-895e-2450fc1e0874 Sep 04 22:41:42 devstack sudo[91281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:41:42 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-e32a284d-d351-4980-aa30-5c335aa414a2 tempest-VolumesTransfersTest-1721111580 None] Acquiring lock "cinder-quobyte-7be875fb-47dd-4497-9f19-ed0950225b01" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:41:42 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-e32a284d-d351-4980-aa30-5c335aa414a2 tempest-VolumesTransfersTest-1721111580 None] Lock "cinder-quobyte-7be875fb-47dd-4497-9f19-ed0950225b01" acquired by "delete_volume" :: waited 0.053s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:41:42 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[9260cbce-b204-4b85-af78-ea86ce66c78b]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:41:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e32a284d-d351-4980-aa30-5c335aa414a2 tempest-VolumesTransfersTest-1721111580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7be875fb-47dd-4497-9f19-ed0950225b01 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:41:42 devstack sudo[91295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7be875fb-47dd-4497-9f19-ed0950225b01 Sep 04 22:41:42 devstack sudo[91295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:41:43 devstack sudo[91295]: pam_unix(sudo:session): session closed for user root Sep 04 22:41:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e32a284d-d351-4980-aa30-5c335aa414a2 tempest-VolumesTransfersTest-1721111580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7be875fb-47dd-4497-9f19-ed0950225b01" returned: 0 in 0.817s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:41:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e32a284d-d351-4980-aa30-5c335aa414a2 tempest-VolumesTransfersTest-1721111580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7be875fb-47dd-4497-9f19-ed0950225b01 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:41:43 devstack sudo[91313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7be875fb-47dd-4497-9f19-ed0950225b01 Sep 04 22:41:43 devstack sudo[91313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:41:44 devstack sudo[91313]: pam_unix(sudo:session): session closed for user root Sep 04 22:41:44 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e32a284d-d351-4980-aa30-5c335aa414a2 tempest-VolumesTransfersTest-1721111580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7be875fb-47dd-4497-9f19-ed0950225b01" returned: 0 in 1.129s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:41:44 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-e32a284d-d351-4980-aa30-5c335aa414a2 tempest-VolumesTransfersTest-1721111580 None] Lock "cinder-quobyte-7be875fb-47dd-4497-9f19-ed0950225b01" released by "delete_volume" :: held 2.123s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:41:44 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-e32a284d-d351-4980-aa30-5c335aa414a2 tempest-VolumesTransfersTest-1721111580 None] Created reservations ['fabdaa9b-ce7e-4369-90e9-9fa847f37069', '9e2b845d-41e5-45d4-bce7-738f27d5863d', '28ae271c-9524-41ad-967e-80858ccb174c', '2bbc604a-77d8-4c1b-b75e-a10d79988d09'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:41:45 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-e32a284d-d351-4980-aa30-5c335aa414a2 tempest-VolumesTransfersTest-1721111580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:41:45 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-e32a284d-d351-4980-aa30-5c335aa414a2 tempest-VolumesTransfersTest-1721111580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:41:45 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-e32a284d-d351-4980-aa30-5c335aa414a2 tempest-VolumesTransfersTest-1721111580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:41:45 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-e32a284d-d351-4980-aa30-5c335aa414a2 tempest-VolumesTransfersTest-1721111580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:41:45 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-e32a284d-d351-4980-aa30-5c335aa414a2 tempest-VolumesTransfersTest-1721111580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.066s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:41:45 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e32a284d-d351-4980-aa30-5c335aa414a2 tempest-VolumesTransfersTest-1721111580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:41:45 devstack sudo[91343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:41:45 devstack sudo[91343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:41:47 devstack sudo[91343]: pam_unix(sudo:session): session closed for user root Sep 04 22:41:47 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e32a284d-d351-4980-aa30-5c335aa414a2 tempest-VolumesTransfersTest-1721111580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 1.778s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:41:47 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-e32a284d-d351-4980-aa30-5c335aa414a2 tempest-VolumesTransfersTest-1721111580 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:41:47 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-e32a284d-d351-4980-aa30-5c335aa414a2 tempest-VolumesTransfersTest-1721111580 None] Deleted volume successfully. Sep 04 22:41:47 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-e32a284d-d351-4980-aa30-5c335aa414a2 tempest-VolumesTransfersTest-1721111580 None] Lock "cinder-7be875fb-47dd-4497-9f19-ed0950225b01-delete_volume" released by "delete_volume" :: held 5.291s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:41:50 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-4038d0e5-f40d-4723-8388-67caefd51ed8 tempest-VolumesTransfersTest-553609294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:41:50 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-4038d0e5-f40d-4723-8388-67caefd51ed8 tempest-VolumesTransfersTest-553609294 None] Flow 'volume_create_manager' (f8ebfa80-dfbd-4e46-9154-57fcadbb87a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:41:50 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-4038d0e5-f40d-4723-8388-67caefd51ed8 tempest-VolumesTransfersTest-553609294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c152160c-b264-489e-bba4-b67cc271aa96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:41:50 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-4038d0e5-f40d-4723-8388-67caefd51ed8 tempest-VolumesTransfersTest-553609294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c152160c-b264-489e-bba4-b67cc271aa96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:41:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-460885532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07443247-4cd4-44bc-8998-f5f9e358f85e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21bfefdd423b4642ba0d6c990d66ae61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:41:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:41:50Z,use_quota=True,user_id='2f776374599d482ca94fed4c2a3df107',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:41:50 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-4038d0e5-f40d-4723-8388-67caefd51ed8 tempest-VolumesTransfersTest-553609294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eb79c11-95bc-48c5-bf98-fa3097a6b2f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:41:50 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-4038d0e5-f40d-4723-8388-67caefd51ed8 tempest-VolumesTransfersTest-553609294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eb79c11-95bc-48c5-bf98-fa3097a6b2f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:41:50 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-4038d0e5-f40d-4723-8388-67caefd51ed8 tempest-VolumesTransfersTest-553609294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d863498-9138-429d-adcd-ed45db12192e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:41:50 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-4038d0e5-f40d-4723-8388-67caefd51ed8 tempest-VolumesTransfersTest-553609294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d863498-9138-429d-adcd-ed45db12192e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07443247-4cd4-44bc-8998-f5f9e358f85e', 'volume_name': 'volume-07443247-4cd4-44bc-8998-f5f9e358f85e', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:41:50 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-4038d0e5-f40d-4723-8388-67caefd51ed8 tempest-VolumesTransfersTest-553609294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8519c89-c581-4dc4-af79-fadd684929bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:41:50 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-4038d0e5-f40d-4723-8388-67caefd51ed8 tempest-VolumesTransfersTest-553609294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8519c89-c581-4dc4-af79-fadd684929bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:41:50 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-4038d0e5-f40d-4723-8388-67caefd51ed8 tempest-VolumesTransfersTest-553609294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0ed20c0-2c81-486a-86e6-163e50e8f96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:41:50 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-4038d0e5-f40d-4723-8388-67caefd51ed8 tempest-VolumesTransfersTest-553609294 None] Volume 07443247-4cd4-44bc-8998-f5f9e358f85e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07443247-4cd4-44bc-8998-f5f9e358f85e', 'volume_size': 1} Sep 04 22:41:50 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-4038d0e5-f40d-4723-8388-67caefd51ed8 tempest-VolumesTransfersTest-553609294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:41:54 devstack sudo[91281]: pam_unix(sudo:session): session closed for user root Sep 04 22:41:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-20c4ab28-211b-4257-a951-bb06cac2759f tempest-GroupSnapshotsTest-65893310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-635f8e92-9779-43e0-98a1-750c49fde2b0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f05f07a4-f059-460f-895e-2450fc1e0874" returned: 0 in 12.263s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:41:54 devstack cinder-volume[87576]: DEBUG cinder.image.image_utils [None req-20c4ab28-211b-4257-a951-bb06cac2759f tempest-GroupSnapshotsTest-65893310 None] Image conversion details: src /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-635f8e92-9779-43e0-98a1-750c49fde2b0, size 1024.00 MB, duration 12.26 sec, destination /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f05f07a4-f059-460f-895e-2450fc1e0874 {{(pid=87576) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 22:41:54 devstack cinder-volume[87576]: INFO cinder.image.image_utils [None req-20c4ab28-211b-4257-a951-bb06cac2759f tempest-GroupSnapshotsTest-65893310 None] Converted 1024.00 MB image at 83.50 MB/s Sep 04 22:41:54 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-20c4ab28-211b-4257-a951-bb06cac2759f tempest-GroupSnapshotsTest-65893310 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f05f07a4-f059-460f-895e-2450fc1e0874 is being set with open permissions: ugo+rw: NotImplementedError Sep 04 22:41:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-20c4ab28-211b-4257-a951-bb06cac2759f tempest-GroupSnapshotsTest-65893310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f05f07a4-f059-460f-895e-2450fc1e0874 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:41:54 devstack sudo[91378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f05f07a4-f059-460f-895e-2450fc1e0874 Sep 04 22:41:54 devstack sudo[91378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:41:54 devstack sudo[91378]: pam_unix(sudo:session): session closed for user root Sep 04 22:41:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-20c4ab28-211b-4257-a951-bb06cac2759f tempest-GroupSnapshotsTest-65893310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f05f07a4-f059-460f-895e-2450fc1e0874" returned: 0 in 0.527s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:41:54 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-20c4ab28-211b-4257-a951-bb06cac2759f tempest-GroupSnapshotsTest-65893310 None] Lock "cinder-quobyte-f05f07a4-f059-460f-895e-2450fc1e0874" released by "_copy_volume_from_snapshot" :: held 15.374s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:41:54 devstack cinder-volume[87576]: DEBUG dbcounter [-] [87576] Writing DB stats cinder:SELECT=77,cinder:UPDATE=96,cinder:DELETE=12,cinder:INSERT=22 {{(pid=87576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 22:41:54 devstack cinder-volume[87576]: DEBUG dbcounter [-] [87576] Writing DB stats cinder:SELECT=82,cinder:INSERT=25,cinder:UPDATE=109,cinder:DELETE=6 {{(pid=87576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 22:41:55 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-20c4ab28-211b-4257-a951-bb06cac2759f tempest-GroupSnapshotsTest-65893310 None] Lock "cinder-quobyte-8714b2e6-4637-4025-abca-5519c5cbd2ec-f05f07a4-f059-460f-895e-2450fc1e0874" released by "_create_volume_from_snapshot" :: held 15.627s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:41:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-20c4ab28-211b-4257-a951-bb06cac2759f tempest-GroupSnapshotsTest-65893310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 15.676s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:41:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-4038d0e5-f40d-4723-8388-67caefd51ed8 tempest-VolumesTransfersTest-553609294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.142s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:41:55 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-4038d0e5-f40d-4723-8388-67caefd51ed8 tempest-VolumesTransfersTest-553609294 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:41:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-460885532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07443247-4cd4-44bc-8998-f5f9e358f85e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21bfefdd423b4642ba0d6c990d66ae61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:41:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:41:50Z,use_quota=True,user_id='2f776374599d482ca94fed4c2a3df107',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:41:55 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-4038d0e5-f40d-4723-8388-67caefd51ed8 tempest-VolumesTransfersTest-553609294 None] Creating volume 07443247-4cd4-44bc-8998-f5f9e358f85e {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:41:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-4038d0e5-f40d-4723-8388-67caefd51ed8 tempest-VolumesTransfersTest-553609294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:41:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-4038d0e5-f40d-4723-8388-67caefd51ed8 tempest-VolumesTransfersTest-553609294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:41:55 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-4038d0e5-f40d-4723-8388-67caefd51ed8 tempest-VolumesTransfersTest-553609294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:41:55 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-4038d0e5-f40d-4723-8388-67caefd51ed8 tempest-VolumesTransfersTest-553609294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:41:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-4038d0e5-f40d-4723-8388-67caefd51ed8 tempest-VolumesTransfersTest-553609294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:41:55 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-4038d0e5-f40d-4723-8388-67caefd51ed8 tempest-VolumesTransfersTest-553609294 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:41:55 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-4038d0e5-f40d-4723-8388-67caefd51ed8 tempest-VolumesTransfersTest-553609294 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:41:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4038d0e5-f40d-4723-8388-67caefd51ed8 tempest-VolumesTransfersTest-553609294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-07443247-4cd4-44bc-8998-f5f9e358f85e 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:41:55 devstack sudo[91382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-07443247-4cd4-44bc-8998-f5f9e358f85e 1073741824 Sep 04 22:41:55 devstack sudo[91382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:41:55 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-20c4ab28-211b-4257-a951-bb06cac2759f tempest-GroupSnapshotsTest-65893310 None] Create group from source-snapshot-72dc012f-eb12-43ad-b145-fd67308a2ad8 completed successfully. Sep 04 22:41:56 devstack sudo[91382]: pam_unix(sudo:session): session closed for user root Sep 04 22:41:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4038d0e5-f40d-4723-8388-67caefd51ed8 tempest-VolumesTransfersTest-553609294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-07443247-4cd4-44bc-8998-f5f9e358f85e 1073741824" returned: 0 in 1.103s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:41:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4038d0e5-f40d-4723-8388-67caefd51ed8 tempest-VolumesTransfersTest-553609294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-07443247-4cd4-44bc-8998-f5f9e358f85e {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:41:56 devstack sudo[91390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-07443247-4cd4-44bc-8998-f5f9e358f85e Sep 04 22:41:56 devstack sudo[91390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:41:57 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-b17f73a3-03c4-4917-aab9-f83228a07752 tempest-GroupSnapshotsTest-65893310 None] Acquiring lock "cinder-quobyte-f05f07a4-f059-460f-895e-2450fc1e0874" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:41:57 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-b17f73a3-03c4-4917-aab9-f83228a07752 tempest-GroupSnapshotsTest-65893310 None] Lock "cinder-quobyte-f05f07a4-f059-460f-895e-2450fc1e0874" acquired by "delete_volume" :: waited 0.056s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:41:57 devstack sudo[91390]: pam_unix(sudo:session): session closed for user root Sep 04 22:41:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4038d0e5-f40d-4723-8388-67caefd51ed8 tempest-VolumesTransfersTest-553609294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-07443247-4cd4-44bc-8998-f5f9e358f85e" returned: 0 in 1.225s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:41:57 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-4038d0e5-f40d-4723-8388-67caefd51ed8 tempest-VolumesTransfersTest-553609294 None] <== create_volume: return (2448ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:41:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-4038d0e5-f40d-4723-8388-67caefd51ed8 tempest-VolumesTransfersTest-553609294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.453s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:41:57 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[e319c6d5-55e9-4880-8d22-1e1c2396aef2]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:41:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b17f73a3-03c4-4917-aab9-f83228a07752 tempest-GroupSnapshotsTest-65893310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f05f07a4-f059-460f-895e-2450fc1e0874 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:41:57 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-4038d0e5-f40d-4723-8388-67caefd51ed8 tempest-VolumesTransfersTest-553609294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0ed20c0-2c81-486a-86e6-163e50e8f96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07443247-4cd4-44bc-8998-f5f9e358f85e', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:41:57 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-4038d0e5-f40d-4723-8388-67caefd51ed8 tempest-VolumesTransfersTest-553609294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7c1696a-2c9c-4b1b-a387-73a7101a77f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:41:57 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-4038d0e5-f40d-4723-8388-67caefd51ed8 tempest-VolumesTransfersTest-553609294 None] Volume volume-07443247-4cd4-44bc-8998-f5f9e358f85e (07443247-4cd4-44bc-8998-f5f9e358f85e): created successfully Sep 04 22:41:57 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-4038d0e5-f40d-4723-8388-67caefd51ed8 tempest-VolumesTransfersTest-553609294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7c1696a-2c9c-4b1b-a387-73a7101a77f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:41:57 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-4038d0e5-f40d-4723-8388-67caefd51ed8 tempest-VolumesTransfersTest-553609294 None] Flow 'volume_create_manager' (f8ebfa80-dfbd-4e46-9154-57fcadbb87a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:41:57 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-4038d0e5-f40d-4723-8388-67caefd51ed8 tempest-VolumesTransfersTest-553609294 None] Created volume successfully. Sep 04 22:41:57 devstack sudo[91444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f05f07a4-f059-460f-895e-2450fc1e0874 Sep 04 22:41:57 devstack sudo[91444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:41:58 devstack sudo[91444]: pam_unix(sudo:session): session closed for user root Sep 04 22:41:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b17f73a3-03c4-4917-aab9-f83228a07752 tempest-GroupSnapshotsTest-65893310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f05f07a4-f059-460f-895e-2450fc1e0874" returned: 0 in 0.989s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:41:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b17f73a3-03c4-4917-aab9-f83228a07752 tempest-GroupSnapshotsTest-65893310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f05f07a4-f059-460f-895e-2450fc1e0874 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:41:58 devstack sudo[91485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f05f07a4-f059-460f-895e-2450fc1e0874 Sep 04 22:41:58 devstack sudo[91485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:41:58 devstack sudo[91485]: pam_unix(sudo:session): session closed for user root Sep 04 22:41:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b17f73a3-03c4-4917-aab9-f83228a07752 tempest-GroupSnapshotsTest-65893310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f05f07a4-f059-460f-895e-2450fc1e0874" returned: 0 in 0.378s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:41:59 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-b17f73a3-03c4-4917-aab9-f83228a07752 tempest-GroupSnapshotsTest-65893310 None] Lock "cinder-quobyte-f05f07a4-f059-460f-895e-2450fc1e0874" released by "delete_volume" :: held 1.507s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:41:59 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-b17f73a3-03c4-4917-aab9-f83228a07752 tempest-GroupSnapshotsTest-65893310 None] Created reservations ['4f9cbaa7-f458-4d11-a17a-476336a12253'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:41:59 devstack cinder-volume[87576]: WARNING cinder.quota [None req-b17f73a3-03c4-4917-aab9-f83228a07752 tempest-GroupSnapshotsTest-65893310 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1572572072 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1572572072, it is now deprecated. Please use the default quota class for default quota. Sep 04 22:41:59 devstack cinder-volume[87576]: WARNING cinder.quota [None req-b17f73a3-03c4-4917-aab9-f83228a07752 tempest-GroupSnapshotsTest-65893310 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1572572072 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1572572072, it is now deprecated. Please use the default quota class for default quota. Sep 04 22:41:59 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-b17f73a3-03c4-4917-aab9-f83228a07752 tempest-GroupSnapshotsTest-65893310 None] Created reservations ['601dc737-7bf9-43f5-a211-bd06373d4684', '20effc3d-3efe-4fb8-b813-f36cc15d11ac', '97c4f1d0-a79f-4a94-8126-4882d7b58003', '4b34ab4a-f071-4bf0-af4a-54f888895573'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:41:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-b17f73a3-03c4-4917-aab9-f83228a07752 tempest-GroupSnapshotsTest-65893310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:41:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-b17f73a3-03c4-4917-aab9-f83228a07752 tempest-GroupSnapshotsTest-65893310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:41:59 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-b17f73a3-03c4-4917-aab9-f83228a07752 tempest-GroupSnapshotsTest-65893310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:41:59 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-b17f73a3-03c4-4917-aab9-f83228a07752 tempest-GroupSnapshotsTest-65893310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:41:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-b17f73a3-03c4-4917-aab9-f83228a07752 tempest-GroupSnapshotsTest-65893310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:41:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b17f73a3-03c4-4917-aab9-f83228a07752 tempest-GroupSnapshotsTest-65893310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:41:59 devstack sudo[91512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:41:59 devstack sudo[91512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:41:59 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c784426c-837e-4ab1-8817-12154c755c00 tempest-VolumesTransfersTest-1721111580 None] Acquiring lock "cinder-07443247-4cd4-44bc-8998-f5f9e358f85e-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:41:59 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c784426c-837e-4ab1-8817-12154c755c00 tempest-VolumesTransfersTest-1721111580 None] Lock "cinder-07443247-4cd4-44bc-8998-f5f9e358f85e-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:41:59 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c784426c-837e-4ab1-8817-12154c755c00 tempest-VolumesTransfersTest-1721111580 None] Acquiring lock "cinder-quobyte-07443247-4cd4-44bc-8998-f5f9e358f85e" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:41:59 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c784426c-837e-4ab1-8817-12154c755c00 tempest-VolumesTransfersTest-1721111580 None] Lock "cinder-quobyte-07443247-4cd4-44bc-8998-f5f9e358f85e" acquired by "delete_volume" :: waited 0.061s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:41:59 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e8c1a66-bd79-4561-a70e-92245817436e]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:41:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c784426c-837e-4ab1-8817-12154c755c00 tempest-VolumesTransfersTest-1721111580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-07443247-4cd4-44bc-8998-f5f9e358f85e {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:41:59 devstack sudo[91516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-07443247-4cd4-44bc-8998-f5f9e358f85e Sep 04 22:41:59 devstack sudo[91516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:00 devstack sudo[91512]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b17f73a3-03c4-4917-aab9-f83228a07752 tempest-GroupSnapshotsTest-65893310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.641s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:00 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-b17f73a3-03c4-4917-aab9-f83228a07752 tempest-GroupSnapshotsTest-65893310 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:42:00 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-b17f73a3-03c4-4917-aab9-f83228a07752 tempest-GroupSnapshotsTest-65893310 None] Delete group completed successfully. Sep 04 22:42:00 devstack sudo[91516]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c784426c-837e-4ab1-8817-12154c755c00 tempest-VolumesTransfersTest-1721111580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-07443247-4cd4-44bc-8998-f5f9e358f85e" returned: 0 in 0.493s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c784426c-837e-4ab1-8817-12154c755c00 tempest-VolumesTransfersTest-1721111580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-07443247-4cd4-44bc-8998-f5f9e358f85e {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:00 devstack sudo[91522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-07443247-4cd4-44bc-8998-f5f9e358f85e Sep 04 22:42:00 devstack sudo[91522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:00 devstack sudo[91522]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c784426c-837e-4ab1-8817-12154c755c00 tempest-VolumesTransfersTest-1721111580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-07443247-4cd4-44bc-8998-f5f9e358f85e" returned: 0 in 0.369s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:00 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-f77fb169-07e8-439a-9525-786a65066ffe tempest-GroupSnapshotsTest-65893310 None] group_snapshot 72dc012f-eb12-43ad-b145-fd67308a2ad8: deleting Sep 04 22:42:00 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c784426c-837e-4ab1-8817-12154c755c00 tempest-VolumesTransfersTest-1721111580 None] Lock "cinder-quobyte-07443247-4cd4-44bc-8998-f5f9e358f85e" released by "delete_volume" :: held 0.966s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:42:00 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-f77fb169-07e8-439a-9525-786a65066ffe tempest-GroupSnapshotsTest-65893310 None] group_snapshot 72dc012f-eb12-43ad-b145-fd67308a2ad8: deleting {{(pid=87576) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 04 22:42:00 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f77fb169-07e8-439a-9525-786a65066ffe tempest-GroupSnapshotsTest-65893310 None] Acquiring lock "cinder-quobyte-635f8e92-9779-43e0-98a1-750c49fde2b0" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:42:00 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f77fb169-07e8-439a-9525-786a65066ffe tempest-GroupSnapshotsTest-65893310 None] Lock "cinder-quobyte-635f8e92-9779-43e0-98a1-750c49fde2b0" acquired by "delete_snapshot" :: waited 0.063s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:42:00 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f77fb169-07e8-439a-9525-786a65066ffe tempest-GroupSnapshotsTest-65893310 None] Acquiring lock "cinder-quobyte-8714b2e6-4637-4025-abca-5519c5cbd2ec" by "_delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:42:00 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-c784426c-837e-4ab1-8817-12154c755c00 tempest-VolumesTransfersTest-1721111580 None] Created reservations ['11dddf20-d032-4373-9f94-d8ce26f6f202', '135bd971-6859-4a05-bef5-48ac7f9796c4', '536a27e6-eeba-45ca-98a5-4347f67a1dbd', 'ac5316db-ac8f-4f20-afc5-e181d4ffc61e'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:42:00 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f77fb169-07e8-439a-9525-786a65066ffe tempest-GroupSnapshotsTest-65893310 None] Lock "cinder-quobyte-8714b2e6-4637-4025-abca-5519c5cbd2ec" acquired by "_delete_snapshot" :: waited 0.057s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:42:00 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-f77fb169-07e8-439a-9525-786a65066ffe tempest-GroupSnapshotsTest-65893310 None] Deleting offline snapshot 8714b2e6-4637-4025-abca-5519c5cbd2ec of volume 635f8e92-9779-43e0-98a1-750c49fde2b0 {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 22:42:00 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-f77fb169-07e8-439a-9525-786a65066ffe tempest-GroupSnapshotsTest-65893310 None] snapshot_file for this snap is: volume-635f8e92-9779-43e0-98a1-750c49fde2b0.8714b2e6-4637-4025-abca-5519c5cbd2ec {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 22:42:00 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa01e6d4-42a8-4765-ba3a-8a7f3ddd59a8]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:42:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f77fb169-07e8-439a-9525-786a65066ffe tempest-GroupSnapshotsTest-65893310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-635f8e92-9779-43e0-98a1-750c49fde2b0.8714b2e6-4637-4025-abca-5519c5cbd2ec {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-c784426c-837e-4ab1-8817-12154c755c00 tempest-VolumesTransfersTest-1721111580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:42:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-c784426c-837e-4ab1-8817-12154c755c00 tempest-VolumesTransfersTest-1721111580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:42:01 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-c784426c-837e-4ab1-8817-12154c755c00 tempest-VolumesTransfersTest-1721111580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:42:01 devstack sudo[91527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-635f8e92-9779-43e0-98a1-750c49fde2b0.8714b2e6-4637-4025-abca-5519c5cbd2ec Sep 04 22:42:01 devstack sudo[91527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:01 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-c784426c-837e-4ab1-8817-12154c755c00 tempest-VolumesTransfersTest-1721111580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:42:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-c784426c-837e-4ab1-8817-12154c755c00 tempest-VolumesTransfersTest-1721111580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:42:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c784426c-837e-4ab1-8817-12154c755c00 tempest-VolumesTransfersTest-1721111580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:01 devstack sudo[91529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:42:01 devstack sudo[91529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:01 devstack sudo[91527]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f77fb169-07e8-439a-9525-786a65066ffe tempest-GroupSnapshotsTest-65893310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-635f8e92-9779-43e0-98a1-750c49fde2b0.8714b2e6-4637-4025-abca-5519c5cbd2ec" returned: 0 in 0.864s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:01 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-f77fb169-07e8-439a-9525-786a65066ffe tempest-GroupSnapshotsTest-65893310 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-635f8e92-9779-43e0-98a1-750c49fde2b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 22:42:01 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b96e884-1df0-4556-aae4-b2573e0f6a0d]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:42:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f77fb169-07e8-439a-9525-786a65066ffe tempest-GroupSnapshotsTest-65893310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-635f8e92-9779-43e0-98a1-750c49fde2b0 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:01 devstack sudo[91529]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c784426c-837e-4ab1-8817-12154c755c00 tempest-VolumesTransfersTest-1721111580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.748s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:01 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-c784426c-837e-4ab1-8817-12154c755c00 tempest-VolumesTransfersTest-1721111580 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:42:01 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-c784426c-837e-4ab1-8817-12154c755c00 tempest-VolumesTransfersTest-1721111580 None] Deleted volume successfully. Sep 04 22:42:02 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c784426c-837e-4ab1-8817-12154c755c00 tempest-VolumesTransfersTest-1721111580 None] Lock "cinder-07443247-4cd4-44bc-8998-f5f9e358f85e-delete_volume" released by "delete_volume" :: held 2.526s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:42:02 devstack sudo[91536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-635f8e92-9779-43e0-98a1-750c49fde2b0 Sep 04 22:42:02 devstack sudo[91536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:03 devstack sudo[91536]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f77fb169-07e8-439a-9525-786a65066ffe tempest-GroupSnapshotsTest-65893310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-635f8e92-9779-43e0-98a1-750c49fde2b0" returned: 0 in 1.135s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f77fb169-07e8-439a-9525-786a65066ffe tempest-GroupSnapshotsTest-65893310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-635f8e92-9779-43e0-98a1-750c49fde2b0.8714b2e6-4637-4025-abca-5519c5cbd2ec {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:03 devstack sudo[91542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-635f8e92-9779-43e0-98a1-750c49fde2b0.8714b2e6-4637-4025-abca-5519c5cbd2ec Sep 04 22:42:03 devstack sudo[91542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:03 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-34249c67-79ed-4343-a063-e02d53ccfe51 tempest-ServerRescueNegativeTestJSON-998210410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:42:03 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-34249c67-79ed-4343-a063-e02d53ccfe51 tempest-ServerRescueNegativeTestJSON-998210410 None] Flow 'volume_create_manager' (fb0fc801-d1bc-4335-9400-67dfeee83cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:42:03 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-34249c67-79ed-4343-a063-e02d53ccfe51 tempest-ServerRescueNegativeTestJSON-998210410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a7f8aa8-74b1-4e54-8ac8-0339262c5d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:42:03 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-34249c67-79ed-4343-a063-e02d53ccfe51 tempest-ServerRescueNegativeTestJSON-998210410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a7f8aa8-74b1-4e54-8ac8-0339262c5d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:42:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1416873545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d904143-3926-41a7-9aef-a04dc4fe046a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08e33e1cd7b147df8a8d040782c9aaa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:42:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:42:03Z,use_quota=True,user_id='4ec144c5e5cd43c791a69eb0ea33abd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:42:03 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-34249c67-79ed-4343-a063-e02d53ccfe51 tempest-ServerRescueNegativeTestJSON-998210410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f8323e8-7238-4cf6-a4b0-64b966cf60fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:42:03 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-34249c67-79ed-4343-a063-e02d53ccfe51 tempest-ServerRescueNegativeTestJSON-998210410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f8323e8-7238-4cf6-a4b0-64b966cf60fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:42:03 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-34249c67-79ed-4343-a063-e02d53ccfe51 tempest-ServerRescueNegativeTestJSON-998210410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fab9908-c99a-401c-b828-793c0730bb46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:42:03 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-34249c67-79ed-4343-a063-e02d53ccfe51 tempest-ServerRescueNegativeTestJSON-998210410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fab9908-c99a-401c-b828-793c0730bb46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d904143-3926-41a7-9aef-a04dc4fe046a', 'volume_name': 'volume-2d904143-3926-41a7-9aef-a04dc4fe046a', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:42:03 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-34249c67-79ed-4343-a063-e02d53ccfe51 tempest-ServerRescueNegativeTestJSON-998210410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57bf34c5-3119-4392-8924-c9307a05ef4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:42:03 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-34249c67-79ed-4343-a063-e02d53ccfe51 tempest-ServerRescueNegativeTestJSON-998210410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57bf34c5-3119-4392-8924-c9307a05ef4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:42:03 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-34249c67-79ed-4343-a063-e02d53ccfe51 tempest-ServerRescueNegativeTestJSON-998210410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f97cb7da-8547-4abe-9da8-bdb73286ed7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:42:03 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-34249c67-79ed-4343-a063-e02d53ccfe51 tempest-ServerRescueNegativeTestJSON-998210410 None] Volume 2d904143-3926-41a7-9aef-a04dc4fe046a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d904143-3926-41a7-9aef-a04dc4fe046a', 'volume_size': 1} Sep 04 22:42:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-34249c67-79ed-4343-a063-e02d53ccfe51 tempest-ServerRescueNegativeTestJSON-998210410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:42:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-34249c67-79ed-4343-a063-e02d53ccfe51 tempest-ServerRescueNegativeTestJSON-998210410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:42:03 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-34249c67-79ed-4343-a063-e02d53ccfe51 tempest-ServerRescueNegativeTestJSON-998210410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:42:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1416873545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d904143-3926-41a7-9aef-a04dc4fe046a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08e33e1cd7b147df8a8d040782c9aaa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:42:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:42:03Z,use_quota=True,user_id='4ec144c5e5cd43c791a69eb0ea33abd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:42:03 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-34249c67-79ed-4343-a063-e02d53ccfe51 tempest-ServerRescueNegativeTestJSON-998210410 None] Creating volume 2d904143-3926-41a7-9aef-a04dc4fe046a {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:42:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-34249c67-79ed-4343-a063-e02d53ccfe51 tempest-ServerRescueNegativeTestJSON-998210410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:42:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-34249c67-79ed-4343-a063-e02d53ccfe51 tempest-ServerRescueNegativeTestJSON-998210410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:42:03 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-34249c67-79ed-4343-a063-e02d53ccfe51 tempest-ServerRescueNegativeTestJSON-998210410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:42:03 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-34249c67-79ed-4343-a063-e02d53ccfe51 tempest-ServerRescueNegativeTestJSON-998210410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:42:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-34249c67-79ed-4343-a063-e02d53ccfe51 tempest-ServerRescueNegativeTestJSON-998210410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:42:03 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-34249c67-79ed-4343-a063-e02d53ccfe51 tempest-ServerRescueNegativeTestJSON-998210410 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:42:03 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-34249c67-79ed-4343-a063-e02d53ccfe51 tempest-ServerRescueNegativeTestJSON-998210410 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:42:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-34249c67-79ed-4343-a063-e02d53ccfe51 tempest-ServerRescueNegativeTestJSON-998210410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-2d904143-3926-41a7-9aef-a04dc4fe046a 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:03 devstack sudo[91544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-2d904143-3926-41a7-9aef-a04dc4fe046a 1073741824 Sep 04 22:42:03 devstack sudo[91544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:03 devstack sudo[91542]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f77fb169-07e8-439a-9525-786a65066ffe tempest-GroupSnapshotsTest-65893310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-635f8e92-9779-43e0-98a1-750c49fde2b0.8714b2e6-4637-4025-abca-5519c5cbd2ec" returned: 0 in 0.935s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f77fb169-07e8-439a-9525-786a65066ffe tempest-GroupSnapshotsTest-65893310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-635f8e92-9779-43e0-98a1-750c49fde2b0.8714b2e6-4637-4025-abca-5519c5cbd2ec {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:04 devstack sudo[91552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-635f8e92-9779-43e0-98a1-750c49fde2b0.8714b2e6-4637-4025-abca-5519c5cbd2ec Sep 04 22:42:04 devstack sudo[91552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:04 devstack sudo[91552]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f77fb169-07e8-439a-9525-786a65066ffe tempest-GroupSnapshotsTest-65893310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-635f8e92-9779-43e0-98a1-750c49fde2b0.8714b2e6-4637-4025-abca-5519c5cbd2ec" returned: 0 in 0.520s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:04 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f77fb169-07e8-439a-9525-786a65066ffe tempest-GroupSnapshotsTest-65893310 None] Lock "cinder-quobyte-8714b2e6-4637-4025-abca-5519c5cbd2ec" released by "_delete_snapshot" :: held 3.681s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:42:04 devstack sudo[91544]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:04 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f77fb169-07e8-439a-9525-786a65066ffe tempest-GroupSnapshotsTest-65893310 None] Lock "cinder-quobyte-635f8e92-9779-43e0-98a1-750c49fde2b0" released by "delete_snapshot" :: held 3.776s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:42:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-34249c67-79ed-4343-a063-e02d53ccfe51 tempest-ServerRescueNegativeTestJSON-998210410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-2d904143-3926-41a7-9aef-a04dc4fe046a 1073741824" returned: 0 in 1.209s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-34249c67-79ed-4343-a063-e02d53ccfe51 tempest-ServerRescueNegativeTestJSON-998210410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-2d904143-3926-41a7-9aef-a04dc4fe046a {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:04 devstack sudo[91558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-2d904143-3926-41a7-9aef-a04dc4fe046a Sep 04 22:42:04 devstack sudo[91558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:04 devstack cinder-volume[87576]: WARNING cinder.quota [None req-f77fb169-07e8-439a-9525-786a65066ffe tempest-GroupSnapshotsTest-65893310 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1572572072 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1572572072, it is now deprecated. Please use the default quota class for default quota. Sep 04 22:42:05 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-f77fb169-07e8-439a-9525-786a65066ffe tempest-GroupSnapshotsTest-65893310 None] Created reservations ['935abcf5-4152-446e-b290-b2c20985bcac', '2258ea3b-514d-4f40-a3d9-3768e8c00182', 'fc4ed5c0-0cd9-474d-9cef-c89dbc062e6e', '1f4780e2-7c80-4da1-993b-77c608681238'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:42:05 devstack sudo[91558]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-34249c67-79ed-4343-a063-e02d53ccfe51 tempest-ServerRescueNegativeTestJSON-998210410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-2d904143-3926-41a7-9aef-a04dc4fe046a" returned: 0 in 0.398s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:05 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-34249c67-79ed-4343-a063-e02d53ccfe51 tempest-ServerRescueNegativeTestJSON-998210410 None] <== create_volume: return (1775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:42:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-34249c67-79ed-4343-a063-e02d53ccfe51 tempest-ServerRescueNegativeTestJSON-998210410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.781s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:42:05 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-34249c67-79ed-4343-a063-e02d53ccfe51 tempest-ServerRescueNegativeTestJSON-998210410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f97cb7da-8547-4abe-9da8-bdb73286ed7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d904143-3926-41a7-9aef-a04dc4fe046a', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:42:05 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-34249c67-79ed-4343-a063-e02d53ccfe51 tempest-ServerRescueNegativeTestJSON-998210410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e494349-9c7c-444a-af5f-2ee71c28a824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:42:05 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-34249c67-79ed-4343-a063-e02d53ccfe51 tempest-ServerRescueNegativeTestJSON-998210410 None] Volume volume-2d904143-3926-41a7-9aef-a04dc4fe046a (2d904143-3926-41a7-9aef-a04dc4fe046a): created successfully Sep 04 22:42:05 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-34249c67-79ed-4343-a063-e02d53ccfe51 tempest-ServerRescueNegativeTestJSON-998210410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e494349-9c7c-444a-af5f-2ee71c28a824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:42:05 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-34249c67-79ed-4343-a063-e02d53ccfe51 tempest-ServerRescueNegativeTestJSON-998210410 None] Flow 'volume_create_manager' (fb0fc801-d1bc-4335-9400-67dfeee83cc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:42:05 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-34249c67-79ed-4343-a063-e02d53ccfe51 tempest-ServerRescueNegativeTestJSON-998210410 None] Created volume successfully. Sep 04 22:42:05 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-f77fb169-07e8-439a-9525-786a65066ffe tempest-GroupSnapshotsTest-65893310 None] group_snapshot 72dc012f-eb12-43ad-b145-fd67308a2ad8: deleted successfully Sep 04 22:42:06 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-276c7ecb-db32-48cb-9f2d-4118e58937cc tempest-GroupSnapshotsTest-65893310 None] Acquiring lock "cinder-quobyte-635f8e92-9779-43e0-98a1-750c49fde2b0" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:42:06 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-276c7ecb-db32-48cb-9f2d-4118e58937cc tempest-GroupSnapshotsTest-65893310 None] Lock "cinder-quobyte-635f8e92-9779-43e0-98a1-750c49fde2b0" acquired by "delete_volume" :: waited 0.022s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:42:06 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0155d13-6f59-44d2-ade9-56f27a7dd466]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:42:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-276c7ecb-db32-48cb-9f2d-4118e58937cc tempest-GroupSnapshotsTest-65893310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-635f8e92-9779-43e0-98a1-750c49fde2b0 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:06 devstack sudo[91564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-635f8e92-9779-43e0-98a1-750c49fde2b0 Sep 04 22:42:06 devstack sudo[91564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:07 devstack sudo[91564]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-276c7ecb-db32-48cb-9f2d-4118e58937cc tempest-GroupSnapshotsTest-65893310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-635f8e92-9779-43e0-98a1-750c49fde2b0" returned: 0 in 1.053s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-276c7ecb-db32-48cb-9f2d-4118e58937cc tempest-GroupSnapshotsTest-65893310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-635f8e92-9779-43e0-98a1-750c49fde2b0 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:07 devstack sudo[91570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-635f8e92-9779-43e0-98a1-750c49fde2b0 Sep 04 22:42:07 devstack sudo[91570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:08 devstack sudo[91570]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-276c7ecb-db32-48cb-9f2d-4118e58937cc tempest-GroupSnapshotsTest-65893310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-635f8e92-9779-43e0-98a1-750c49fde2b0" returned: 0 in 0.594s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:08 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-276c7ecb-db32-48cb-9f2d-4118e58937cc tempest-GroupSnapshotsTest-65893310 None] Lock "cinder-quobyte-635f8e92-9779-43e0-98a1-750c49fde2b0" released by "delete_volume" :: held 1.828s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:42:08 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-276c7ecb-db32-48cb-9f2d-4118e58937cc tempest-GroupSnapshotsTest-65893310 None] Created reservations ['a0ec4017-d67a-40f8-810d-1c1707e30dcc'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:42:08 devstack cinder-volume[87576]: WARNING cinder.db.api [None req-276c7ecb-db32-48cb-9f2d-4118e58937cc tempest-GroupSnapshotsTest-65893310 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1572572072'] Sep 04 22:42:08 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-276c7ecb-db32-48cb-9f2d-4118e58937cc tempest-GroupSnapshotsTest-65893310 None] Created reservations ['0af1e145-8a14-4cef-ab55-e220636dbcc5', '2a893e47-24e8-4937-a99e-3400a1afa925', '9944e29f-1316-4cbe-8964-896163418424', 'b280e79a-a5fa-4fd6-b19a-b7ce291441f6'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:42:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-276c7ecb-db32-48cb-9f2d-4118e58937cc tempest-GroupSnapshotsTest-65893310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:42:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-276c7ecb-db32-48cb-9f2d-4118e58937cc tempest-GroupSnapshotsTest-65893310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:42:08 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-276c7ecb-db32-48cb-9f2d-4118e58937cc tempest-GroupSnapshotsTest-65893310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:42:08 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-276c7ecb-db32-48cb-9f2d-4118e58937cc tempest-GroupSnapshotsTest-65893310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:42:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-276c7ecb-db32-48cb-9f2d-4118e58937cc tempest-GroupSnapshotsTest-65893310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:42:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-276c7ecb-db32-48cb-9f2d-4118e58937cc tempest-GroupSnapshotsTest-65893310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:08 devstack sudo[91573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:42:08 devstack sudo[91573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:08 devstack sudo[91573]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-276c7ecb-db32-48cb-9f2d-4118e58937cc tempest-GroupSnapshotsTest-65893310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.474s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:08 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-276c7ecb-db32-48cb-9f2d-4118e58937cc tempest-GroupSnapshotsTest-65893310 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:42:08 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-276c7ecb-db32-48cb-9f2d-4118e58937cc tempest-GroupSnapshotsTest-65893310 None] Delete group completed successfully. Sep 04 22:42:10 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-e4959c44-61d4-4b4a-ae15-44099101654b tempest-GroupSnapshotsTest-65893310 None] Group tempest-GroupSnapshotsTest-Group-422421405: creating Sep 04 22:42:10 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-e4959c44-61d4-4b4a-ae15-44099101654b tempest-GroupSnapshotsTest-65893310 None] Group tempest-GroupSnapshotsTest-Group-422421405: created successfully Sep 04 22:42:10 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-e4959c44-61d4-4b4a-ae15-44099101654b tempest-GroupSnapshotsTest-65893310 None] Create group completed successfully. Sep 04 22:42:11 devstack cinder-volume[87576]: DEBUG oslo_service.periodic_task [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87576) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 22:42:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:42:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:42:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:42:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:42:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:42:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:11 devstack sudo[91615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:42:11 devstack sudo[91615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:12 devstack sudo[91615]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.794s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:12 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:42:12 devstack cinder-volume[87576]: DEBUG oslo_service.periodic_task [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Running periodic task VolumeManager._thread_info {{(pid=87576) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 22:42:12 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] thread count: 8 {{(pid=87576) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 22:42:12 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] thread info: [<_MainThread(MainThread, started 125730416963712)>, , , , , , , ] {{(pid=87576) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 22:42:13 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7223c18-de3a-45b9-b4e0-5c63fb02e8c4 tempest-GroupSnapshotsTest-65893310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:42:13 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-f7223c18-de3a-45b9-b4e0-5c63fb02e8c4 tempest-GroupSnapshotsTest-65893310 None] Flow 'volume_create_manager' (ded76a4c-9932-4679-8f32-730eeca73a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:42:13 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-f7223c18-de3a-45b9-b4e0-5c63fb02e8c4 tempest-GroupSnapshotsTest-65893310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09e5c707-c630-4b79-91f7-674a418e3970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:42:13 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-f7223c18-de3a-45b9-b4e0-5c63fb02e8c4 tempest-GroupSnapshotsTest-65893310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09e5c707-c630-4b79-91f7-674a418e3970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-264346729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f0a84824-6e22-4a61-b433-6fa8fb9bfc26,host='devstack@QuobyteHD#QuobyteHD',id=b88e65e1-24ef-4cff-8a5a-398e70203169,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9461c1200b2c4eaa9020b032a95fc8b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:42:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:42:13Z,use_quota=True,user_id='ad160e737c8f4a2ea86584b02930cad0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b07a2f59-17af-43d5-9c59-a9676a12bf0f),volume_type_id=b07a2f59-17af-43d5-9c59-a9676a12bf0f)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:42:13 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-f7223c18-de3a-45b9-b4e0-5c63fb02e8c4 tempest-GroupSnapshotsTest-65893310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2813e652-4e39-4546-a554-8ae943e46dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:42:13 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-f7223c18-de3a-45b9-b4e0-5c63fb02e8c4 tempest-GroupSnapshotsTest-65893310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2813e652-4e39-4546-a554-8ae943e46dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:42:13 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-f7223c18-de3a-45b9-b4e0-5c63fb02e8c4 tempest-GroupSnapshotsTest-65893310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ad2eee0-73ff-497f-b5df-aa1d69c6d035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:42:13 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-f7223c18-de3a-45b9-b4e0-5c63fb02e8c4 tempest-GroupSnapshotsTest-65893310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ad2eee0-73ff-497f-b5df-aa1d69c6d035) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b88e65e1-24ef-4cff-8a5a-398e70203169', 'volume_name': 'volume-b88e65e1-24ef-4cff-8a5a-398e70203169', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:42:13 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-f7223c18-de3a-45b9-b4e0-5c63fb02e8c4 tempest-GroupSnapshotsTest-65893310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab7e7112-e3f9-4d2f-b9f8-bc8df643e1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:42:13 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-f7223c18-de3a-45b9-b4e0-5c63fb02e8c4 tempest-GroupSnapshotsTest-65893310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab7e7112-e3f9-4d2f-b9f8-bc8df643e1f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:42:13 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-f7223c18-de3a-45b9-b4e0-5c63fb02e8c4 tempest-GroupSnapshotsTest-65893310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (732179d9-d287-400f-afbd-b669b1ce61be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:42:13 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-f7223c18-de3a-45b9-b4e0-5c63fb02e8c4 tempest-GroupSnapshotsTest-65893310 None] Volume b88e65e1-24ef-4cff-8a5a-398e70203169: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b88e65e1-24ef-4cff-8a5a-398e70203169', 'volume_size': 1} Sep 04 22:42:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f7223c18-de3a-45b9-b4e0-5c63fb02e8c4 tempest-GroupSnapshotsTest-65893310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:42:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f7223c18-de3a-45b9-b4e0-5c63fb02e8c4 tempest-GroupSnapshotsTest-65893310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:42:13 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-f7223c18-de3a-45b9-b4e0-5c63fb02e8c4 tempest-GroupSnapshotsTest-65893310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f0a84824-6e22-4a61-b433-6fa8fb9bfc26,created_at=2026-09-04T20:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-264346729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f0a84824-6e22-4a61-b433-6fa8fb9bfc26,host='devstack@QuobyteHD#QuobyteHD',id=b88e65e1-24ef-4cff-8a5a-398e70203169,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9461c1200b2c4eaa9020b032a95fc8b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:42:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:42:13Z,use_quota=True,user_id='ad160e737c8f4a2ea86584b02930cad0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b07a2f59-17af-43d5-9c59-a9676a12bf0f),volume_type_id=b07a2f59-17af-43d5-9c59-a9676a12bf0f)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:42:13 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-f7223c18-de3a-45b9-b4e0-5c63fb02e8c4 tempest-GroupSnapshotsTest-65893310 None] Creating volume b88e65e1-24ef-4cff-8a5a-398e70203169 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:42:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f7223c18-de3a-45b9-b4e0-5c63fb02e8c4 tempest-GroupSnapshotsTest-65893310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:42:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f7223c18-de3a-45b9-b4e0-5c63fb02e8c4 tempest-GroupSnapshotsTest-65893310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:42:13 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-f7223c18-de3a-45b9-b4e0-5c63fb02e8c4 tempest-GroupSnapshotsTest-65893310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:42:13 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-f7223c18-de3a-45b9-b4e0-5c63fb02e8c4 tempest-GroupSnapshotsTest-65893310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:42:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f7223c18-de3a-45b9-b4e0-5c63fb02e8c4 tempest-GroupSnapshotsTest-65893310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:42:13 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-f7223c18-de3a-45b9-b4e0-5c63fb02e8c4 tempest-GroupSnapshotsTest-65893310 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:42:13 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-f7223c18-de3a-45b9-b4e0-5c63fb02e8c4 tempest-GroupSnapshotsTest-65893310 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:42:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f7223c18-de3a-45b9-b4e0-5c63fb02e8c4 tempest-GroupSnapshotsTest-65893310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b88e65e1-24ef-4cff-8a5a-398e70203169 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:13 devstack sudo[91620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b88e65e1-24ef-4cff-8a5a-398e70203169 1073741824 Sep 04 22:42:13 devstack sudo[91620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:14 devstack sudo[91620]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f7223c18-de3a-45b9-b4e0-5c63fb02e8c4 tempest-GroupSnapshotsTest-65893310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b88e65e1-24ef-4cff-8a5a-398e70203169 1073741824" returned: 0 in 0.980s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f7223c18-de3a-45b9-b4e0-5c63fb02e8c4 tempest-GroupSnapshotsTest-65893310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b88e65e1-24ef-4cff-8a5a-398e70203169 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:14 devstack sudo[91625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b88e65e1-24ef-4cff-8a5a-398e70203169 Sep 04 22:42:14 devstack sudo[91625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:15 devstack sudo[91625]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f7223c18-de3a-45b9-b4e0-5c63fb02e8c4 tempest-GroupSnapshotsTest-65893310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b88e65e1-24ef-4cff-8a5a-398e70203169" returned: 0 in 0.815s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:15 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-f7223c18-de3a-45b9-b4e0-5c63fb02e8c4 tempest-GroupSnapshotsTest-65893310 None] <== create_volume: return (1899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:42:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f7223c18-de3a-45b9-b4e0-5c63fb02e8c4 tempest-GroupSnapshotsTest-65893310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.902s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:42:15 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-f7223c18-de3a-45b9-b4e0-5c63fb02e8c4 tempest-GroupSnapshotsTest-65893310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (732179d9-d287-400f-afbd-b669b1ce61be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b88e65e1-24ef-4cff-8a5a-398e70203169', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:42:15 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-f7223c18-de3a-45b9-b4e0-5c63fb02e8c4 tempest-GroupSnapshotsTest-65893310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae57bcce-ba8f-4a04-983a-76ea79b29ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:42:15 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-f7223c18-de3a-45b9-b4e0-5c63fb02e8c4 tempest-GroupSnapshotsTest-65893310 None] Volume volume-b88e65e1-24ef-4cff-8a5a-398e70203169 (b88e65e1-24ef-4cff-8a5a-398e70203169): created successfully Sep 04 22:42:15 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-f7223c18-de3a-45b9-b4e0-5c63fb02e8c4 tempest-GroupSnapshotsTest-65893310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae57bcce-ba8f-4a04-983a-76ea79b29ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:42:15 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-f7223c18-de3a-45b9-b4e0-5c63fb02e8c4 tempest-GroupSnapshotsTest-65893310 None] Flow 'volume_create_manager' (ded76a4c-9932-4679-8f32-730eeca73a80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:42:15 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-f7223c18-de3a-45b9-b4e0-5c63fb02e8c4 tempest-GroupSnapshotsTest-65893310 None] Created volume successfully. Sep 04 22:42:17 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-64e741a4-fc7f-48cf-bc14-128435de6acc tempest-GroupSnapshotsTest-65893310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:42:17 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-64e741a4-fc7f-48cf-bc14-128435de6acc tempest-GroupSnapshotsTest-65893310 None] Flow 'volume_create_manager' (e7d4081a-51e6-4761-a8c5-37cecc635572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:42:17 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-64e741a4-fc7f-48cf-bc14-128435de6acc tempest-GroupSnapshotsTest-65893310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ea021d8-63af-4665-ac0d-119d10503ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:42:17 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-64e741a4-fc7f-48cf-bc14-128435de6acc tempest-GroupSnapshotsTest-65893310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ea021d8-63af-4665-ac0d-119d10503ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:42:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-990584158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f0a84824-6e22-4a61-b433-6fa8fb9bfc26,host='devstack@QuobyteHD#QuobyteHD',id=fea08aae-a5f9-47d8-9e19-dd4351286db9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9461c1200b2c4eaa9020b032a95fc8b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:42:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:42:17Z,use_quota=True,user_id='ad160e737c8f4a2ea86584b02930cad0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b07a2f59-17af-43d5-9c59-a9676a12bf0f),volume_type_id=b07a2f59-17af-43d5-9c59-a9676a12bf0f)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:42:17 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-64e741a4-fc7f-48cf-bc14-128435de6acc tempest-GroupSnapshotsTest-65893310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e4d1a00-26d9-4e81-a4be-c9d93d964f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:42:17 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-64e741a4-fc7f-48cf-bc14-128435de6acc tempest-GroupSnapshotsTest-65893310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e4d1a00-26d9-4e81-a4be-c9d93d964f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:42:17 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-64e741a4-fc7f-48cf-bc14-128435de6acc tempest-GroupSnapshotsTest-65893310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (031cfaca-9d95-4462-80f1-e89ee311a5c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:42:17 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-64e741a4-fc7f-48cf-bc14-128435de6acc tempest-GroupSnapshotsTest-65893310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (031cfaca-9d95-4462-80f1-e89ee311a5c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fea08aae-a5f9-47d8-9e19-dd4351286db9', 'volume_name': 'volume-fea08aae-a5f9-47d8-9e19-dd4351286db9', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:42:17 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-64e741a4-fc7f-48cf-bc14-128435de6acc tempest-GroupSnapshotsTest-65893310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61d88726-4887-4a61-b620-8675c33667e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:42:17 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-64e741a4-fc7f-48cf-bc14-128435de6acc tempest-GroupSnapshotsTest-65893310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61d88726-4887-4a61-b620-8675c33667e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:42:17 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-64e741a4-fc7f-48cf-bc14-128435de6acc tempest-GroupSnapshotsTest-65893310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab94c4a3-874d-4097-a739-5b94501057a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:42:17 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-64e741a4-fc7f-48cf-bc14-128435de6acc tempest-GroupSnapshotsTest-65893310 None] Volume fea08aae-a5f9-47d8-9e19-dd4351286db9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fea08aae-a5f9-47d8-9e19-dd4351286db9', 'volume_size': 1} Sep 04 22:42:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-64e741a4-fc7f-48cf-bc14-128435de6acc tempest-GroupSnapshotsTest-65893310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:42:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-64e741a4-fc7f-48cf-bc14-128435de6acc tempest-GroupSnapshotsTest-65893310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:42:17 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-64e741a4-fc7f-48cf-bc14-128435de6acc tempest-GroupSnapshotsTest-65893310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f0a84824-6e22-4a61-b433-6fa8fb9bfc26,created_at=2026-09-04T20:42:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-990584158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f0a84824-6e22-4a61-b433-6fa8fb9bfc26,host='devstack@QuobyteHD#QuobyteHD',id=fea08aae-a5f9-47d8-9e19-dd4351286db9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9461c1200b2c4eaa9020b032a95fc8b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:42:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:42:17Z,use_quota=True,user_id='ad160e737c8f4a2ea86584b02930cad0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b07a2f59-17af-43d5-9c59-a9676a12bf0f),volume_type_id=b07a2f59-17af-43d5-9c59-a9676a12bf0f)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:42:17 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-64e741a4-fc7f-48cf-bc14-128435de6acc tempest-GroupSnapshotsTest-65893310 None] Creating volume fea08aae-a5f9-47d8-9e19-dd4351286db9 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:42:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-64e741a4-fc7f-48cf-bc14-128435de6acc tempest-GroupSnapshotsTest-65893310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:42:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-64e741a4-fc7f-48cf-bc14-128435de6acc tempest-GroupSnapshotsTest-65893310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:42:17 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-64e741a4-fc7f-48cf-bc14-128435de6acc tempest-GroupSnapshotsTest-65893310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:42:17 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-64e741a4-fc7f-48cf-bc14-128435de6acc tempest-GroupSnapshotsTest-65893310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:42:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-64e741a4-fc7f-48cf-bc14-128435de6acc tempest-GroupSnapshotsTest-65893310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:42:17 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-64e741a4-fc7f-48cf-bc14-128435de6acc tempest-GroupSnapshotsTest-65893310 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:42:17 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-64e741a4-fc7f-48cf-bc14-128435de6acc tempest-GroupSnapshotsTest-65893310 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:42:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-64e741a4-fc7f-48cf-bc14-128435de6acc tempest-GroupSnapshotsTest-65893310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fea08aae-a5f9-47d8-9e19-dd4351286db9 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:17 devstack sudo[91690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fea08aae-a5f9-47d8-9e19-dd4351286db9 1073741824 Sep 04 22:42:17 devstack sudo[91690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:17 devstack sudo[91690]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-64e741a4-fc7f-48cf-bc14-128435de6acc tempest-GroupSnapshotsTest-65893310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fea08aae-a5f9-47d8-9e19-dd4351286db9 1073741824" returned: 0 in 0.572s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-64e741a4-fc7f-48cf-bc14-128435de6acc tempest-GroupSnapshotsTest-65893310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fea08aae-a5f9-47d8-9e19-dd4351286db9 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:17 devstack sudo[91733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fea08aae-a5f9-47d8-9e19-dd4351286db9 Sep 04 22:42:17 devstack sudo[91733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:18 devstack sudo[91733]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-64e741a4-fc7f-48cf-bc14-128435de6acc tempest-GroupSnapshotsTest-65893310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fea08aae-a5f9-47d8-9e19-dd4351286db9" returned: 0 in 0.530s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:18 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-64e741a4-fc7f-48cf-bc14-128435de6acc tempest-GroupSnapshotsTest-65893310 None] <== create_volume: return (1167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:42:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-64e741a4-fc7f-48cf-bc14-128435de6acc tempest-GroupSnapshotsTest-65893310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.178s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:42:18 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-64e741a4-fc7f-48cf-bc14-128435de6acc tempest-GroupSnapshotsTest-65893310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab94c4a3-874d-4097-a739-5b94501057a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fea08aae-a5f9-47d8-9e19-dd4351286db9', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:42:18 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-64e741a4-fc7f-48cf-bc14-128435de6acc tempest-GroupSnapshotsTest-65893310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da76f96e-632b-4a7b-ac75-f9c8c9116a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:42:18 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-64e741a4-fc7f-48cf-bc14-128435de6acc tempest-GroupSnapshotsTest-65893310 None] Volume volume-fea08aae-a5f9-47d8-9e19-dd4351286db9 (fea08aae-a5f9-47d8-9e19-dd4351286db9): created successfully Sep 04 22:42:18 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-64e741a4-fc7f-48cf-bc14-128435de6acc tempest-GroupSnapshotsTest-65893310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da76f96e-632b-4a7b-ac75-f9c8c9116a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:42:18 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-64e741a4-fc7f-48cf-bc14-128435de6acc tempest-GroupSnapshotsTest-65893310 None] Flow 'volume_create_manager' (e7d4081a-51e6-4761-a8c5-37cecc635572) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:42:18 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-64e741a4-fc7f-48cf-bc14-128435de6acc tempest-GroupSnapshotsTest-65893310 None] Created volume successfully. Sep 04 22:42:18 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bdb0274-fa78-433e-9e08-d2d16ea1f5b0 tempest-VolumesTransfersV355Test-1014648654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:42:18 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-8bdb0274-fa78-433e-9e08-d2d16ea1f5b0 tempest-VolumesTransfersV355Test-1014648654 None] Flow 'volume_create_manager' (b3813301-88cc-4096-ad99-0c9bbdb8925e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:42:18 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-8bdb0274-fa78-433e-9e08-d2d16ea1f5b0 tempest-VolumesTransfersV355Test-1014648654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (372034f0-ab74-4a63-9390-1e732b1e1cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:42:18 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-8bdb0274-fa78-433e-9e08-d2d16ea1f5b0 tempest-VolumesTransfersV355Test-1014648654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (372034f0-ab74-4a63-9390-1e732b1e1cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:42:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-158724133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c0f34e6-1759-45d4-b397-eca91c18e071,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d52023228226438fb364440a860a463f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:42:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:42:19Z,use_quota=True,user_id='e63c25156ca6428a820b428b1a07e5fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:42:18 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-8bdb0274-fa78-433e-9e08-d2d16ea1f5b0 tempest-VolumesTransfersV355Test-1014648654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78c0384c-bd9a-4c17-9a56-2bbf614aff64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:42:18 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-8bdb0274-fa78-433e-9e08-d2d16ea1f5b0 tempest-VolumesTransfersV355Test-1014648654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78c0384c-bd9a-4c17-9a56-2bbf614aff64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:42:18 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-8bdb0274-fa78-433e-9e08-d2d16ea1f5b0 tempest-VolumesTransfersV355Test-1014648654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d545a5e-a3de-45ec-9b73-5a9167a2826f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:42:18 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-8bdb0274-fa78-433e-9e08-d2d16ea1f5b0 tempest-VolumesTransfersV355Test-1014648654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d545a5e-a3de-45ec-9b73-5a9167a2826f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c0f34e6-1759-45d4-b397-eca91c18e071', 'volume_name': 'volume-0c0f34e6-1759-45d4-b397-eca91c18e071', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:42:18 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-8bdb0274-fa78-433e-9e08-d2d16ea1f5b0 tempest-VolumesTransfersV355Test-1014648654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93441727-599d-476e-a1ba-747079661836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:42:18 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-8bdb0274-fa78-433e-9e08-d2d16ea1f5b0 tempest-VolumesTransfersV355Test-1014648654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93441727-599d-476e-a1ba-747079661836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:42:18 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-8bdb0274-fa78-433e-9e08-d2d16ea1f5b0 tempest-VolumesTransfersV355Test-1014648654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63b84cdc-22ac-4056-86b6-f99b57526486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:42:18 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-8bdb0274-fa78-433e-9e08-d2d16ea1f5b0 tempest-VolumesTransfersV355Test-1014648654 None] Volume 0c0f34e6-1759-45d4-b397-eca91c18e071: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c0f34e6-1759-45d4-b397-eca91c18e071', 'volume_size': 1} Sep 04 22:42:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-8bdb0274-fa78-433e-9e08-d2d16ea1f5b0 tempest-VolumesTransfersV355Test-1014648654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:42:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-8bdb0274-fa78-433e-9e08-d2d16ea1f5b0 tempest-VolumesTransfersV355Test-1014648654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:42:18 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-8bdb0274-fa78-433e-9e08-d2d16ea1f5b0 tempest-VolumesTransfersV355Test-1014648654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:42:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-158724133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c0f34e6-1759-45d4-b397-eca91c18e071,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d52023228226438fb364440a860a463f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:42:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:42:19Z,use_quota=True,user_id='e63c25156ca6428a820b428b1a07e5fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:42:18 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-8bdb0274-fa78-433e-9e08-d2d16ea1f5b0 tempest-VolumesTransfersV355Test-1014648654 None] Creating volume 0c0f34e6-1759-45d4-b397-eca91c18e071 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:42:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-8bdb0274-fa78-433e-9e08-d2d16ea1f5b0 tempest-VolumesTransfersV355Test-1014648654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:42:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-8bdb0274-fa78-433e-9e08-d2d16ea1f5b0 tempest-VolumesTransfersV355Test-1014648654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:42:18 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-8bdb0274-fa78-433e-9e08-d2d16ea1f5b0 tempest-VolumesTransfersV355Test-1014648654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:42:18 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-8bdb0274-fa78-433e-9e08-d2d16ea1f5b0 tempest-VolumesTransfersV355Test-1014648654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:42:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-8bdb0274-fa78-433e-9e08-d2d16ea1f5b0 tempest-VolumesTransfersV355Test-1014648654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:42:18 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-8bdb0274-fa78-433e-9e08-d2d16ea1f5b0 tempest-VolumesTransfersV355Test-1014648654 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:42:18 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-8bdb0274-fa78-433e-9e08-d2d16ea1f5b0 tempest-VolumesTransfersV355Test-1014648654 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:42:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-8bdb0274-fa78-433e-9e08-d2d16ea1f5b0 tempest-VolumesTransfersV355Test-1014648654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-0c0f34e6-1759-45d4-b397-eca91c18e071 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:18 devstack sudo[91737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-0c0f34e6-1759-45d4-b397-eca91c18e071 1073741824 Sep 04 22:42:18 devstack sudo[91737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:19 devstack sudo[91737]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:19 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-8bdb0274-fa78-433e-9e08-d2d16ea1f5b0 tempest-VolumesTransfersV355Test-1014648654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-0c0f34e6-1759-45d4-b397-eca91c18e071 1073741824" returned: 0 in 0.412s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:19 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-8bdb0274-fa78-433e-9e08-d2d16ea1f5b0 tempest-VolumesTransfersV355Test-1014648654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-0c0f34e6-1759-45d4-b397-eca91c18e071 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:19 devstack sudo[91742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-0c0f34e6-1759-45d4-b397-eca91c18e071 Sep 04 22:42:19 devstack sudo[91742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:19 devstack sudo[91742]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:19 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-8bdb0274-fa78-433e-9e08-d2d16ea1f5b0 tempest-VolumesTransfersV355Test-1014648654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-0c0f34e6-1759-45d4-b397-eca91c18e071" returned: 0 in 0.285s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:19 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-8bdb0274-fa78-433e-9e08-d2d16ea1f5b0 tempest-VolumesTransfersV355Test-1014648654 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:42:19 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-8bdb0274-fa78-433e-9e08-d2d16ea1f5b0 tempest-VolumesTransfersV355Test-1014648654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:42:19 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-8bdb0274-fa78-433e-9e08-d2d16ea1f5b0 tempest-VolumesTransfersV355Test-1014648654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63b84cdc-22ac-4056-86b6-f99b57526486) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c0f34e6-1759-45d4-b397-eca91c18e071', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:42:19 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-8bdb0274-fa78-433e-9e08-d2d16ea1f5b0 tempest-VolumesTransfersV355Test-1014648654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (858eabbc-15d5-4afb-8c17-a231e8a49401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:42:19 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-8bdb0274-fa78-433e-9e08-d2d16ea1f5b0 tempest-VolumesTransfersV355Test-1014648654 None] Volume volume-0c0f34e6-1759-45d4-b397-eca91c18e071 (0c0f34e6-1759-45d4-b397-eca91c18e071): created successfully Sep 04 22:42:19 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-8bdb0274-fa78-433e-9e08-d2d16ea1f5b0 tempest-VolumesTransfersV355Test-1014648654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (858eabbc-15d5-4afb-8c17-a231e8a49401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:42:19 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-8bdb0274-fa78-433e-9e08-d2d16ea1f5b0 tempest-VolumesTransfersV355Test-1014648654 None] Flow 'volume_create_manager' (b3813301-88cc-4096-ad99-0c9bbdb8925e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:42:19 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-8bdb0274-fa78-433e-9e08-d2d16ea1f5b0 tempest-VolumesTransfersV355Test-1014648654 None] Created volume successfully. Sep 04 22:42:19 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-93ae00c7-40b4-4523-a923-4f95f877b2ee tempest-ServerRescueNegativeTestJSON-998210410 None] Acquiring lock "cinder-2d904143-3926-41a7-9aef-a04dc4fe046a-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:42:19 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-93ae00c7-40b4-4523-a923-4f95f877b2ee tempest-ServerRescueNegativeTestJSON-998210410 None] Lock "cinder-2d904143-3926-41a7-9aef-a04dc4fe046a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:42:20 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-aabadbc8-1ae2-4737-959f-5852a0e6c398 tempest-GroupSnapshotsTest-65893310 None] Update group completed successfully. Sep 04 22:42:20 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-93ae00c7-40b4-4523-a923-4f95f877b2ee tempest-ServerRescueNegativeTestJSON-998210410 None] Acquiring lock "cinder-quobyte-2d904143-3926-41a7-9aef-a04dc4fe046a" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:42:20 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-93ae00c7-40b4-4523-a923-4f95f877b2ee tempest-ServerRescueNegativeTestJSON-998210410 None] Lock "cinder-quobyte-2d904143-3926-41a7-9aef-a04dc4fe046a" acquired by "delete_volume" :: waited 0.019s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:42:20 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[96496d4d-9f94-4c18-9b40-5f203f34be0c]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:42:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-93ae00c7-40b4-4523-a923-4f95f877b2ee tempest-ServerRescueNegativeTestJSON-998210410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-2d904143-3926-41a7-9aef-a04dc4fe046a {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:20 devstack sudo[91745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-2d904143-3926-41a7-9aef-a04dc4fe046a Sep 04 22:42:20 devstack sudo[91745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:20 devstack sudo[91745]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-93ae00c7-40b4-4523-a923-4f95f877b2ee tempest-ServerRescueNegativeTestJSON-998210410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-2d904143-3926-41a7-9aef-a04dc4fe046a" returned: 0 in 0.406s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-93ae00c7-40b4-4523-a923-4f95f877b2ee tempest-ServerRescueNegativeTestJSON-998210410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-2d904143-3926-41a7-9aef-a04dc4fe046a {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:20 devstack sudo[91750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-2d904143-3926-41a7-9aef-a04dc4fe046a Sep 04 22:42:20 devstack sudo[91750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:20 devstack sudo[91750]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-93ae00c7-40b4-4523-a923-4f95f877b2ee tempest-ServerRescueNegativeTestJSON-998210410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-2d904143-3926-41a7-9aef-a04dc4fe046a" returned: 0 in 0.294s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:20 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-93ae00c7-40b4-4523-a923-4f95f877b2ee tempest-ServerRescueNegativeTestJSON-998210410 None] Lock "cinder-quobyte-2d904143-3926-41a7-9aef-a04dc4fe046a" released by "delete_volume" :: held 0.755s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:42:20 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-93ae00c7-40b4-4523-a923-4f95f877b2ee tempest-ServerRescueNegativeTestJSON-998210410 None] Created reservations ['07ed44a6-933c-420d-9dc7-5cca7a7c9088', '3ae05acd-5727-42cd-9632-6af08185e50b', '52b059e2-6cd6-412e-a5e2-4419b8e517e3', '5d6467c8-e42d-40e3-9b79-e1799fabf4bf'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:42:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-93ae00c7-40b4-4523-a923-4f95f877b2ee tempest-ServerRescueNegativeTestJSON-998210410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:42:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-93ae00c7-40b4-4523-a923-4f95f877b2ee tempest-ServerRescueNegativeTestJSON-998210410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:42:20 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-93ae00c7-40b4-4523-a923-4f95f877b2ee tempest-ServerRescueNegativeTestJSON-998210410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:42:20 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-93ae00c7-40b4-4523-a923-4f95f877b2ee tempest-ServerRescueNegativeTestJSON-998210410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:42:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-93ae00c7-40b4-4523-a923-4f95f877b2ee tempest-ServerRescueNegativeTestJSON-998210410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:42:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-93ae00c7-40b4-4523-a923-4f95f877b2ee tempest-ServerRescueNegativeTestJSON-998210410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:21 devstack sudo[91753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:42:21 devstack sudo[91753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:21 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-70e3a616-9952-4ec7-a4db-b5a8426cf024 tempest-VolumesTransfersV355Test-1532547630 None] Transfer volume completed successfully. Sep 04 22:42:21 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-8f2fab0c-e7d5-475a-9f5f-b2c0c12e3cd0 tempest-GroupSnapshotsTest-65893310 None] Update group completed successfully. Sep 04 22:42:21 devstack sudo[91753]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-93ae00c7-40b4-4523-a923-4f95f877b2ee tempest-ServerRescueNegativeTestJSON-998210410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.431s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:21 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-93ae00c7-40b4-4523-a923-4f95f877b2ee tempest-ServerRescueNegativeTestJSON-998210410 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:42:21 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-93ae00c7-40b4-4523-a923-4f95f877b2ee tempest-ServerRescueNegativeTestJSON-998210410 None] Deleted volume successfully. Sep 04 22:42:21 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-93ae00c7-40b4-4523-a923-4f95f877b2ee tempest-ServerRescueNegativeTestJSON-998210410 None] Lock "cinder-2d904143-3926-41a7-9aef-a04dc4fe046a-delete_volume" released by "delete_volume" :: held 1.490s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:42:21 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-e63f657e-d383-4a82-a981-5c412fd21e7c tempest-VolumesTransfersV355Test-689045781 None] Acquiring lock "cinder-0c0f34e6-1759-45d4-b397-eca91c18e071-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:42:21 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-e63f657e-d383-4a82-a981-5c412fd21e7c tempest-VolumesTransfersV355Test-689045781 None] Lock "cinder-0c0f34e6-1759-45d4-b397-eca91c18e071-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:42:22 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-e63f657e-d383-4a82-a981-5c412fd21e7c tempest-VolumesTransfersV355Test-689045781 None] Acquiring lock "cinder-quobyte-0c0f34e6-1759-45d4-b397-eca91c18e071" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:42:22 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-e63f657e-d383-4a82-a981-5c412fd21e7c tempest-VolumesTransfersV355Test-689045781 None] Lock "cinder-quobyte-0c0f34e6-1759-45d4-b397-eca91c18e071" acquired by "delete_volume" :: waited 0.029s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:42:22 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d31133-1cd1-4515-98be-9dcd3bee4404]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:42:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e63f657e-d383-4a82-a981-5c412fd21e7c tempest-VolumesTransfersV355Test-689045781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-0c0f34e6-1759-45d4-b397-eca91c18e071 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:22 devstack sudo[91776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-0c0f34e6-1759-45d4-b397-eca91c18e071 Sep 04 22:42:22 devstack sudo[91776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:22 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-79a74b76-07c7-4c02-b5b9-9485667f29de tempest-GroupSnapshotsTest-65893310 None] Update group completed successfully. Sep 04 22:42:22 devstack sudo[91776]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e63f657e-d383-4a82-a981-5c412fd21e7c tempest-VolumesTransfersV355Test-689045781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-0c0f34e6-1759-45d4-b397-eca91c18e071" returned: 0 in 0.606s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e63f657e-d383-4a82-a981-5c412fd21e7c tempest-VolumesTransfersV355Test-689045781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-0c0f34e6-1759-45d4-b397-eca91c18e071 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:22 devstack sudo[91824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-0c0f34e6-1759-45d4-b397-eca91c18e071 Sep 04 22:42:22 devstack sudo[91824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:23 devstack sudo[91824]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e63f657e-d383-4a82-a981-5c412fd21e7c tempest-VolumesTransfersV355Test-689045781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-0c0f34e6-1759-45d4-b397-eca91c18e071" returned: 0 in 0.440s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:23 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-e63f657e-d383-4a82-a981-5c412fd21e7c tempest-VolumesTransfersV355Test-689045781 None] Lock "cinder-quobyte-0c0f34e6-1759-45d4-b397-eca91c18e071" released by "delete_volume" :: held 1.113s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:42:23 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-e63f657e-d383-4a82-a981-5c412fd21e7c tempest-VolumesTransfersV355Test-689045781 None] Created reservations ['4031f859-63cb-4049-8597-6bace22629f1', '0aea7312-ae71-4faa-a420-a38fee89912e', 'af6ad33d-f7d2-4286-a79b-feb4174e9d74', '62ee6aef-2947-49c7-88e1-c03ec97be25e'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:42:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-e63f657e-d383-4a82-a981-5c412fd21e7c tempest-VolumesTransfersV355Test-689045781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:42:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-e63f657e-d383-4a82-a981-5c412fd21e7c tempest-VolumesTransfersV355Test-689045781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:42:23 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-e63f657e-d383-4a82-a981-5c412fd21e7c tempest-VolumesTransfersV355Test-689045781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:42:23 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-e63f657e-d383-4a82-a981-5c412fd21e7c tempest-VolumesTransfersV355Test-689045781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:42:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-e63f657e-d383-4a82-a981-5c412fd21e7c tempest-VolumesTransfersV355Test-689045781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:42:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e63f657e-d383-4a82-a981-5c412fd21e7c tempest-VolumesTransfersV355Test-689045781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:23 devstack sudo[91830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:42:23 devstack sudo[91830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:23 devstack sudo[91830]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e63f657e-d383-4a82-a981-5c412fd21e7c tempest-VolumesTransfersV355Test-689045781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.413s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:23 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-e63f657e-d383-4a82-a981-5c412fd21e7c tempest-VolumesTransfersV355Test-689045781 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:42:23 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-e63f657e-d383-4a82-a981-5c412fd21e7c tempest-VolumesTransfersV355Test-689045781 None] Deleted volume successfully. Sep 04 22:42:23 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-e63f657e-d383-4a82-a981-5c412fd21e7c tempest-VolumesTransfersV355Test-689045781 None] Lock "cinder-0c0f34e6-1759-45d4-b397-eca91c18e071-delete_volume" released by "delete_volume" :: held 1.946s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:42:24 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-6ad6a836-3ad8-4ee8-a890-6c707647ff95 tempest-GroupSnapshotsTest-65893310 None] Update group completed successfully. Sep 04 22:42:25 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-d650c7a7-a182-403d-9031-33be6547d685 tempest-VolumesTransfersV355Test-1014648654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:42:25 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d650c7a7-a182-403d-9031-33be6547d685 tempest-VolumesTransfersV355Test-1014648654 None] Flow 'volume_create_manager' (32f685fc-4c49-4494-b5c1-ad633e95f535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:42:25 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d650c7a7-a182-403d-9031-33be6547d685 tempest-VolumesTransfersV355Test-1014648654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da867b99-8090-4727-ab14-3e80d8b904a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:42:25 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d650c7a7-a182-403d-9031-33be6547d685 tempest-VolumesTransfersV355Test-1014648654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da867b99-8090-4727-ab14-3e80d8b904a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:42:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-951946250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4b61923-801f-44a7-abbe-68262bba300c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d52023228226438fb364440a860a463f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:42:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:42:25Z,use_quota=True,user_id='e63c25156ca6428a820b428b1a07e5fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:42:25 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d650c7a7-a182-403d-9031-33be6547d685 tempest-VolumesTransfersV355Test-1014648654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df4a1715-a987-4e61-92e5-20dc4f185deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:42:25 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d650c7a7-a182-403d-9031-33be6547d685 tempest-VolumesTransfersV355Test-1014648654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df4a1715-a987-4e61-92e5-20dc4f185deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:42:25 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d650c7a7-a182-403d-9031-33be6547d685 tempest-VolumesTransfersV355Test-1014648654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d698382d-2965-4319-b097-f0e6e85687e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:42:25 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d650c7a7-a182-403d-9031-33be6547d685 tempest-VolumesTransfersV355Test-1014648654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d698382d-2965-4319-b097-f0e6e85687e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4b61923-801f-44a7-abbe-68262bba300c', 'volume_name': 'volume-f4b61923-801f-44a7-abbe-68262bba300c', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:42:25 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d650c7a7-a182-403d-9031-33be6547d685 tempest-VolumesTransfersV355Test-1014648654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29890b23-26d7-48ce-a268-65f7983ef44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:42:25 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d650c7a7-a182-403d-9031-33be6547d685 tempest-VolumesTransfersV355Test-1014648654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29890b23-26d7-48ce-a268-65f7983ef44b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:42:25 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d650c7a7-a182-403d-9031-33be6547d685 tempest-VolumesTransfersV355Test-1014648654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25dc5f8e-88e6-47e3-aa41-b5df8b5b54a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:42:25 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-d650c7a7-a182-403d-9031-33be6547d685 tempest-VolumesTransfersV355Test-1014648654 None] Volume f4b61923-801f-44a7-abbe-68262bba300c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4b61923-801f-44a7-abbe-68262bba300c', 'volume_size': 1} Sep 04 22:42:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-d650c7a7-a182-403d-9031-33be6547d685 tempest-VolumesTransfersV355Test-1014648654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:42:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-d650c7a7-a182-403d-9031-33be6547d685 tempest-VolumesTransfersV355Test-1014648654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:42:25 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-d650c7a7-a182-403d-9031-33be6547d685 tempest-VolumesTransfersV355Test-1014648654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:42:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-951946250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4b61923-801f-44a7-abbe-68262bba300c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d52023228226438fb364440a860a463f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:42:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:42:25Z,use_quota=True,user_id='e63c25156ca6428a820b428b1a07e5fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:42:25 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-d650c7a7-a182-403d-9031-33be6547d685 tempest-VolumesTransfersV355Test-1014648654 None] Creating volume f4b61923-801f-44a7-abbe-68262bba300c {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:42:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-d650c7a7-a182-403d-9031-33be6547d685 tempest-VolumesTransfersV355Test-1014648654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:42:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-d650c7a7-a182-403d-9031-33be6547d685 tempest-VolumesTransfersV355Test-1014648654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:42:25 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-d650c7a7-a182-403d-9031-33be6547d685 tempest-VolumesTransfersV355Test-1014648654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:42:25 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-d650c7a7-a182-403d-9031-33be6547d685 tempest-VolumesTransfersV355Test-1014648654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:42:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-d650c7a7-a182-403d-9031-33be6547d685 tempest-VolumesTransfersV355Test-1014648654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:42:25 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-d650c7a7-a182-403d-9031-33be6547d685 tempest-VolumesTransfersV355Test-1014648654 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:42:25 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-d650c7a7-a182-403d-9031-33be6547d685 tempest-VolumesTransfersV355Test-1014648654 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:42:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d650c7a7-a182-403d-9031-33be6547d685 tempest-VolumesTransfersV355Test-1014648654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f4b61923-801f-44a7-abbe-68262bba300c 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:25 devstack sudo[91854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f4b61923-801f-44a7-abbe-68262bba300c 1073741824 Sep 04 22:42:25 devstack sudo[91854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:26 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-c88831c0-bfd7-44c7-bd74-ecb26561c645 tempest-GroupSnapshotsTest-65893310 None] GroupSnapshot 2536189e-c639-4fa3-bffa-64b1d665da1f: creating. Sep 04 22:42:26 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-c88831c0-bfd7-44c7-bd74-ecb26561c645 tempest-GroupSnapshotsTest-65893310 None] Group snapshot 2536189e-c639-4fa3-bffa-64b1d665da1f: creating. {{(pid=87576) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 04 22:42:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-c88831c0-bfd7-44c7-bd74-ecb26561c645 tempest-GroupSnapshotsTest-65893310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:42:26 devstack sudo[91854]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d650c7a7-a182-403d-9031-33be6547d685 tempest-VolumesTransfersV355Test-1014648654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f4b61923-801f-44a7-abbe-68262bba300c 1073741824" returned: 0 in 0.866s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d650c7a7-a182-403d-9031-33be6547d685 tempest-VolumesTransfersV355Test-1014648654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f4b61923-801f-44a7-abbe-68262bba300c {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:26 devstack sudo[91862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f4b61923-801f-44a7-abbe-68262bba300c Sep 04 22:42:26 devstack sudo[91862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:26 devstack sudo[91862]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d650c7a7-a182-403d-9031-33be6547d685 tempest-VolumesTransfersV355Test-1014648654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f4b61923-801f-44a7-abbe-68262bba300c" returned: 0 in 0.300s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:26 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-d650c7a7-a182-403d-9031-33be6547d685 tempest-VolumesTransfersV355Test-1014648654 None] <== create_volume: return (1226ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:42:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-d650c7a7-a182-403d-9031-33be6547d685 tempest-VolumesTransfersV355Test-1014648654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.232s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:42:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-c88831c0-bfd7-44c7-bd74-ecb26561c645 tempest-GroupSnapshotsTest-65893310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.420s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:42:26 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d650c7a7-a182-403d-9031-33be6547d685 tempest-VolumesTransfersV355Test-1014648654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25dc5f8e-88e6-47e3-aa41-b5df8b5b54a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4b61923-801f-44a7-abbe-68262bba300c', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:42:26 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d650c7a7-a182-403d-9031-33be6547d685 tempest-VolumesTransfersV355Test-1014648654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdd4f86e-a5e7-43c1-b141-110842ad80da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:42:26 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-c88831c0-bfd7-44c7-bd74-ecb26561c645 tempest-GroupSnapshotsTest-65893310 None] Creating offline snapshot 4d6558c2-7203-4bad-8f04-37a0e50c3ca6 of volume fea08aae-a5f9-47d8-9e19-dd4351286db9 {{(pid=87576) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 22:42:26 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-d650c7a7-a182-403d-9031-33be6547d685 tempest-VolumesTransfersV355Test-1014648654 None] Volume volume-f4b61923-801f-44a7-abbe-68262bba300c (f4b61923-801f-44a7-abbe-68262bba300c): created successfully Sep 04 22:42:26 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d650c7a7-a182-403d-9031-33be6547d685 tempest-VolumesTransfersV355Test-1014648654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdd4f86e-a5e7-43c1-b141-110842ad80da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:42:26 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d650c7a7-a182-403d-9031-33be6547d685 tempest-VolumesTransfersV355Test-1014648654 None] Flow 'volume_create_manager' (32f685fc-4c49-4494-b5c1-ad633e95f535) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:42:26 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[508d58f7-6f2c-49c9-bd34-2e80ff5e8588]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:42:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c88831c0-bfd7-44c7-bd74-ecb26561c645 tempest-GroupSnapshotsTest-65893310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fea08aae-a5f9-47d8-9e19-dd4351286db9 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:26 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-d650c7a7-a182-403d-9031-33be6547d685 tempest-VolumesTransfersV355Test-1014648654 None] Created volume successfully. Sep 04 22:42:26 devstack sudo[91867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fea08aae-a5f9-47d8-9e19-dd4351286db9 Sep 04 22:42:26 devstack sudo[91867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:27 devstack sudo[91867]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:27 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c88831c0-bfd7-44c7-bd74-ecb26561c645 tempest-GroupSnapshotsTest-65893310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fea08aae-a5f9-47d8-9e19-dd4351286db9" returned: 0 in 0.446s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:27 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c88831c0-bfd7-44c7-bd74-ecb26561c645 tempest-GroupSnapshotsTest-65893310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fea08aae-a5f9-47d8-9e19-dd4351286db9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fea08aae-a5f9-47d8-9e19-dd4351286db9.4d6558c2-7203-4bad-8f04-37a0e50c3ca6 1G {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:27 devstack sudo[91874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fea08aae-a5f9-47d8-9e19-dd4351286db9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fea08aae-a5f9-47d8-9e19-dd4351286db9.4d6558c2-7203-4bad-8f04-37a0e50c3ca6 1G Sep 04 22:42:27 devstack sudo[91874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:27 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-b2420c82-e23b-41f0-b5d8-933b9d971f3d tempest-VolumesTransfersV355Test-689045781 None] Acquiring lock "cinder-f4b61923-801f-44a7-abbe-68262bba300c-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:42:27 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-b2420c82-e23b-41f0-b5d8-933b9d971f3d tempest-VolumesTransfersV355Test-689045781 None] Lock "cinder-f4b61923-801f-44a7-abbe-68262bba300c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:42:27 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-b2420c82-e23b-41f0-b5d8-933b9d971f3d tempest-VolumesTransfersV355Test-689045781 None] Acquiring lock "cinder-quobyte-f4b61923-801f-44a7-abbe-68262bba300c" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:42:27 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-b2420c82-e23b-41f0-b5d8-933b9d971f3d tempest-VolumesTransfersV355Test-689045781 None] Lock "cinder-quobyte-f4b61923-801f-44a7-abbe-68262bba300c" acquired by "delete_volume" :: waited 0.025s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:42:27 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba7f184-dfc2-4a81-a76c-85bd9955b078]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:42:27 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b2420c82-e23b-41f0-b5d8-933b9d971f3d tempest-VolumesTransfersV355Test-689045781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f4b61923-801f-44a7-abbe-68262bba300c {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:27 devstack sudo[91874]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:27 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c88831c0-bfd7-44c7-bd74-ecb26561c645 tempest-GroupSnapshotsTest-65893310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fea08aae-a5f9-47d8-9e19-dd4351286db9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fea08aae-a5f9-47d8-9e19-dd4351286db9.4d6558c2-7203-4bad-8f04-37a0e50c3ca6 1G" returned: 0 in 0.600s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:27 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c88831c0-bfd7-44c7-bd74-ecb26561c645 tempest-GroupSnapshotsTest-65893310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fea08aae-a5f9-47d8-9e19-dd4351286db9 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fea08aae-a5f9-47d8-9e19-dd4351286db9.4d6558c2-7203-4bad-8f04-37a0e50c3ca6 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:27 devstack sudo[91896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fea08aae-a5f9-47d8-9e19-dd4351286db9 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fea08aae-a5f9-47d8-9e19-dd4351286db9.4d6558c2-7203-4bad-8f04-37a0e50c3ca6 Sep 04 22:42:27 devstack sudo[91896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:27 devstack sudo[91895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f4b61923-801f-44a7-abbe-68262bba300c Sep 04 22:42:27 devstack sudo[91895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:28 devstack sudo[91896]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:28 devstack sudo[91895]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c88831c0-bfd7-44c7-bd74-ecb26561c645 tempest-GroupSnapshotsTest-65893310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fea08aae-a5f9-47d8-9e19-dd4351286db9 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fea08aae-a5f9-47d8-9e19-dd4351286db9.4d6558c2-7203-4bad-8f04-37a0e50c3ca6" returned: 0 in 0.357s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:28 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-c88831c0-bfd7-44c7-bd74-ecb26561c645 tempest-GroupSnapshotsTest-65893310 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fea08aae-a5f9-47d8-9e19-dd4351286db9.4d6558c2-7203-4bad-8f04-37a0e50c3ca6 is being set with open permissions: ugo+rw: NotImplementedError Sep 04 22:42:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c88831c0-bfd7-44c7-bd74-ecb26561c645 tempest-GroupSnapshotsTest-65893310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fea08aae-a5f9-47d8-9e19-dd4351286db9.4d6558c2-7203-4bad-8f04-37a0e50c3ca6 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b2420c82-e23b-41f0-b5d8-933b9d971f3d tempest-VolumesTransfersV355Test-689045781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f4b61923-801f-44a7-abbe-68262bba300c" returned: 0 in 0.416s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b2420c82-e23b-41f0-b5d8-933b9d971f3d tempest-VolumesTransfersV355Test-689045781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f4b61923-801f-44a7-abbe-68262bba300c {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:28 devstack sudo[91905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fea08aae-a5f9-47d8-9e19-dd4351286db9.4d6558c2-7203-4bad-8f04-37a0e50c3ca6 Sep 04 22:42:28 devstack sudo[91905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:28 devstack sudo[91906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f4b61923-801f-44a7-abbe-68262bba300c Sep 04 22:42:28 devstack sudo[91906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:28 devstack sudo[91906]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:28 devstack sudo[91905]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b2420c82-e23b-41f0-b5d8-933b9d971f3d tempest-VolumesTransfersV355Test-689045781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f4b61923-801f-44a7-abbe-68262bba300c" returned: 0 in 0.315s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c88831c0-bfd7-44c7-bd74-ecb26561c645 tempest-GroupSnapshotsTest-65893310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fea08aae-a5f9-47d8-9e19-dd4351286db9.4d6558c2-7203-4bad-8f04-37a0e50c3ca6" returned: 0 in 0.343s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:28 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-b2420c82-e23b-41f0-b5d8-933b9d971f3d tempest-VolumesTransfersV355Test-689045781 None] Lock "cinder-quobyte-f4b61923-801f-44a7-abbe-68262bba300c" released by "delete_volume" :: held 0.795s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:42:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c88831c0-bfd7-44c7-bd74-ecb26561c645 tempest-GroupSnapshotsTest-65893310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fea08aae-a5f9-47d8-9e19-dd4351286db9.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:28 devstack sudo[91916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fea08aae-a5f9-47d8-9e19-dd4351286db9.info Sep 04 22:42:28 devstack sudo[91916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:28 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-b2420c82-e23b-41f0-b5d8-933b9d971f3d tempest-VolumesTransfersV355Test-689045781 None] Created reservations ['798d196a-dde8-4cf9-9bf2-2138ce17530f', 'aa23b1b9-7bed-4abf-b713-f5b0bb3e7bc7', '4801cc15-b08c-4efb-a691-0a8c25bc9daf', 'd11b1e38-7027-488c-b24c-186d33331e0d'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:42:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-b2420c82-e23b-41f0-b5d8-933b9d971f3d tempest-VolumesTransfersV355Test-689045781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:42:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-b2420c82-e23b-41f0-b5d8-933b9d971f3d tempest-VolumesTransfersV355Test-689045781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:42:28 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-b2420c82-e23b-41f0-b5d8-933b9d971f3d tempest-VolumesTransfersV355Test-689045781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:42:28 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-b2420c82-e23b-41f0-b5d8-933b9d971f3d tempest-VolumesTransfersV355Test-689045781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:42:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-b2420c82-e23b-41f0-b5d8-933b9d971f3d tempest-VolumesTransfersV355Test-689045781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:42:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b2420c82-e23b-41f0-b5d8-933b9d971f3d tempest-VolumesTransfersV355Test-689045781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:28 devstack sudo[91918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:42:28 devstack sudo[91918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:28 devstack sudo[91916]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c88831c0-bfd7-44c7-bd74-ecb26561c645 tempest-GroupSnapshotsTest-65893310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fea08aae-a5f9-47d8-9e19-dd4351286db9.info" returned: 0 in 0.471s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:29 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-c88831c0-bfd7-44c7-bd74-ecb26561c645 tempest-GroupSnapshotsTest-65893310 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fea08aae-a5f9-47d8-9e19-dd4351286db9.info is being set with open permissions: ugo+rw: NotImplementedError Sep 04 22:42:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c88831c0-bfd7-44c7-bd74-ecb26561c645 tempest-GroupSnapshotsTest-65893310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fea08aae-a5f9-47d8-9e19-dd4351286db9.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:29 devstack sudo[91930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fea08aae-a5f9-47d8-9e19-dd4351286db9.info Sep 04 22:42:29 devstack sudo[91930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:29 devstack sudo[91918]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b2420c82-e23b-41f0-b5d8-933b9d971f3d tempest-VolumesTransfersV355Test-689045781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.391s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:29 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-b2420c82-e23b-41f0-b5d8-933b9d971f3d tempest-VolumesTransfersV355Test-689045781 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:42:29 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-b2420c82-e23b-41f0-b5d8-933b9d971f3d tempest-VolumesTransfersV355Test-689045781 None] Deleted volume successfully. Sep 04 22:42:29 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-b2420c82-e23b-41f0-b5d8-933b9d971f3d tempest-VolumesTransfersV355Test-689045781 None] Lock "cinder-f4b61923-801f-44a7-abbe-68262bba300c-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:42:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-3f8dad7f-344c-40ac-8798-6a7ce9a2e708 req-5a073508-3f24-48ed-8013-2e2080864058 tempest-ServerActionsTestOtherA-1336516134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:42:29 devstack sudo[91930]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c88831c0-bfd7-44c7-bd74-ecb26561c645 tempest-GroupSnapshotsTest-65893310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fea08aae-a5f9-47d8-9e19-dd4351286db9.info" returned: 0 in 0.323s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-c88831c0-bfd7-44c7-bd74-ecb26561c645 tempest-GroupSnapshotsTest-65893310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.741s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:42:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-c88831c0-bfd7-44c7-bd74-ecb26561c645 tempest-GroupSnapshotsTest-65893310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:42:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-c88831c0-bfd7-44c7-bd74-ecb26561c645 tempest-GroupSnapshotsTest-65893310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:42:29 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-c88831c0-bfd7-44c7-bd74-ecb26561c645 tempest-GroupSnapshotsTest-65893310 None] Creating offline snapshot 5b5badec-81a5-423c-b23d-2cf5b4561faf of volume b88e65e1-24ef-4cff-8a5a-398e70203169 {{(pid=87576) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 22:42:29 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f01f04-1a38-4d77-a926-4fbeec918f10]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:42:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c88831c0-bfd7-44c7-bd74-ecb26561c645 tempest-GroupSnapshotsTest-65893310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b88e65e1-24ef-4cff-8a5a-398e70203169 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:29 devstack sudo[91935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b88e65e1-24ef-4cff-8a5a-398e70203169 Sep 04 22:42:29 devstack sudo[91935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:29 devstack sudo[91935]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c88831c0-bfd7-44c7-bd74-ecb26561c645 tempest-GroupSnapshotsTest-65893310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b88e65e1-24ef-4cff-8a5a-398e70203169" returned: 0 in 0.430s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c88831c0-bfd7-44c7-bd74-ecb26561c645 tempest-GroupSnapshotsTest-65893310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b88e65e1-24ef-4cff-8a5a-398e70203169,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b88e65e1-24ef-4cff-8a5a-398e70203169.5b5badec-81a5-423c-b23d-2cf5b4561faf 1G {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:29 devstack sudo[91940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b88e65e1-24ef-4cff-8a5a-398e70203169,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b88e65e1-24ef-4cff-8a5a-398e70203169.5b5badec-81a5-423c-b23d-2cf5b4561faf 1G Sep 04 22:42:29 devstack sudo[91940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:30 devstack sudo[91940]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c88831c0-bfd7-44c7-bd74-ecb26561c645 tempest-GroupSnapshotsTest-65893310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b88e65e1-24ef-4cff-8a5a-398e70203169,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b88e65e1-24ef-4cff-8a5a-398e70203169.5b5badec-81a5-423c-b23d-2cf5b4561faf 1G" returned: 0 in 0.478s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c88831c0-bfd7-44c7-bd74-ecb26561c645 tempest-GroupSnapshotsTest-65893310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b88e65e1-24ef-4cff-8a5a-398e70203169 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b88e65e1-24ef-4cff-8a5a-398e70203169.5b5badec-81a5-423c-b23d-2cf5b4561faf {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:30 devstack sudo[91946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b88e65e1-24ef-4cff-8a5a-398e70203169 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b88e65e1-24ef-4cff-8a5a-398e70203169.5b5badec-81a5-423c-b23d-2cf5b4561faf Sep 04 22:42:30 devstack sudo[91946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:30 devstack sudo[91946]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c88831c0-bfd7-44c7-bd74-ecb26561c645 tempest-GroupSnapshotsTest-65893310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b88e65e1-24ef-4cff-8a5a-398e70203169 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b88e65e1-24ef-4cff-8a5a-398e70203169.5b5badec-81a5-423c-b23d-2cf5b4561faf" returned: 0 in 0.371s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:30 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-c88831c0-bfd7-44c7-bd74-ecb26561c645 tempest-GroupSnapshotsTest-65893310 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b88e65e1-24ef-4cff-8a5a-398e70203169.5b5badec-81a5-423c-b23d-2cf5b4561faf is being set with open permissions: ugo+rw: NotImplementedError Sep 04 22:42:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c88831c0-bfd7-44c7-bd74-ecb26561c645 tempest-GroupSnapshotsTest-65893310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b88e65e1-24ef-4cff-8a5a-398e70203169.5b5badec-81a5-423c-b23d-2cf5b4561faf {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:30 devstack sudo[91951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b88e65e1-24ef-4cff-8a5a-398e70203169.5b5badec-81a5-423c-b23d-2cf5b4561faf Sep 04 22:42:30 devstack sudo[91951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:30 devstack sudo[91951]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c88831c0-bfd7-44c7-bd74-ecb26561c645 tempest-GroupSnapshotsTest-65893310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b88e65e1-24ef-4cff-8a5a-398e70203169.5b5badec-81a5-423c-b23d-2cf5b4561faf" returned: 0 in 0.272s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c88831c0-bfd7-44c7-bd74-ecb26561c645 tempest-GroupSnapshotsTest-65893310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b88e65e1-24ef-4cff-8a5a-398e70203169.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:31 devstack sudo[91954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b88e65e1-24ef-4cff-8a5a-398e70203169.info Sep 04 22:42:31 devstack sudo[91954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:31 devstack sudo[91954]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c88831c0-bfd7-44c7-bd74-ecb26561c645 tempest-GroupSnapshotsTest-65893310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b88e65e1-24ef-4cff-8a5a-398e70203169.info" returned: 0 in 0.277s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:31 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-c88831c0-bfd7-44c7-bd74-ecb26561c645 tempest-GroupSnapshotsTest-65893310 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b88e65e1-24ef-4cff-8a5a-398e70203169.info is being set with open permissions: ugo+rw: NotImplementedError Sep 04 22:42:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c88831c0-bfd7-44c7-bd74-ecb26561c645 tempest-GroupSnapshotsTest-65893310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b88e65e1-24ef-4cff-8a5a-398e70203169.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:31 devstack sudo[91957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b88e65e1-24ef-4cff-8a5a-398e70203169.info Sep 04 22:42:31 devstack sudo[91957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:31 devstack sudo[91957]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c88831c0-bfd7-44c7-bd74-ecb26561c645 tempest-GroupSnapshotsTest-65893310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b88e65e1-24ef-4cff-8a5a-398e70203169.info" returned: 0 in 0.354s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-c88831c0-bfd7-44c7-bd74-ecb26561c645 tempest-GroupSnapshotsTest-65893310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.317s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:42:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-3f8dad7f-344c-40ac-8798-6a7ce9a2e708 req-5a073508-3f24-48ed-8013-2e2080864058 tempest-ServerActionsTestOtherA-1336516134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.463s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:42:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-3f8dad7f-344c-40ac-8798-6a7ce9a2e708 req-5a073508-3f24-48ed-8013-2e2080864058 tempest-ServerActionsTestOtherA-1336516134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:42:31 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-3f8dad7f-344c-40ac-8798-6a7ce9a2e708 req-5a073508-3f24-48ed-8013-2e2080864058 tempest-ServerActionsTestOtherA-1336516134 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4', 'name': 'volume-281ffbed-1bd7-47c6-80d4-f79b85b22826', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '333e3637-b073-4a2d-a7ec-fd64b6ac05fd', 'enforce_multipath': True} {{(pid=87576) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 22:42:31 devstack cinder-volume[87576]: INFO cinder.volume.manager [req-3f8dad7f-344c-40ac-8798-6a7ce9a2e708 req-5a073508-3f24-48ed-8013-2e2080864058 tempest-ServerActionsTestOtherA-1336516134 None] attachment_update completed successfully. Sep 04 22:42:31 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-c88831c0-bfd7-44c7-bd74-ecb26561c645 tempest-GroupSnapshotsTest-65893310 None] group_snapshot 2536189e-c639-4fa3-bffa-64b1d665da1f: created successfully Sep 04 22:42:32 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-25ed6aa7-ac24-46ed-89ea-9e2dfe313b93 tempest-GroupSnapshotsTest-65893310 None] group_snapshot 2536189e-c639-4fa3-bffa-64b1d665da1f: deleting Sep 04 22:42:32 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-25ed6aa7-ac24-46ed-89ea-9e2dfe313b93 tempest-GroupSnapshotsTest-65893310 None] group_snapshot 2536189e-c639-4fa3-bffa-64b1d665da1f: deleting {{(pid=87576) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 04 22:42:32 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-25ed6aa7-ac24-46ed-89ea-9e2dfe313b93 tempest-GroupSnapshotsTest-65893310 None] Acquiring lock "cinder-quobyte-fea08aae-a5f9-47d8-9e19-dd4351286db9" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:42:32 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-25ed6aa7-ac24-46ed-89ea-9e2dfe313b93 tempest-GroupSnapshotsTest-65893310 None] Lock "cinder-quobyte-fea08aae-a5f9-47d8-9e19-dd4351286db9" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:42:32 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-25ed6aa7-ac24-46ed-89ea-9e2dfe313b93 tempest-GroupSnapshotsTest-65893310 None] Acquiring lock "cinder-quobyte-4d6558c2-7203-4bad-8f04-37a0e50c3ca6" by "_delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:42:32 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-25ed6aa7-ac24-46ed-89ea-9e2dfe313b93 tempest-GroupSnapshotsTest-65893310 None] Lock "cinder-quobyte-4d6558c2-7203-4bad-8f04-37a0e50c3ca6" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:42:33 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-25ed6aa7-ac24-46ed-89ea-9e2dfe313b93 tempest-GroupSnapshotsTest-65893310 None] Deleting offline snapshot 4d6558c2-7203-4bad-8f04-37a0e50c3ca6 of volume fea08aae-a5f9-47d8-9e19-dd4351286db9 {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 22:42:33 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-25ed6aa7-ac24-46ed-89ea-9e2dfe313b93 tempest-GroupSnapshotsTest-65893310 None] snapshot_file for this snap is: volume-fea08aae-a5f9-47d8-9e19-dd4351286db9.4d6558c2-7203-4bad-8f04-37a0e50c3ca6 {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 22:42:33 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[77dd2d08-c24d-4ab0-8264-502320ea41a6]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:42:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-25ed6aa7-ac24-46ed-89ea-9e2dfe313b93 tempest-GroupSnapshotsTest-65893310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fea08aae-a5f9-47d8-9e19-dd4351286db9.4d6558c2-7203-4bad-8f04-37a0e50c3ca6 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:33 devstack sudo[92344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fea08aae-a5f9-47d8-9e19-dd4351286db9.4d6558c2-7203-4bad-8f04-37a0e50c3ca6 Sep 04 22:42:33 devstack sudo[92344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:33 devstack sudo[92344]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-25ed6aa7-ac24-46ed-89ea-9e2dfe313b93 tempest-GroupSnapshotsTest-65893310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fea08aae-a5f9-47d8-9e19-dd4351286db9.4d6558c2-7203-4bad-8f04-37a0e50c3ca6" returned: 0 in 0.525s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:33 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-25ed6aa7-ac24-46ed-89ea-9e2dfe313b93 tempest-GroupSnapshotsTest-65893310 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fea08aae-a5f9-47d8-9e19-dd4351286db9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 22:42:33 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f4a645-6d66-4478-a1a8-232bc79869f9]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:42:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-25ed6aa7-ac24-46ed-89ea-9e2dfe313b93 tempest-GroupSnapshotsTest-65893310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fea08aae-a5f9-47d8-9e19-dd4351286db9 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:33 devstack sudo[92350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fea08aae-a5f9-47d8-9e19-dd4351286db9 Sep 04 22:42:33 devstack sudo[92350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:34 devstack sudo[92350]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:34 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-25ed6aa7-ac24-46ed-89ea-9e2dfe313b93 tempest-GroupSnapshotsTest-65893310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fea08aae-a5f9-47d8-9e19-dd4351286db9" returned: 0 in 0.509s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:34 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-25ed6aa7-ac24-46ed-89ea-9e2dfe313b93 tempest-GroupSnapshotsTest-65893310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fea08aae-a5f9-47d8-9e19-dd4351286db9.4d6558c2-7203-4bad-8f04-37a0e50c3ca6 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:34 devstack sudo[92355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fea08aae-a5f9-47d8-9e19-dd4351286db9.4d6558c2-7203-4bad-8f04-37a0e50c3ca6 Sep 04 22:42:34 devstack sudo[92355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:34 devstack sudo[92355]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:34 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-25ed6aa7-ac24-46ed-89ea-9e2dfe313b93 tempest-GroupSnapshotsTest-65893310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fea08aae-a5f9-47d8-9e19-dd4351286db9.4d6558c2-7203-4bad-8f04-37a0e50c3ca6" returned: 0 in 0.549s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:34 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-25ed6aa7-ac24-46ed-89ea-9e2dfe313b93 tempest-GroupSnapshotsTest-65893310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fea08aae-a5f9-47d8-9e19-dd4351286db9.4d6558c2-7203-4bad-8f04-37a0e50c3ca6 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:34 devstack sudo[92363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fea08aae-a5f9-47d8-9e19-dd4351286db9.4d6558c2-7203-4bad-8f04-37a0e50c3ca6 Sep 04 22:42:34 devstack sudo[92363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-25ed6aa7-ac24-46ed-89ea-9e2dfe313b93 tempest-GroupSnapshotsTest-65893310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fea08aae-a5f9-47d8-9e19-dd4351286db9.4d6558c2-7203-4bad-8f04-37a0e50c3ca6" returned: 0 in 0.349s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:35 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-25ed6aa7-ac24-46ed-89ea-9e2dfe313b93 tempest-GroupSnapshotsTest-65893310 None] Lock "cinder-quobyte-4d6558c2-7203-4bad-8f04-37a0e50c3ca6" released by "_delete_snapshot" :: held 2.090s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:42:35 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-25ed6aa7-ac24-46ed-89ea-9e2dfe313b93 tempest-GroupSnapshotsTest-65893310 None] Lock "cinder-quobyte-fea08aae-a5f9-47d8-9e19-dd4351286db9" released by "delete_snapshot" :: held 2.137s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:42:35 devstack sudo[92363]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:35 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-25ed6aa7-ac24-46ed-89ea-9e2dfe313b93 tempest-GroupSnapshotsTest-65893310 None] Acquiring lock "cinder-quobyte-b88e65e1-24ef-4cff-8a5a-398e70203169" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:42:35 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-25ed6aa7-ac24-46ed-89ea-9e2dfe313b93 tempest-GroupSnapshotsTest-65893310 None] Lock "cinder-quobyte-b88e65e1-24ef-4cff-8a5a-398e70203169" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:42:35 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-25ed6aa7-ac24-46ed-89ea-9e2dfe313b93 tempest-GroupSnapshotsTest-65893310 None] Acquiring lock "cinder-quobyte-5b5badec-81a5-423c-b23d-2cf5b4561faf" by "_delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:42:35 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-25ed6aa7-ac24-46ed-89ea-9e2dfe313b93 tempest-GroupSnapshotsTest-65893310 None] Lock "cinder-quobyte-5b5badec-81a5-423c-b23d-2cf5b4561faf" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:42:35 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-25ed6aa7-ac24-46ed-89ea-9e2dfe313b93 tempest-GroupSnapshotsTest-65893310 None] Deleting offline snapshot 5b5badec-81a5-423c-b23d-2cf5b4561faf of volume b88e65e1-24ef-4cff-8a5a-398e70203169 {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 22:42:35 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-25ed6aa7-ac24-46ed-89ea-9e2dfe313b93 tempest-GroupSnapshotsTest-65893310 None] snapshot_file for this snap is: volume-b88e65e1-24ef-4cff-8a5a-398e70203169.5b5badec-81a5-423c-b23d-2cf5b4561faf {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 22:42:35 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8042cf0-0f4b-4c49-a39b-e531b02689e0]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:42:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-25ed6aa7-ac24-46ed-89ea-9e2dfe313b93 tempest-GroupSnapshotsTest-65893310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b88e65e1-24ef-4cff-8a5a-398e70203169.5b5badec-81a5-423c-b23d-2cf5b4561faf {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:35 devstack sudo[92370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b88e65e1-24ef-4cff-8a5a-398e70203169.5b5badec-81a5-423c-b23d-2cf5b4561faf Sep 04 22:42:35 devstack sudo[92370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-25ed6aa7-ac24-46ed-89ea-9e2dfe313b93 tempest-GroupSnapshotsTest-65893310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b88e65e1-24ef-4cff-8a5a-398e70203169.5b5badec-81a5-423c-b23d-2cf5b4561faf" returned: 0 in 0.470s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:35 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-25ed6aa7-ac24-46ed-89ea-9e2dfe313b93 tempest-GroupSnapshotsTest-65893310 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b88e65e1-24ef-4cff-8a5a-398e70203169(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 22:42:35 devstack sudo[92370]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:35 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[846e7c24-9c3c-41ef-bb62-ff64decc6c72]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:42:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-25ed6aa7-ac24-46ed-89ea-9e2dfe313b93 tempest-GroupSnapshotsTest-65893310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b88e65e1-24ef-4cff-8a5a-398e70203169 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:35 devstack cinder-volume[87576]: INFO cinder.volume.manager [req-a865b002-5216-443c-8b79-2ff07d955821 req-b48bfede-e87a-4162-9b5e-b741acb5b6cf tempest-ServerActionsTestOtherA-1336516134 None] Terminate volume connection completed successfully. Sep 04 22:42:35 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-a865b002-5216-443c-8b79-2ff07d955821 req-b48bfede-e87a-4162-9b5e-b741acb5b6cf tempest-ServerActionsTestOtherA-1336516134 None] Deleting attachment 333e3637-b073-4a2d-a7ec-fd64b6ac05fd. {{(pid=87576) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 22:42:35 devstack sudo[92406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b88e65e1-24ef-4cff-8a5a-398e70203169 Sep 04 22:42:35 devstack sudo[92406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:36 devstack sudo[92406]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-25ed6aa7-ac24-46ed-89ea-9e2dfe313b93 tempest-GroupSnapshotsTest-65893310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b88e65e1-24ef-4cff-8a5a-398e70203169" returned: 0 in 0.681s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-25ed6aa7-ac24-46ed-89ea-9e2dfe313b93 tempest-GroupSnapshotsTest-65893310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b88e65e1-24ef-4cff-8a5a-398e70203169.5b5badec-81a5-423c-b23d-2cf5b4561faf {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:36 devstack sudo[92431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b88e65e1-24ef-4cff-8a5a-398e70203169.5b5badec-81a5-423c-b23d-2cf5b4561faf Sep 04 22:42:36 devstack sudo[92431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-a865b002-5216-443c-8b79-2ff07d955821 req-409712cd-90eb-4d31-bbde-134a61c841a6 tempest-ServerActionsTestOtherA-1336516134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:42:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-a865b002-5216-443c-8b79-2ff07d955821 req-409712cd-90eb-4d31-bbde-134a61c841a6 tempest-ServerActionsTestOtherA-1336516134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:42:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-a865b002-5216-443c-8b79-2ff07d955821 req-409712cd-90eb-4d31-bbde-134a61c841a6 tempest-ServerActionsTestOtherA-1336516134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:42:36 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-a865b002-5216-443c-8b79-2ff07d955821 req-409712cd-90eb-4d31-bbde-134a61c841a6 tempest-ServerActionsTestOtherA-1336516134 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4', 'name': 'volume-281ffbed-1bd7-47c6-80d4-f79b85b22826', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2442aee8-5376-42e5-8852-5c5c614795d0', 'enforce_multipath': True} {{(pid=87576) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 22:42:37 devstack cinder-volume[87576]: INFO cinder.volume.manager [req-a865b002-5216-443c-8b79-2ff07d955821 req-409712cd-90eb-4d31-bbde-134a61c841a6 tempest-ServerActionsTestOtherA-1336516134 None] attachment_update completed successfully. Sep 04 22:42:37 devstack sudo[92431]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:37 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-25ed6aa7-ac24-46ed-89ea-9e2dfe313b93 tempest-GroupSnapshotsTest-65893310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b88e65e1-24ef-4cff-8a5a-398e70203169.5b5badec-81a5-423c-b23d-2cf5b4561faf" returned: 0 in 0.692s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:37 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-25ed6aa7-ac24-46ed-89ea-9e2dfe313b93 tempest-GroupSnapshotsTest-65893310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b88e65e1-24ef-4cff-8a5a-398e70203169.5b5badec-81a5-423c-b23d-2cf5b4561faf {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:37 devstack sudo[92446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b88e65e1-24ef-4cff-8a5a-398e70203169.5b5badec-81a5-423c-b23d-2cf5b4561faf Sep 04 22:42:37 devstack sudo[92446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:37 devstack sudo[92446]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:37 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-25ed6aa7-ac24-46ed-89ea-9e2dfe313b93 tempest-GroupSnapshotsTest-65893310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b88e65e1-24ef-4cff-8a5a-398e70203169.5b5badec-81a5-423c-b23d-2cf5b4561faf" returned: 0 in 0.378s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:37 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-25ed6aa7-ac24-46ed-89ea-9e2dfe313b93 tempest-GroupSnapshotsTest-65893310 None] Lock "cinder-quobyte-5b5badec-81a5-423c-b23d-2cf5b4561faf" released by "_delete_snapshot" :: held 2.366s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:42:37 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-25ed6aa7-ac24-46ed-89ea-9e2dfe313b93 tempest-GroupSnapshotsTest-65893310 None] Lock "cinder-quobyte-b88e65e1-24ef-4cff-8a5a-398e70203169" released by "delete_snapshot" :: held 2.396s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:42:37 devstack cinder-volume[87576]: WARNING cinder.quota [None req-25ed6aa7-ac24-46ed-89ea-9e2dfe313b93 tempest-GroupSnapshotsTest-65893310 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1308289920 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1308289920, it is now deprecated. Please use the default quota class for default quota. Sep 04 22:42:37 devstack cinder-volume[87576]: WARNING cinder.quota [None req-25ed6aa7-ac24-46ed-89ea-9e2dfe313b93 tempest-GroupSnapshotsTest-65893310 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1308289920 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1308289920, it is now deprecated. Please use the default quota class for default quota. Sep 04 22:42:37 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-25ed6aa7-ac24-46ed-89ea-9e2dfe313b93 tempest-GroupSnapshotsTest-65893310 None] Created reservations ['f4feba38-b238-46da-8979-28f897137326', 'd609015b-a1a7-4cb7-b6db-a0fa28dc2000', 'f5be6ee6-2c50-44af-978d-d5ea6ef981e3', '532253b2-a42d-447e-806d-161b06e02e24'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:42:37 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-cec0d8dc-1699-4bd2-a114-eefc148c072a tempest-VolumesExtendTest-1086463602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:42:37 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-cec0d8dc-1699-4bd2-a114-eefc148c072a tempest-VolumesExtendTest-1086463602 None] Flow 'volume_create_manager' (3c5fa09f-2348-4419-afce-c35ab5adf2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:42:37 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-cec0d8dc-1699-4bd2-a114-eefc148c072a tempest-VolumesExtendTest-1086463602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2d9a457-f602-498b-a593-294881276074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:42:37 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-cec0d8dc-1699-4bd2-a114-eefc148c072a tempest-VolumesExtendTest-1086463602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2d9a457-f602-498b-a593-294881276074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:42:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-345839491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c12321ac-ee92-44fa-8b68-b5aa5f3d5cdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d55a483f144947dea89e2dc4734558d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:42:38Z,use_quota=True,user_id='90335bc337ab42caad2f25abf1d08e96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:42:37 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-cec0d8dc-1699-4bd2-a114-eefc148c072a tempest-VolumesExtendTest-1086463602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e32b838-df53-4255-913a-a77de84c1132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:42:37 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-cec0d8dc-1699-4bd2-a114-eefc148c072a tempest-VolumesExtendTest-1086463602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e32b838-df53-4255-913a-a77de84c1132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:42:37 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-cec0d8dc-1699-4bd2-a114-eefc148c072a tempest-VolumesExtendTest-1086463602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d87ab9b0-d2d9-4c96-a9d8-5b9e5756e58e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:42:37 devstack cinder-volume[87576]: DEBUG cinder.image.glance [None req-cec0d8dc-1699-4bd2-a114-eefc148c072a tempest-VolumesExtendTest-1086463602 None] Creating Keystone auth plugin from conf {{(pid=87576) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 04 22:42:38 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-25ed6aa7-ac24-46ed-89ea-9e2dfe313b93 tempest-GroupSnapshotsTest-65893310 None] Created reservations ['3906efee-7e1e-4ec1-91ed-f13ddc5f6142', '0c3ce8ab-24d0-480f-8d33-49641e23cc0e', '0ba782e7-2e2d-4ecb-9f95-8a5f5552c315', 'f5f36a3a-335e-46de-a810-c8244b23a5b3'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:42:38 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-25ed6aa7-ac24-46ed-89ea-9e2dfe313b93 tempest-GroupSnapshotsTest-65893310 None] group_snapshot 2536189e-c639-4fa3-bffa-64b1d665da1f: deleted successfully Sep 04 22:42:38 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-cec0d8dc-1699-4bd2-a114-eefc148c072a tempest-VolumesExtendTest-1086463602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d87ab9b0-d2d9-4c96-a9d8-5b9e5756e58e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c12321ac-ee92-44fa-8b68-b5aa5f3d5cdc', 'volume_name': 'volume-c12321ac-ee92-44fa-8b68-b5aa5f3d5cdc', 'volume_size': 1, 'image_id': '4f8d7a81-6282-4f52-a601-d840d8973365', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4f8d7a81-6282-4f52-a601-d840d8973365', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5d1fd1f571ef419184ac7eda6748fdd3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4f8d7a81-6282-4f52-a601-d840d8973365', 'created_at': datetime.datetime(2026, 9, 4, 20, 33, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 20, 33, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f8d7a81-6282-4f52-a601-d840d8973365/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:42:38 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-cec0d8dc-1699-4bd2-a114-eefc148c072a tempest-VolumesExtendTest-1086463602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe4d578c-67f3-4589-aa79-0e11db07c13a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:42:38 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-cec0d8dc-1699-4bd2-a114-eefc148c072a tempest-VolumesExtendTest-1086463602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe4d578c-67f3-4589-aa79-0e11db07c13a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:42:38 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-cec0d8dc-1699-4bd2-a114-eefc148c072a tempest-VolumesExtendTest-1086463602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26559c00-56d7-4d68-9946-4bc6a6564adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:42:38 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-cec0d8dc-1699-4bd2-a114-eefc148c072a tempest-VolumesExtendTest-1086463602 None] Volume c12321ac-ee92-44fa-8b68-b5aa5f3d5cdc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c12321ac-ee92-44fa-8b68-b5aa5f3d5cdc', 'volume_size': 1, 'image_id': '4f8d7a81-6282-4f52-a601-d840d8973365', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4f8d7a81-6282-4f52-a601-d840d8973365', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5d1fd1f571ef419184ac7eda6748fdd3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4f8d7a81-6282-4f52-a601-d840d8973365', 'created_at': datetime.datetime(2026, 9, 4, 20, 33, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 20, 33, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f8d7a81-6282-4f52-a601-d840d8973365/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 04 22:42:38 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-cec0d8dc-1699-4bd2-a114-eefc148c072a tempest-VolumesExtendTest-1086463602 None] Trying to clone c12321ac-ee92-44fa-8b68-b5aa5f3d5cdc from image 4f8d7a81-6282-4f52-a601-d840d8973365 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4f8d7a81-6282-4f52-a601-d840d8973365', 'metadata': {}}]). {{(pid=87576) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 04 22:42:39 devstack cinder-volume[87576]: DEBUG cinder.image.image_utils [None req-cec0d8dc-1699-4bd2-a114-eefc148c072a tempest-VolumesExtendTest-1086463602 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4f8d7a81-6282-4f52-a601-d840d8973365_0u7plszydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87576) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 04 22:42:39 devstack cinder-volume[87576]: INFO cinder.image.image_utils [None req-cec0d8dc-1699-4bd2-a114-eefc148c072a tempest-VolumesExtendTest-1086463602 None] Image download 20.69 MB at 20.69 MB/s Sep 04 22:42:39 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3bfb90-6d4d-4fce-8760-30c71b0533b3]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:42:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-cec0d8dc-1699-4bd2-a114-eefc148c072a tempest-VolumesExtendTest-1086463602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f8d7a81-6282-4f52-a601-d840d8973365_0u7plszydevstack@QuobyteHD {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:39 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c19e267c-f4b6-4064-aa88-559480cc9394 tempest-GroupSnapshotsTest-65893310 None] Acquiring lock "cinder-quobyte-b88e65e1-24ef-4cff-8a5a-398e70203169" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:42:39 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c19e267c-f4b6-4064-aa88-559480cc9394 tempest-GroupSnapshotsTest-65893310 None] Lock "cinder-quobyte-b88e65e1-24ef-4cff-8a5a-398e70203169" acquired by "delete_volume" :: waited 0.030s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:42:39 devstack sudo[92886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f8d7a81-6282-4f52-a601-d840d8973365_0u7plszydevstack@QuobyteHD Sep 04 22:42:39 devstack sudo[92886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:39 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1502a8d-8946-4712-9f72-41512556fd56]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:42:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c19e267c-f4b6-4064-aa88-559480cc9394 tempest-GroupSnapshotsTest-65893310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b88e65e1-24ef-4cff-8a5a-398e70203169 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:39 devstack sudo[92902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b88e65e1-24ef-4cff-8a5a-398e70203169 Sep 04 22:42:39 devstack sudo[92902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:39 devstack sudo[92886]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-cec0d8dc-1699-4bd2-a114-eefc148c072a tempest-VolumesExtendTest-1086463602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f8d7a81-6282-4f52-a601-d840d8973365_0u7plszydevstack@QuobyteHD" returned: 0 in 0.596s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:39 devstack cinder-volume[87576]: DEBUG cinder.image.image_utils [None req-cec0d8dc-1699-4bd2-a114-eefc148c072a tempest-VolumesExtendTest-1086463602 None] Temporary image 4f8d7a81-6282-4f52-a601-d840d8973365 is fetched for user 90335bc337ab42caad2f25abf1d08e96. {{(pid=87576) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 04 22:42:39 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[e90f2d72-34da-4aa1-8140-c7da19f59ac3]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:42:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-cec0d8dc-1699-4bd2-a114-eefc148c072a tempest-VolumesExtendTest-1086463602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f8d7a81-6282-4f52-a601-d840d8973365_0u7plszydevstack@QuobyteHD {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:40 devstack sudo[92913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f8d7a81-6282-4f52-a601-d840d8973365_0u7plszydevstack@QuobyteHD Sep 04 22:42:40 devstack sudo[92913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:40 devstack sudo[92902]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c19e267c-f4b6-4064-aa88-559480cc9394 tempest-GroupSnapshotsTest-65893310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b88e65e1-24ef-4cff-8a5a-398e70203169" returned: 0 in 0.656s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c19e267c-f4b6-4064-aa88-559480cc9394 tempest-GroupSnapshotsTest-65893310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b88e65e1-24ef-4cff-8a5a-398e70203169 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:40 devstack sudo[92919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b88e65e1-24ef-4cff-8a5a-398e70203169 Sep 04 22:42:40 devstack sudo[92919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:40 devstack sudo[92913]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-cec0d8dc-1699-4bd2-a114-eefc148c072a tempest-VolumesExtendTest-1086463602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f8d7a81-6282-4f52-a601-d840d8973365_0u7plszydevstack@QuobyteHD" returned: 0 in 0.422s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-cec0d8dc-1699-4bd2-a114-eefc148c072a tempest-VolumesExtendTest-1086463602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:42:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-cec0d8dc-1699-4bd2-a114-eefc148c072a tempest-VolumesExtendTest-1086463602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:42:40 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-cec0d8dc-1699-4bd2-a114-eefc148c072a tempest-VolumesExtendTest-1086463602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:42:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-345839491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c12321ac-ee92-44fa-8b68-b5aa5f3d5cdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d55a483f144947dea89e2dc4734558d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:42:38Z,use_quota=True,user_id='90335bc337ab42caad2f25abf1d08e96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:42:40 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-cec0d8dc-1699-4bd2-a114-eefc148c072a tempest-VolumesExtendTest-1086463602 None] Creating volume c12321ac-ee92-44fa-8b68-b5aa5f3d5cdc {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:42:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-cec0d8dc-1699-4bd2-a114-eefc148c072a tempest-VolumesExtendTest-1086463602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:42:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-cec0d8dc-1699-4bd2-a114-eefc148c072a tempest-VolumesExtendTest-1086463602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:42:40 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-cec0d8dc-1699-4bd2-a114-eefc148c072a tempest-VolumesExtendTest-1086463602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:42:40 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-cec0d8dc-1699-4bd2-a114-eefc148c072a tempest-VolumesExtendTest-1086463602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:42:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-cec0d8dc-1699-4bd2-a114-eefc148c072a tempest-VolumesExtendTest-1086463602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:42:40 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-cec0d8dc-1699-4bd2-a114-eefc148c072a tempest-VolumesExtendTest-1086463602 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:42:40 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-cec0d8dc-1699-4bd2-a114-eefc148c072a tempest-VolumesExtendTest-1086463602 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:42:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-cec0d8dc-1699-4bd2-a114-eefc148c072a tempest-VolumesExtendTest-1086463602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c12321ac-ee92-44fa-8b68-b5aa5f3d5cdc 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:40 devstack sudo[92924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c12321ac-ee92-44fa-8b68-b5aa5f3d5cdc 1073741824 Sep 04 22:42:40 devstack sudo[92924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:40 devstack sudo[92919]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c19e267c-f4b6-4064-aa88-559480cc9394 tempest-GroupSnapshotsTest-65893310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b88e65e1-24ef-4cff-8a5a-398e70203169" returned: 0 in 0.381s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:40 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c19e267c-f4b6-4064-aa88-559480cc9394 tempest-GroupSnapshotsTest-65893310 None] Lock "cinder-quobyte-b88e65e1-24ef-4cff-8a5a-398e70203169" released by "delete_volume" :: held 1.194s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:42:40 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c19e267c-f4b6-4064-aa88-559480cc9394 tempest-GroupSnapshotsTest-65893310 None] Acquiring lock "cinder-quobyte-fea08aae-a5f9-47d8-9e19-dd4351286db9" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:42:40 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c19e267c-f4b6-4064-aa88-559480cc9394 tempest-GroupSnapshotsTest-65893310 None] Lock "cinder-quobyte-fea08aae-a5f9-47d8-9e19-dd4351286db9" acquired by "delete_volume" :: waited 0.037s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:42:40 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf81ec1b-e9b0-419d-b81b-9f312b4fb2a2]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:42:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c19e267c-f4b6-4064-aa88-559480cc9394 tempest-GroupSnapshotsTest-65893310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fea08aae-a5f9-47d8-9e19-dd4351286db9 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:41 devstack sudo[92931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fea08aae-a5f9-47d8-9e19-dd4351286db9 Sep 04 22:42:41 devstack sudo[92931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:41 devstack sudo[92924]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-cec0d8dc-1699-4bd2-a114-eefc148c072a tempest-VolumesExtendTest-1086463602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c12321ac-ee92-44fa-8b68-b5aa5f3d5cdc 1073741824" returned: 0 in 0.816s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-cec0d8dc-1699-4bd2-a114-eefc148c072a tempest-VolumesExtendTest-1086463602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c12321ac-ee92-44fa-8b68-b5aa5f3d5cdc {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:41 devstack sudo[92936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c12321ac-ee92-44fa-8b68-b5aa5f3d5cdc Sep 04 22:42:41 devstack sudo[92936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:41 devstack sudo[92931]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c19e267c-f4b6-4064-aa88-559480cc9394 tempest-GroupSnapshotsTest-65893310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fea08aae-a5f9-47d8-9e19-dd4351286db9" returned: 0 in 0.738s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c19e267c-f4b6-4064-aa88-559480cc9394 tempest-GroupSnapshotsTest-65893310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fea08aae-a5f9-47d8-9e19-dd4351286db9 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:41 devstack sudo[92941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fea08aae-a5f9-47d8-9e19-dd4351286db9 Sep 04 22:42:41 devstack sudo[92941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:41 devstack sudo[92936]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-cec0d8dc-1699-4bd2-a114-eefc148c072a tempest-VolumesExtendTest-1086463602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c12321ac-ee92-44fa-8b68-b5aa5f3d5cdc" returned: 0 in 0.527s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:41 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-cec0d8dc-1699-4bd2-a114-eefc148c072a tempest-VolumesExtendTest-1086463602 None] <== create_volume: return (1421ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:42:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-cec0d8dc-1699-4bd2-a114-eefc148c072a tempest-VolumesExtendTest-1086463602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.428s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:42:41 devstack cinder-volume[87576]: DEBUG cinder.volume.volume_utils [None req-cec0d8dc-1699-4bd2-a114-eefc148c072a tempest-VolumesExtendTest-1086463602 None] Attempting download of 4f8d7a81-6282-4f52-a601-d840d8973365 ((None, [{'url': 'file:///opt/stack/data/glance/images/4f8d7a81-6282-4f52-a601-d840d8973365', 'metadata': {}}])) to volume c12321ac-ee92-44fa-8b68-b5aa5f3d5cdc. {{(pid=87576) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 04 22:42:41 devstack sudo[92941]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c19e267c-f4b6-4064-aa88-559480cc9394 tempest-GroupSnapshotsTest-65893310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fea08aae-a5f9-47d8-9e19-dd4351286db9" returned: 0 in 0.380s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:41 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c19e267c-f4b6-4064-aa88-559480cc9394 tempest-GroupSnapshotsTest-65893310 None] Lock "cinder-quobyte-fea08aae-a5f9-47d8-9e19-dd4351286db9" released by "delete_volume" :: held 1.257s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:42:42 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ffc966-bd3f-4081-b24c-4f80dde89974]: (4, 'raw') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:42:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-cec0d8dc-1699-4bd2-a114-eefc148c072a tempest-VolumesExtendTest-1086463602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4f8d7a81-6282-4f52-a601-d840d8973365_yswp8zmg {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:42 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-c19e267c-f4b6-4064-aa88-559480cc9394 tempest-GroupSnapshotsTest-65893310 None] Created reservations ['fa285d33-8c47-4f9e-922b-00f48c63096b'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:42:42 devstack sudo[92945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4f8d7a81-6282-4f52-a601-d840d8973365_yswp8zmg Sep 04 22:42:42 devstack sudo[92945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:42 devstack cinder-volume[87576]: WARNING cinder.quota [None req-c19e267c-f4b6-4064-aa88-559480cc9394 tempest-GroupSnapshotsTest-65893310 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1308289920 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1308289920, it is now deprecated. Please use the default quota class for default quota. Sep 04 22:42:42 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-c19e267c-f4b6-4064-aa88-559480cc9394 tempest-GroupSnapshotsTest-65893310 None] Created reservations ['f0394498-8b89-4484-b861-c69f9864f161', '695d54fc-7f01-47cd-b7d2-99c3144d5756', 'ed978989-b5f7-4e45-9bf9-63d0f56c44c5', '606a1c5b-a14c-42dc-b539-ea9d751fcc1d'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:42:42 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-c19e267c-f4b6-4064-aa88-559480cc9394 tempest-GroupSnapshotsTest-65893310 None] Created reservations ['e5135b35-0e45-43f4-84c5-fdded08885a9', '6e55fdf7-5781-48e1-97fd-d73f4be6f5c9', '70e1d5d9-c7f5-4607-9b6d-b09656f28411', '565370b6-56af-4fcb-bbbe-4c080c76a2ec'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:42:42 devstack sudo[92945]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-cec0d8dc-1699-4bd2-a114-eefc148c072a tempest-VolumesExtendTest-1086463602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4f8d7a81-6282-4f52-a601-d840d8973365_yswp8zmg" returned: 0 in 0.690s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-cec0d8dc-1699-4bd2-a114-eefc148c072a tempest-VolumesExtendTest-1086463602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4f8d7a81-6282-4f52-a601-d840d8973365_yswp8zmg {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-c19e267c-f4b6-4064-aa88-559480cc9394 tempest-GroupSnapshotsTest-65893310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:42:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-c19e267c-f4b6-4064-aa88-559480cc9394 tempest-GroupSnapshotsTest-65893310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:42:42 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-c19e267c-f4b6-4064-aa88-559480cc9394 tempest-GroupSnapshotsTest-65893310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:42:42 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-c19e267c-f4b6-4064-aa88-559480cc9394 tempest-GroupSnapshotsTest-65893310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:42:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-c19e267c-f4b6-4064-aa88-559480cc9394 tempest-GroupSnapshotsTest-65893310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:42:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c19e267c-f4b6-4064-aa88-559480cc9394 tempest-GroupSnapshotsTest-65893310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:42 devstack sudo[92951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:42:42 devstack sudo[92951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:42 devstack sudo[92950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4f8d7a81-6282-4f52-a601-d840d8973365_yswp8zmg Sep 04 22:42:42 devstack sudo[92950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:43 devstack sudo[92950]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-cec0d8dc-1699-4bd2-a114-eefc148c072a tempest-VolumesExtendTest-1086463602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4f8d7a81-6282-4f52-a601-d840d8973365_yswp8zmg" returned: 1 in 0.407s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-cec0d8dc-1699-4bd2-a114-eefc148c072a tempest-VolumesExtendTest-1086463602 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4f8d7a81-6282-4f52-a601-d840d8973365_yswp8zmg' failed. Not Retrying. {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 22:42:43 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[e90a0d20-1e8d-404e-a045-55b287c75ccd]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:42:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-cec0d8dc-1699-4bd2-a114-eefc148c072a tempest-VolumesExtendTest-1086463602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f8d7a81-6282-4f52-a601-d840d8973365_0u7plszydevstack@QuobyteHD {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:43 devstack sudo[92956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f8d7a81-6282-4f52-a601-d840d8973365_0u7plszydevstack@QuobyteHD Sep 04 22:42:43 devstack sudo[92956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:43 devstack sudo[92951]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c19e267c-f4b6-4064-aa88-559480cc9394 tempest-GroupSnapshotsTest-65893310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.563s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:43 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-c19e267c-f4b6-4064-aa88-559480cc9394 tempest-GroupSnapshotsTest-65893310 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:42:43 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-c19e267c-f4b6-4064-aa88-559480cc9394 tempest-GroupSnapshotsTest-65893310 None] Delete group completed successfully. Sep 04 22:42:43 devstack sudo[92956]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-cec0d8dc-1699-4bd2-a114-eefc148c072a tempest-VolumesExtendTest-1086463602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f8d7a81-6282-4f52-a601-d840d8973365_0u7plszydevstack@QuobyteHD" returned: 0 in 0.438s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:43 devstack cinder-volume[87576]: DEBUG cinder.image.image_utils [None req-cec0d8dc-1699-4bd2-a114-eefc148c072a tempest-VolumesExtendTest-1086463602 None] 4f8d7a81-6282-4f52-a601-d840d8973365 was qcow2, converting to qcow2 {{(pid=87576) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 04 22:42:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-cec0d8dc-1699-4bd2-a114-eefc148c072a tempest-VolumesExtendTest-1086463602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4f8d7a81-6282-4f52-a601-d840d8973365_0u7plszydevstack@QuobyteHD /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c12321ac-ee92-44fa-8b68-b5aa5f3d5cdc {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:43 devstack sudo[92963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4f8d7a81-6282-4f52-a601-d840d8973365_0u7plszydevstack@QuobyteHD /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c12321ac-ee92-44fa-8b68-b5aa5f3d5cdc Sep 04 22:42:43 devstack sudo[92963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:44 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-27ad7080-c4ca-4270-aa48-f7128736eecd tempest-GroupSnapshotsTest-65893310 None] Group tempest-GroupSnapshotsTest-Group-458300323: creating Sep 04 22:42:44 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-27ad7080-c4ca-4270-aa48-f7128736eecd tempest-GroupSnapshotsTest-65893310 None] Group tempest-GroupSnapshotsTest-Group-458300323: created successfully Sep 04 22:42:44 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-27ad7080-c4ca-4270-aa48-f7128736eecd tempest-GroupSnapshotsTest-65893310 None] Create group completed successfully. Sep 04 22:42:45 devstack sudo[92963]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:45 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-cec0d8dc-1699-4bd2-a114-eefc148c072a tempest-VolumesExtendTest-1086463602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4f8d7a81-6282-4f52-a601-d840d8973365_0u7plszydevstack@QuobyteHD /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c12321ac-ee92-44fa-8b68-b5aa5f3d5cdc" returned: 0 in 2.409s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:45 devstack cinder-volume[87576]: DEBUG cinder.image.image_utils [None req-cec0d8dc-1699-4bd2-a114-eefc148c072a tempest-VolumesExtendTest-1086463602 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4f8d7a81-6282-4f52-a601-d840d8973365_0u7plszydevstack@QuobyteHD, size 112.00 MB, duration 2.41 sec, destination /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c12321ac-ee92-44fa-8b68-b5aa5f3d5cdc {{(pid=87576) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 22:42:45 devstack cinder-volume[87576]: INFO cinder.image.image_utils [None req-cec0d8dc-1699-4bd2-a114-eefc148c072a tempest-VolumesExtendTest-1086463602 None] Converted 112.00 MB image at 46.41 MB/s Sep 04 22:42:45 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-cec0d8dc-1699-4bd2-a114-eefc148c072a tempest-VolumesExtendTest-1086463602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c12321ac-ee92-44fa-8b68-b5aa5f3d5cdc 1G {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:46 devstack sudo[92977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c12321ac-ee92-44fa-8b68-b5aa5f3d5cdc 1G Sep 04 22:42:46 devstack sudo[92977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:46 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb04120c-5caa-47b9-9596-92a2aff03b46 tempest-GroupSnapshotsTest-65893310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:42:46 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-bb04120c-5caa-47b9-9596-92a2aff03b46 tempest-GroupSnapshotsTest-65893310 None] Flow 'volume_create_manager' (a0b9168b-1f3b-4b93-92bd-0aca3cf17bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:42:46 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-bb04120c-5caa-47b9-9596-92a2aff03b46 tempest-GroupSnapshotsTest-65893310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa9a4025-da5d-47e6-958b-d44b1a8acf28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:42:46 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-bb04120c-5caa-47b9-9596-92a2aff03b46 tempest-GroupSnapshotsTest-65893310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa9a4025-da5d-47e6-958b-d44b1a8acf28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:42:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-803273195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=696e698c-29b9-420b-a8db-1e0993278766,host='devstack@QuobyteHD#QuobyteHD',id=cd028472-cbf3-4ec9-965b-ffe162e185b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9461c1200b2c4eaa9020b032a95fc8b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:42:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:42:46Z,use_quota=True,user_id='ad160e737c8f4a2ea86584b02930cad0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81204117-2c41-407e-a9c5-8f3c8901fe81),volume_type_id=81204117-2c41-407e-a9c5-8f3c8901fe81)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:42:46 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-bb04120c-5caa-47b9-9596-92a2aff03b46 tempest-GroupSnapshotsTest-65893310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb726c9b-57b5-4b0e-9d0d-bc357a925e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:42:46 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-bb04120c-5caa-47b9-9596-92a2aff03b46 tempest-GroupSnapshotsTest-65893310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb726c9b-57b5-4b0e-9d0d-bc357a925e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:42:46 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-bb04120c-5caa-47b9-9596-92a2aff03b46 tempest-GroupSnapshotsTest-65893310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea898886-98c8-460a-9b7a-d9d99ebfd744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:42:46 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-bb04120c-5caa-47b9-9596-92a2aff03b46 tempest-GroupSnapshotsTest-65893310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea898886-98c8-460a-9b7a-d9d99ebfd744) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd028472-cbf3-4ec9-965b-ffe162e185b9', 'volume_name': 'volume-cd028472-cbf3-4ec9-965b-ffe162e185b9', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:42:46 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-bb04120c-5caa-47b9-9596-92a2aff03b46 tempest-GroupSnapshotsTest-65893310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5a45725-6e71-4983-833a-b4c8af35975e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:42:46 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-bb04120c-5caa-47b9-9596-92a2aff03b46 tempest-GroupSnapshotsTest-65893310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5a45725-6e71-4983-833a-b4c8af35975e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:42:46 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-bb04120c-5caa-47b9-9596-92a2aff03b46 tempest-GroupSnapshotsTest-65893310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (497a551a-1e90-4716-b94d-4d35ee92e2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:42:46 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-bb04120c-5caa-47b9-9596-92a2aff03b46 tempest-GroupSnapshotsTest-65893310 None] Volume cd028472-cbf3-4ec9-965b-ffe162e185b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd028472-cbf3-4ec9-965b-ffe162e185b9', 'volume_size': 1} Sep 04 22:42:46 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-bb04120c-5caa-47b9-9596-92a2aff03b46 tempest-GroupSnapshotsTest-65893310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:42:46 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-bb04120c-5caa-47b9-9596-92a2aff03b46 tempest-GroupSnapshotsTest-65893310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:42:46 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-bb04120c-5caa-47b9-9596-92a2aff03b46 tempest-GroupSnapshotsTest-65893310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=696e698c-29b9-420b-a8db-1e0993278766,created_at=2026-09-04T20:42:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-803273195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=696e698c-29b9-420b-a8db-1e0993278766,host='devstack@QuobyteHD#QuobyteHD',id=cd028472-cbf3-4ec9-965b-ffe162e185b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9461c1200b2c4eaa9020b032a95fc8b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:42:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:42:46Z,use_quota=True,user_id='ad160e737c8f4a2ea86584b02930cad0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81204117-2c41-407e-a9c5-8f3c8901fe81),volume_type_id=81204117-2c41-407e-a9c5-8f3c8901fe81)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:42:46 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-bb04120c-5caa-47b9-9596-92a2aff03b46 tempest-GroupSnapshotsTest-65893310 None] Creating volume cd028472-cbf3-4ec9-965b-ffe162e185b9 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:42:46 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-bb04120c-5caa-47b9-9596-92a2aff03b46 tempest-GroupSnapshotsTest-65893310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:42:46 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-bb04120c-5caa-47b9-9596-92a2aff03b46 tempest-GroupSnapshotsTest-65893310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:42:46 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-bb04120c-5caa-47b9-9596-92a2aff03b46 tempest-GroupSnapshotsTest-65893310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:42:46 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-bb04120c-5caa-47b9-9596-92a2aff03b46 tempest-GroupSnapshotsTest-65893310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:42:46 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-bb04120c-5caa-47b9-9596-92a2aff03b46 tempest-GroupSnapshotsTest-65893310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:42:46 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-bb04120c-5caa-47b9-9596-92a2aff03b46 tempest-GroupSnapshotsTest-65893310 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:42:46 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-bb04120c-5caa-47b9-9596-92a2aff03b46 tempest-GroupSnapshotsTest-65893310 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:42:46 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-bb04120c-5caa-47b9-9596-92a2aff03b46 tempest-GroupSnapshotsTest-65893310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-cd028472-cbf3-4ec9-965b-ffe162e185b9 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:46 devstack sudo[92981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-cd028472-cbf3-4ec9-965b-ffe162e185b9 1073741824 Sep 04 22:42:46 devstack sudo[92981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:46 devstack sudo[92977]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:46 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-cec0d8dc-1699-4bd2-a114-eefc148c072a tempest-VolumesExtendTest-1086463602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c12321ac-ee92-44fa-8b68-b5aa5f3d5cdc 1G" returned: 0 in 0.605s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:46 devstack cinder-volume[87576]: DEBUG cinder.volume.volume_utils [None req-cec0d8dc-1699-4bd2-a114-eefc148c072a tempest-VolumesExtendTest-1086463602 None] Downloaded image 4f8d7a81-6282-4f52-a601-d840d8973365 ((None, [{'url': 'file:///opt/stack/data/glance/images/4f8d7a81-6282-4f52-a601-d840d8973365', 'metadata': {}}])) to volume c12321ac-ee92-44fa-8b68-b5aa5f3d5cdc successfully. {{(pid=87576) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 04 22:42:46 devstack cinder-volume[87576]: DEBUG cinder.image.image_utils [None req-cec0d8dc-1699-4bd2-a114-eefc148c072a tempest-VolumesExtendTest-1086463602 None] Temporary image 4f8d7a81-6282-4f52-a601-d840d8973365 for user 90335bc337ab42caad2f25abf1d08e96 is deleted. {{(pid=87576) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 04 22:42:46 devstack cinder-volume[87576]: DEBUG cinder.volume.volume_utils [None req-cec0d8dc-1699-4bd2-a114-eefc148c072a tempest-VolumesExtendTest-1086463602 None] Marking volume c12321ac-ee92-44fa-8b68-b5aa5f3d5cdc as bootable. {{(pid=87576) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 04 22:42:46 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-cec0d8dc-1699-4bd2-a114-eefc148c072a tempest-VolumesExtendTest-1086463602 None] Copying metadata from image 4f8d7a81-6282-4f52-a601-d840d8973365 to c12321ac-ee92-44fa-8b68-b5aa5f3d5cdc. {{(pid=87576) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 04 22:42:46 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-cec0d8dc-1699-4bd2-a114-eefc148c072a tempest-VolumesExtendTest-1086463602 None] Creating volume glance metadata for volume c12321ac-ee92-44fa-8b68-b5aa5f3d5cdc backed by image 4f8d7a81-6282-4f52-a601-d840d8973365 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4f8d7a81-6282-4f52-a601-d840d8973365', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87576) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 04 22:42:46 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-cec0d8dc-1699-4bd2-a114-eefc148c072a tempest-VolumesExtendTest-1086463602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26559c00-56d7-4d68-9946-4bc6a6564adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c12321ac-ee92-44fa-8b68-b5aa5f3d5cdc', 'volume_size': 1, 'image_id': '4f8d7a81-6282-4f52-a601-d840d8973365', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4f8d7a81-6282-4f52-a601-d840d8973365', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5d1fd1f571ef419184ac7eda6748fdd3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4f8d7a81-6282-4f52-a601-d840d8973365', 'created_at': datetime.datetime(2026, 9, 4, 20, 33, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 20, 33, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f8d7a81-6282-4f52-a601-d840d8973365/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:42:46 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-cec0d8dc-1699-4bd2-a114-eefc148c072a tempest-VolumesExtendTest-1086463602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f144a1b-669c-4002-a8a8-fc1e16bf5a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:42:46 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-cec0d8dc-1699-4bd2-a114-eefc148c072a tempest-VolumesExtendTest-1086463602 None] Volume volume-c12321ac-ee92-44fa-8b68-b5aa5f3d5cdc (c12321ac-ee92-44fa-8b68-b5aa5f3d5cdc): created successfully Sep 04 22:42:46 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-cec0d8dc-1699-4bd2-a114-eefc148c072a tempest-VolumesExtendTest-1086463602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f144a1b-669c-4002-a8a8-fc1e16bf5a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:42:46 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-cec0d8dc-1699-4bd2-a114-eefc148c072a tempest-VolumesExtendTest-1086463602 None] Flow 'volume_create_manager' (3c5fa09f-2348-4419-afce-c35ab5adf2a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:42:46 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-cec0d8dc-1699-4bd2-a114-eefc148c072a tempest-VolumesExtendTest-1086463602 None] Created volume successfully. Sep 04 22:42:46 devstack sudo[92981]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:46 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-bb04120c-5caa-47b9-9596-92a2aff03b46 tempest-GroupSnapshotsTest-65893310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-cd028472-cbf3-4ec9-965b-ffe162e185b9 1073741824" returned: 0 in 0.696s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:47 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-bb04120c-5caa-47b9-9596-92a2aff03b46 tempest-GroupSnapshotsTest-65893310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-cd028472-cbf3-4ec9-965b-ffe162e185b9 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:47 devstack sudo[92990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-cd028472-cbf3-4ec9-965b-ffe162e185b9 Sep 04 22:42:47 devstack sudo[92990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:47 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f9afb5d7-d723-44bf-9b7a-6019c3c9e40c tempest-VolumesExtendTest-1086463602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:42:47 devstack sudo[92990]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:47 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-bb04120c-5caa-47b9-9596-92a2aff03b46 tempest-GroupSnapshotsTest-65893310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-cd028472-cbf3-4ec9-965b-ffe162e185b9" returned: 0 in 0.483s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:47 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-bb04120c-5caa-47b9-9596-92a2aff03b46 tempest-GroupSnapshotsTest-65893310 None] <== create_volume: return (1249ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:42:47 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-bb04120c-5caa-47b9-9596-92a2aff03b46 tempest-GroupSnapshotsTest-65893310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.255s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:42:47 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f9afb5d7-d723-44bf-9b7a-6019c3c9e40c tempest-VolumesExtendTest-1086463602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.186s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:42:47 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-bb04120c-5caa-47b9-9596-92a2aff03b46 tempest-GroupSnapshotsTest-65893310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (497a551a-1e90-4716-b94d-4d35ee92e2ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd028472-cbf3-4ec9-965b-ffe162e185b9', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:42:47 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-bb04120c-5caa-47b9-9596-92a2aff03b46 tempest-GroupSnapshotsTest-65893310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce6dfac5-c1b9-420d-9661-d1c8f2a1a52c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:42:47 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbad9752-a53a-4cce-885f-97a11f741113]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:42:47 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f9afb5d7-d723-44bf-9b7a-6019c3c9e40c tempest-VolumesExtendTest-1086463602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c12321ac-ee92-44fa-8b68-b5aa5f3d5cdc {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:47 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-bb04120c-5caa-47b9-9596-92a2aff03b46 tempest-GroupSnapshotsTest-65893310 None] Volume volume-cd028472-cbf3-4ec9-965b-ffe162e185b9 (cd028472-cbf3-4ec9-965b-ffe162e185b9): created successfully Sep 04 22:42:47 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-bb04120c-5caa-47b9-9596-92a2aff03b46 tempest-GroupSnapshotsTest-65893310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce6dfac5-c1b9-420d-9661-d1c8f2a1a52c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:42:47 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-bb04120c-5caa-47b9-9596-92a2aff03b46 tempest-GroupSnapshotsTest-65893310 None] Flow 'volume_create_manager' (a0b9168b-1f3b-4b93-92bd-0aca3cf17bcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:42:47 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-bb04120c-5caa-47b9-9596-92a2aff03b46 tempest-GroupSnapshotsTest-65893310 None] Created volume successfully. Sep 04 22:42:47 devstack sudo[92993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c12321ac-ee92-44fa-8b68-b5aa5f3d5cdc Sep 04 22:42:47 devstack sudo[92993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:48 devstack sudo[92993]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:48 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f9afb5d7-d723-44bf-9b7a-6019c3c9e40c tempest-VolumesExtendTest-1086463602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c12321ac-ee92-44fa-8b68-b5aa5f3d5cdc" returned: 0 in 0.512s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:48 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f9afb5d7-d723-44bf-9b7a-6019c3c9e40c tempest-VolumesExtendTest-1086463602 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c12321ac-ee92-44fa-8b68-b5aa5f3d5cdc 2G {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:48 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f9afb5d7-d723-44bf-9b7a-6019c3c9e40c tempest-VolumesExtendTest-1086463602 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c12321ac-ee92-44fa-8b68-b5aa5f3d5cdc 2G" returned: 0 in 0.137s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:48 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f9afb5d7-d723-44bf-9b7a-6019c3c9e40c tempest-VolumesExtendTest-1086463602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.693s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:42:48 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-f9afb5d7-d723-44bf-9b7a-6019c3c9e40c tempest-VolumesExtendTest-1086463602 None] Extend volume completed successfully. Sep 04 22:42:48 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-06e92525-3539-4fd4-ab86-13b5b3510d64 tempest-VolumesExtendTest-1086463602 None] Acquiring lock "cinder-c12321ac-ee92-44fa-8b68-b5aa5f3d5cdc-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:42:48 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-06e92525-3539-4fd4-ab86-13b5b3510d64 tempest-VolumesExtendTest-1086463602 None] Lock "cinder-c12321ac-ee92-44fa-8b68-b5aa5f3d5cdc-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:42:49 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-06e92525-3539-4fd4-ab86-13b5b3510d64 tempest-VolumesExtendTest-1086463602 None] Acquiring lock "cinder-quobyte-c12321ac-ee92-44fa-8b68-b5aa5f3d5cdc" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:42:49 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-06e92525-3539-4fd4-ab86-13b5b3510d64 tempest-VolumesExtendTest-1086463602 None] Lock "cinder-quobyte-c12321ac-ee92-44fa-8b68-b5aa5f3d5cdc" acquired by "delete_volume" :: waited 0.036s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:42:49 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-7e15f9d6-2393-4538-a8f3-b4a9b3bc28e3 tempest-GroupSnapshotsTest-65893310 None] GroupSnapshot 7d1db080-fc98-4157-bbce-935314bc59d4: creating. Sep 04 22:42:49 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[991e8b8c-e011-4fa7-80fc-0b79d0c347f6]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:42:49 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-06e92525-3539-4fd4-ab86-13b5b3510d64 tempest-VolumesExtendTest-1086463602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c12321ac-ee92-44fa-8b68-b5aa5f3d5cdc {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:49 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-7e15f9d6-2393-4538-a8f3-b4a9b3bc28e3 tempest-GroupSnapshotsTest-65893310 None] Group snapshot 7d1db080-fc98-4157-bbce-935314bc59d4: creating. {{(pid=87576) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 04 22:42:49 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-7e15f9d6-2393-4538-a8f3-b4a9b3bc28e3 tempest-GroupSnapshotsTest-65893310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:42:49 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-7e15f9d6-2393-4538-a8f3-b4a9b3bc28e3 tempest-GroupSnapshotsTest-65893310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:42:49 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-7e15f9d6-2393-4538-a8f3-b4a9b3bc28e3 tempest-GroupSnapshotsTest-65893310 None] Creating offline snapshot 312a08e4-cad9-4eb2-9a0c-f74fb0905a5d of volume cd028472-cbf3-4ec9-965b-ffe162e185b9 {{(pid=87576) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 22:42:49 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[18bf767a-405f-4e33-a71a-72e4bbfea9c1]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:42:49 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-7e15f9d6-2393-4538-a8f3-b4a9b3bc28e3 tempest-GroupSnapshotsTest-65893310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-cd028472-cbf3-4ec9-965b-ffe162e185b9 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:49 devstack sudo[93003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c12321ac-ee92-44fa-8b68-b5aa5f3d5cdc Sep 04 22:42:49 devstack sudo[93003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:49 devstack sudo[93004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-cd028472-cbf3-4ec9-965b-ffe162e185b9 Sep 04 22:42:49 devstack sudo[93004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:49 devstack sudo[93003]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:49 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-06e92525-3539-4fd4-ab86-13b5b3510d64 tempest-VolumesExtendTest-1086463602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c12321ac-ee92-44fa-8b68-b5aa5f3d5cdc" returned: 0 in 0.610s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:49 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-06e92525-3539-4fd4-ab86-13b5b3510d64 tempest-VolumesExtendTest-1086463602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c12321ac-ee92-44fa-8b68-b5aa5f3d5cdc {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:49 devstack sudo[93012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c12321ac-ee92-44fa-8b68-b5aa5f3d5cdc Sep 04 22:42:49 devstack sudo[93012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:49 devstack sudo[93004]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:49 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-7e15f9d6-2393-4538-a8f3-b4a9b3bc28e3 tempest-GroupSnapshotsTest-65893310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-cd028472-cbf3-4ec9-965b-ffe162e185b9" returned: 0 in 0.553s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:49 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-7e15f9d6-2393-4538-a8f3-b4a9b3bc28e3 tempest-GroupSnapshotsTest-65893310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-cd028472-cbf3-4ec9-965b-ffe162e185b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-cd028472-cbf3-4ec9-965b-ffe162e185b9.312a08e4-cad9-4eb2-9a0c-f74fb0905a5d 1G {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:49 devstack sudo[93015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-cd028472-cbf3-4ec9-965b-ffe162e185b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-cd028472-cbf3-4ec9-965b-ffe162e185b9.312a08e4-cad9-4eb2-9a0c-f74fb0905a5d 1G Sep 04 22:42:49 devstack sudo[93015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:50 devstack sudo[93012]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:50 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-06e92525-3539-4fd4-ab86-13b5b3510d64 tempest-VolumesExtendTest-1086463602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c12321ac-ee92-44fa-8b68-b5aa5f3d5cdc" returned: 0 in 0.358s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:50 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-06e92525-3539-4fd4-ab86-13b5b3510d64 tempest-VolumesExtendTest-1086463602 None] Lock "cinder-quobyte-c12321ac-ee92-44fa-8b68-b5aa5f3d5cdc" released by "delete_volume" :: held 1.096s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:42:50 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-06e92525-3539-4fd4-ab86-13b5b3510d64 tempest-VolumesExtendTest-1086463602 None] Created reservations ['f93fe149-f76e-4333-a313-49b1a903dec0', '33c2246e-18c1-414b-8853-bc5deaea1aea', '8013cf9a-9370-49b9-b90c-46af929b8410', '20a15294-6aec-4299-94c4-64ee82047d4d'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:42:50 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-06e92525-3539-4fd4-ab86-13b5b3510d64 tempest-VolumesExtendTest-1086463602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:42:50 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-06e92525-3539-4fd4-ab86-13b5b3510d64 tempest-VolumesExtendTest-1086463602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:42:50 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-06e92525-3539-4fd4-ab86-13b5b3510d64 tempest-VolumesExtendTest-1086463602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:42:50 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-06e92525-3539-4fd4-ab86-13b5b3510d64 tempest-VolumesExtendTest-1086463602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:42:50 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-06e92525-3539-4fd4-ab86-13b5b3510d64 tempest-VolumesExtendTest-1086463602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:42:50 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-06e92525-3539-4fd4-ab86-13b5b3510d64 tempest-VolumesExtendTest-1086463602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:50 devstack sudo[93021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:42:50 devstack sudo[93021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:50 devstack sudo[93015]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:50 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-7e15f9d6-2393-4538-a8f3-b4a9b3bc28e3 tempest-GroupSnapshotsTest-65893310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-cd028472-cbf3-4ec9-965b-ffe162e185b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-cd028472-cbf3-4ec9-965b-ffe162e185b9.312a08e4-cad9-4eb2-9a0c-f74fb0905a5d 1G" returned: 0 in 0.899s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:50 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-7e15f9d6-2393-4538-a8f3-b4a9b3bc28e3 tempest-GroupSnapshotsTest-65893310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd028472-cbf3-4ec9-965b-ffe162e185b9 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-cd028472-cbf3-4ec9-965b-ffe162e185b9.312a08e4-cad9-4eb2-9a0c-f74fb0905a5d {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:50 devstack sudo[93023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd028472-cbf3-4ec9-965b-ffe162e185b9 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-cd028472-cbf3-4ec9-965b-ffe162e185b9.312a08e4-cad9-4eb2-9a0c-f74fb0905a5d Sep 04 22:42:50 devstack sudo[93023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:51 devstack sudo[93021]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:51 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-06e92525-3539-4fd4-ab86-13b5b3510d64 tempest-VolumesExtendTest-1086463602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.508s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:51 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-06e92525-3539-4fd4-ab86-13b5b3510d64 tempest-VolumesExtendTest-1086463602 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:42:51 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-06e92525-3539-4fd4-ab86-13b5b3510d64 tempest-VolumesExtendTest-1086463602 None] Deleted volume successfully. Sep 04 22:42:51 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-06e92525-3539-4fd4-ab86-13b5b3510d64 tempest-VolumesExtendTest-1086463602 None] Lock "cinder-c12321ac-ee92-44fa-8b68-b5aa5f3d5cdc-delete_volume" released by "delete_volume" :: held 2.093s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:42:51 devstack sudo[93023]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:51 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-7e15f9d6-2393-4538-a8f3-b4a9b3bc28e3 tempest-GroupSnapshotsTest-65893310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd028472-cbf3-4ec9-965b-ffe162e185b9 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-cd028472-cbf3-4ec9-965b-ffe162e185b9.312a08e4-cad9-4eb2-9a0c-f74fb0905a5d" returned: 0 in 0.491s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:51 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-7e15f9d6-2393-4538-a8f3-b4a9b3bc28e3 tempest-GroupSnapshotsTest-65893310 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-cd028472-cbf3-4ec9-965b-ffe162e185b9.312a08e4-cad9-4eb2-9a0c-f74fb0905a5d is being set with open permissions: ugo+rw: NotImplementedError Sep 04 22:42:51 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-7e15f9d6-2393-4538-a8f3-b4a9b3bc28e3 tempest-GroupSnapshotsTest-65893310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-cd028472-cbf3-4ec9-965b-ffe162e185b9.312a08e4-cad9-4eb2-9a0c-f74fb0905a5d {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:51 devstack sudo[93035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-cd028472-cbf3-4ec9-965b-ffe162e185b9.312a08e4-cad9-4eb2-9a0c-f74fb0905a5d Sep 04 22:42:51 devstack sudo[93035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:51 devstack sudo[93035]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:51 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-7e15f9d6-2393-4538-a8f3-b4a9b3bc28e3 tempest-GroupSnapshotsTest-65893310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-cd028472-cbf3-4ec9-965b-ffe162e185b9.312a08e4-cad9-4eb2-9a0c-f74fb0905a5d" returned: 0 in 0.459s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:51 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-7e15f9d6-2393-4538-a8f3-b4a9b3bc28e3 tempest-GroupSnapshotsTest-65893310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-cd028472-cbf3-4ec9-965b-ffe162e185b9.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:51 devstack sudo[93045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-cd028472-cbf3-4ec9-965b-ffe162e185b9.info Sep 04 22:42:51 devstack sudo[93045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:52 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4120a73-c552-494c-8cec-dfaec8556cfd tempest-VolumesExtendTest-1086463602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:42:52 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-f4120a73-c552-494c-8cec-dfaec8556cfd tempest-VolumesExtendTest-1086463602 None] Flow 'volume_create_manager' (c0d04d95-6b91-42a9-a6db-0688628c8181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:42:52 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-f4120a73-c552-494c-8cec-dfaec8556cfd tempest-VolumesExtendTest-1086463602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46895eed-623e-4ac9-af5f-e4bee2625620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:42:52 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-f4120a73-c552-494c-8cec-dfaec8556cfd tempest-VolumesExtendTest-1086463602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46895eed-623e-4ac9-af5f-e4bee2625620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:42:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1844229607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42d349be-71c6-41d5-b959-3f787701dad2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d55a483f144947dea89e2dc4734558d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:42:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:42:52Z,use_quota=True,user_id='90335bc337ab42caad2f25abf1d08e96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:42:52 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-f4120a73-c552-494c-8cec-dfaec8556cfd tempest-VolumesExtendTest-1086463602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aff33e12-9924-49c6-bcff-51c81f4514f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:42:52 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-f4120a73-c552-494c-8cec-dfaec8556cfd tempest-VolumesExtendTest-1086463602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aff33e12-9924-49c6-bcff-51c81f4514f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:42:52 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-f4120a73-c552-494c-8cec-dfaec8556cfd tempest-VolumesExtendTest-1086463602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7bf9b77-d6ab-47b7-8fae-129836fd2149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:42:52 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-f4120a73-c552-494c-8cec-dfaec8556cfd tempest-VolumesExtendTest-1086463602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7bf9b77-d6ab-47b7-8fae-129836fd2149) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42d349be-71c6-41d5-b959-3f787701dad2', 'volume_name': 'volume-42d349be-71c6-41d5-b959-3f787701dad2', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:42:52 devstack sudo[93045]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:52 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-f4120a73-c552-494c-8cec-dfaec8556cfd tempest-VolumesExtendTest-1086463602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a865c47-68a0-4095-9974-e59900db0894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:42:52 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-f4120a73-c552-494c-8cec-dfaec8556cfd tempest-VolumesExtendTest-1086463602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a865c47-68a0-4095-9974-e59900db0894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:42:52 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-f4120a73-c552-494c-8cec-dfaec8556cfd tempest-VolumesExtendTest-1086463602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (090c6cc3-e3a2-4352-9d93-30d2c7f86178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:42:52 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-f4120a73-c552-494c-8cec-dfaec8556cfd tempest-VolumesExtendTest-1086463602 None] Volume 42d349be-71c6-41d5-b959-3f787701dad2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42d349be-71c6-41d5-b959-3f787701dad2', 'volume_size': 1} Sep 04 22:42:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f4120a73-c552-494c-8cec-dfaec8556cfd tempest-VolumesExtendTest-1086463602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:42:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-7e15f9d6-2393-4538-a8f3-b4a9b3bc28e3 tempest-GroupSnapshotsTest-65893310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-cd028472-cbf3-4ec9-965b-ffe162e185b9.info" returned: 0 in 0.487s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:52 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-7e15f9d6-2393-4538-a8f3-b4a9b3bc28e3 tempest-GroupSnapshotsTest-65893310 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-cd028472-cbf3-4ec9-965b-ffe162e185b9.info is being set with open permissions: ugo+rw: NotImplementedError Sep 04 22:42:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-7e15f9d6-2393-4538-a8f3-b4a9b3bc28e3 tempest-GroupSnapshotsTest-65893310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-cd028472-cbf3-4ec9-965b-ffe162e185b9.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:52 devstack sudo[93052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-cd028472-cbf3-4ec9-965b-ffe162e185b9.info Sep 04 22:42:52 devstack sudo[93052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:52 devstack sudo[93052]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-7e15f9d6-2393-4538-a8f3-b4a9b3bc28e3 tempest-GroupSnapshotsTest-65893310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-cd028472-cbf3-4ec9-965b-ffe162e185b9.info" returned: 0 in 0.383s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-7e15f9d6-2393-4538-a8f3-b4a9b3bc28e3 tempest-GroupSnapshotsTest-65893310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.396s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:42:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f4120a73-c552-494c-8cec-dfaec8556cfd tempest-VolumesExtendTest-1086463602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.414s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:42:52 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-f4120a73-c552-494c-8cec-dfaec8556cfd tempest-VolumesExtendTest-1086463602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:42:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1844229607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42d349be-71c6-41d5-b959-3f787701dad2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d55a483f144947dea89e2dc4734558d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:42:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:42:52Z,use_quota=True,user_id='90335bc337ab42caad2f25abf1d08e96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:42:52 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-f4120a73-c552-494c-8cec-dfaec8556cfd tempest-VolumesExtendTest-1086463602 None] Creating volume 42d349be-71c6-41d5-b959-3f787701dad2 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:42:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f4120a73-c552-494c-8cec-dfaec8556cfd tempest-VolumesExtendTest-1086463602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:42:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f4120a73-c552-494c-8cec-dfaec8556cfd tempest-VolumesExtendTest-1086463602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:42:52 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-f4120a73-c552-494c-8cec-dfaec8556cfd tempest-VolumesExtendTest-1086463602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:42:52 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-f4120a73-c552-494c-8cec-dfaec8556cfd tempest-VolumesExtendTest-1086463602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:42:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f4120a73-c552-494c-8cec-dfaec8556cfd tempest-VolumesExtendTest-1086463602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:42:52 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-f4120a73-c552-494c-8cec-dfaec8556cfd tempest-VolumesExtendTest-1086463602 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:42:52 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-f4120a73-c552-494c-8cec-dfaec8556cfd tempest-VolumesExtendTest-1086463602 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:42:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f4120a73-c552-494c-8cec-dfaec8556cfd tempest-VolumesExtendTest-1086463602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42d349be-71c6-41d5-b959-3f787701dad2 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:52 devstack sudo[93055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42d349be-71c6-41d5-b959-3f787701dad2 1073741824 Sep 04 22:42:52 devstack sudo[93055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:52 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-7e15f9d6-2393-4538-a8f3-b4a9b3bc28e3 tempest-GroupSnapshotsTest-65893310 None] group_snapshot 7d1db080-fc98-4157-bbce-935314bc59d4: created successfully Sep 04 22:42:53 devstack sudo[93055]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:53 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f4120a73-c552-494c-8cec-dfaec8556cfd tempest-VolumesExtendTest-1086463602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42d349be-71c6-41d5-b959-3f787701dad2 1073741824" returned: 0 in 0.572s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:53 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f4120a73-c552-494c-8cec-dfaec8556cfd tempest-VolumesExtendTest-1086463602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42d349be-71c6-41d5-b959-3f787701dad2 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:53 devstack sudo[93063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42d349be-71c6-41d5-b959-3f787701dad2 Sep 04 22:42:53 devstack sudo[93063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:53 devstack sudo[93063]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:53 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f4120a73-c552-494c-8cec-dfaec8556cfd tempest-VolumesExtendTest-1086463602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42d349be-71c6-41d5-b959-3f787701dad2" returned: 0 in 0.349s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:53 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-f4120a73-c552-494c-8cec-dfaec8556cfd tempest-VolumesExtendTest-1086463602 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:42:53 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f4120a73-c552-494c-8cec-dfaec8556cfd tempest-VolumesExtendTest-1086463602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:42:53 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-f4120a73-c552-494c-8cec-dfaec8556cfd tempest-VolumesExtendTest-1086463602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (090c6cc3-e3a2-4352-9d93-30d2c7f86178) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42d349be-71c6-41d5-b959-3f787701dad2', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:42:53 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-f4120a73-c552-494c-8cec-dfaec8556cfd tempest-VolumesExtendTest-1086463602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57867b49-54f8-458a-9b08-190585b2c589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:42:53 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-f4120a73-c552-494c-8cec-dfaec8556cfd tempest-VolumesExtendTest-1086463602 None] Volume volume-42d349be-71c6-41d5-b959-3f787701dad2 (42d349be-71c6-41d5-b959-3f787701dad2): created successfully Sep 04 22:42:53 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-f4120a73-c552-494c-8cec-dfaec8556cfd tempest-VolumesExtendTest-1086463602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57867b49-54f8-458a-9b08-190585b2c589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:42:53 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-f4120a73-c552-494c-8cec-dfaec8556cfd tempest-VolumesExtendTest-1086463602 None] Flow 'volume_create_manager' (c0d04d95-6b91-42a9-a6db-0688628c8181) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:42:53 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-f4120a73-c552-494c-8cec-dfaec8556cfd tempest-VolumesExtendTest-1086463602 None] Created volume successfully. Sep 04 22:42:53 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-41bf1531-aa0f-494c-96d4-b0862509826d tempest-GroupSnapshotsTest-65893310 None] group_snapshot 7d1db080-fc98-4157-bbce-935314bc59d4: deleting Sep 04 22:42:53 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-41bf1531-aa0f-494c-96d4-b0862509826d tempest-GroupSnapshotsTest-65893310 None] group_snapshot 7d1db080-fc98-4157-bbce-935314bc59d4: deleting {{(pid=87576) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 04 22:42:53 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-41bf1531-aa0f-494c-96d4-b0862509826d tempest-GroupSnapshotsTest-65893310 None] Acquiring lock "cinder-quobyte-cd028472-cbf3-4ec9-965b-ffe162e185b9" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:42:53 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-41bf1531-aa0f-494c-96d4-b0862509826d tempest-GroupSnapshotsTest-65893310 None] Lock "cinder-quobyte-cd028472-cbf3-4ec9-965b-ffe162e185b9" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:42:53 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-41bf1531-aa0f-494c-96d4-b0862509826d tempest-GroupSnapshotsTest-65893310 None] Acquiring lock "cinder-quobyte-312a08e4-cad9-4eb2-9a0c-f74fb0905a5d" by "_delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:42:53 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-41bf1531-aa0f-494c-96d4-b0862509826d tempest-GroupSnapshotsTest-65893310 None] Lock "cinder-quobyte-312a08e4-cad9-4eb2-9a0c-f74fb0905a5d" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:42:53 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-41bf1531-aa0f-494c-96d4-b0862509826d tempest-GroupSnapshotsTest-65893310 None] Deleting offline snapshot 312a08e4-cad9-4eb2-9a0c-f74fb0905a5d of volume cd028472-cbf3-4ec9-965b-ffe162e185b9 {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 22:42:53 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-41bf1531-aa0f-494c-96d4-b0862509826d tempest-GroupSnapshotsTest-65893310 None] snapshot_file for this snap is: volume-cd028472-cbf3-4ec9-965b-ffe162e185b9.312a08e4-cad9-4eb2-9a0c-f74fb0905a5d {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 22:42:53 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[1042f72d-62f6-4055-b996-41439c03a32a]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:42:53 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-41bf1531-aa0f-494c-96d4-b0862509826d tempest-GroupSnapshotsTest-65893310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-cd028472-cbf3-4ec9-965b-ffe162e185b9.312a08e4-cad9-4eb2-9a0c-f74fb0905a5d {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:54 devstack sudo[93073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-cd028472-cbf3-4ec9-965b-ffe162e185b9.312a08e4-cad9-4eb2-9a0c-f74fb0905a5d Sep 04 22:42:54 devstack sudo[93073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:54 devstack sudo[93073]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-41bf1531-aa0f-494c-96d4-b0862509826d tempest-GroupSnapshotsTest-65893310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-cd028472-cbf3-4ec9-965b-ffe162e185b9.312a08e4-cad9-4eb2-9a0c-f74fb0905a5d" returned: 0 in 0.506s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:54 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-41bf1531-aa0f-494c-96d4-b0862509826d tempest-GroupSnapshotsTest-65893310 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd028472-cbf3-4ec9-965b-ffe162e185b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 22:42:54 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b633034-03ef-40f4-bcf8-aa0639a068b5]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:42:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-41bf1531-aa0f-494c-96d4-b0862509826d tempest-GroupSnapshotsTest-65893310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-cd028472-cbf3-4ec9-965b-ffe162e185b9 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-4ae71517-3013-4b79-ae75-f8e70ff6193e tempest-VolumesExtendTest-1086463602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:42:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-4ae71517-3013-4b79-ae75-f8e70ff6193e tempest-VolumesExtendTest-1086463602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:42:54 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-4ae71517-3013-4b79-ae75-f8e70ff6193e tempest-VolumesExtendTest-1086463602 None] Creating offline snapshot 0d54dda7-ebff-4ef7-8b9f-ebd0b7f37737 of volume 42d349be-71c6-41d5-b959-3f787701dad2 {{(pid=87576) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 22:42:54 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[73db0dc9-3acb-48ec-b13d-77043462ad34]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:42:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4ae71517-3013-4b79-ae75-f8e70ff6193e tempest-VolumesExtendTest-1086463602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42d349be-71c6-41d5-b959-3f787701dad2 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:54 devstack sudo[93110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-cd028472-cbf3-4ec9-965b-ffe162e185b9 Sep 04 22:42:54 devstack sudo[93110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:54 devstack sudo[93111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42d349be-71c6-41d5-b959-3f787701dad2 Sep 04 22:42:54 devstack sudo[93111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:55 devstack sudo[93110]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-41bf1531-aa0f-494c-96d4-b0862509826d tempest-GroupSnapshotsTest-65893310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-cd028472-cbf3-4ec9-965b-ffe162e185b9" returned: 0 in 0.559s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-41bf1531-aa0f-494c-96d4-b0862509826d tempest-GroupSnapshotsTest-65893310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-cd028472-cbf3-4ec9-965b-ffe162e185b9.312a08e4-cad9-4eb2-9a0c-f74fb0905a5d {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:55 devstack sudo[93121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-cd028472-cbf3-4ec9-965b-ffe162e185b9.312a08e4-cad9-4eb2-9a0c-f74fb0905a5d Sep 04 22:42:55 devstack sudo[93121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:55 devstack sudo[93111]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4ae71517-3013-4b79-ae75-f8e70ff6193e tempest-VolumesExtendTest-1086463602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42d349be-71c6-41d5-b959-3f787701dad2" returned: 0 in 0.553s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4ae71517-3013-4b79-ae75-f8e70ff6193e tempest-VolumesExtendTest-1086463602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42d349be-71c6-41d5-b959-3f787701dad2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42d349be-71c6-41d5-b959-3f787701dad2.0d54dda7-ebff-4ef7-8b9f-ebd0b7f37737 1G {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:55 devstack sudo[93127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42d349be-71c6-41d5-b959-3f787701dad2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42d349be-71c6-41d5-b959-3f787701dad2.0d54dda7-ebff-4ef7-8b9f-ebd0b7f37737 1G Sep 04 22:42:55 devstack sudo[93127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:55 devstack sudo[93121]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-41bf1531-aa0f-494c-96d4-b0862509826d tempest-GroupSnapshotsTest-65893310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-cd028472-cbf3-4ec9-965b-ffe162e185b9.312a08e4-cad9-4eb2-9a0c-f74fb0905a5d" returned: 0 in 0.432s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-41bf1531-aa0f-494c-96d4-b0862509826d tempest-GroupSnapshotsTest-65893310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-cd028472-cbf3-4ec9-965b-ffe162e185b9.312a08e4-cad9-4eb2-9a0c-f74fb0905a5d {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:55 devstack sudo[93141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-cd028472-cbf3-4ec9-965b-ffe162e185b9.312a08e4-cad9-4eb2-9a0c-f74fb0905a5d Sep 04 22:42:55 devstack sudo[93141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:55 devstack sudo[93127]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4ae71517-3013-4b79-ae75-f8e70ff6193e tempest-VolumesExtendTest-1086463602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42d349be-71c6-41d5-b959-3f787701dad2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42d349be-71c6-41d5-b959-3f787701dad2.0d54dda7-ebff-4ef7-8b9f-ebd0b7f37737 1G" returned: 0 in 0.682s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4ae71517-3013-4b79-ae75-f8e70ff6193e tempest-VolumesExtendTest-1086463602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42d349be-71c6-41d5-b959-3f787701dad2 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42d349be-71c6-41d5-b959-3f787701dad2.0d54dda7-ebff-4ef7-8b9f-ebd0b7f37737 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:55 devstack sudo[93155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42d349be-71c6-41d5-b959-3f787701dad2 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42d349be-71c6-41d5-b959-3f787701dad2.0d54dda7-ebff-4ef7-8b9f-ebd0b7f37737 Sep 04 22:42:55 devstack sudo[93155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:55 devstack sudo[93141]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-41bf1531-aa0f-494c-96d4-b0862509826d tempest-GroupSnapshotsTest-65893310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-cd028472-cbf3-4ec9-965b-ffe162e185b9.312a08e4-cad9-4eb2-9a0c-f74fb0905a5d" returned: 0 in 0.477s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:56 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-41bf1531-aa0f-494c-96d4-b0862509826d tempest-GroupSnapshotsTest-65893310 None] Lock "cinder-quobyte-312a08e4-cad9-4eb2-9a0c-f74fb0905a5d" released by "_delete_snapshot" :: held 2.152s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:42:56 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-41bf1531-aa0f-494c-96d4-b0862509826d tempest-GroupSnapshotsTest-65893310 None] Lock "cinder-quobyte-cd028472-cbf3-4ec9-965b-ffe162e185b9" released by "delete_snapshot" :: held 2.183s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:42:56 devstack cinder-volume[87576]: DEBUG dbcounter [-] [87576] Writing DB stats cinder:UPDATE=146,cinder:SELECT=144,cinder:INSERT=38,cinder:DELETE=6 {{(pid=87576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 22:42:56 devstack cinder-volume[87576]: DEBUG dbcounter [-] [87576] Writing DB stats cinder:SELECT=145,cinder:INSERT=39,cinder:UPDATE=146,cinder:DELETE=8 {{(pid=87576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 22:42:56 devstack cinder-volume[87576]: WARNING cinder.quota [None req-41bf1531-aa0f-494c-96d4-b0862509826d tempest-GroupSnapshotsTest-65893310 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1741504597 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1741504597, it is now deprecated. Please use the default quota class for default quota. Sep 04 22:42:56 devstack cinder-volume[87576]: WARNING cinder.quota [None req-41bf1531-aa0f-494c-96d4-b0862509826d tempest-GroupSnapshotsTest-65893310 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1741504597 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1741504597, it is now deprecated. Please use the default quota class for default quota. Sep 04 22:42:56 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-41bf1531-aa0f-494c-96d4-b0862509826d tempest-GroupSnapshotsTest-65893310 None] Created reservations ['b7ed6e02-9ca5-4ed8-a702-4f1512f2611b', 'bcf3d331-fcab-492c-84eb-b3e810be3f8e', '695a39a1-4879-4bd4-be30-aaff9dc2cffa', '5675da68-1bbd-4294-adce-64c55f0ed743'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:42:56 devstack sudo[93155]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4ae71517-3013-4b79-ae75-f8e70ff6193e tempest-VolumesExtendTest-1086463602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42d349be-71c6-41d5-b959-3f787701dad2 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42d349be-71c6-41d5-b959-3f787701dad2.0d54dda7-ebff-4ef7-8b9f-ebd0b7f37737" returned: 0 in 0.370s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:56 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-4ae71517-3013-4b79-ae75-f8e70ff6193e tempest-VolumesExtendTest-1086463602 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42d349be-71c6-41d5-b959-3f787701dad2.0d54dda7-ebff-4ef7-8b9f-ebd0b7f37737 is being set with open permissions: ugo+rw Sep 04 22:42:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4ae71517-3013-4b79-ae75-f8e70ff6193e tempest-VolumesExtendTest-1086463602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42d349be-71c6-41d5-b959-3f787701dad2.0d54dda7-ebff-4ef7-8b9f-ebd0b7f37737 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:56 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-41bf1531-aa0f-494c-96d4-b0862509826d tempest-GroupSnapshotsTest-65893310 None] group_snapshot 7d1db080-fc98-4157-bbce-935314bc59d4: deleted successfully Sep 04 22:42:56 devstack sudo[93161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42d349be-71c6-41d5-b959-3f787701dad2.0d54dda7-ebff-4ef7-8b9f-ebd0b7f37737 Sep 04 22:42:56 devstack sudo[93161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:56 devstack sudo[93161]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4ae71517-3013-4b79-ae75-f8e70ff6193e tempest-VolumesExtendTest-1086463602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42d349be-71c6-41d5-b959-3f787701dad2.0d54dda7-ebff-4ef7-8b9f-ebd0b7f37737" returned: 0 in 0.267s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4ae71517-3013-4b79-ae75-f8e70ff6193e tempest-VolumesExtendTest-1086463602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42d349be-71c6-41d5-b959-3f787701dad2.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:56 devstack sudo[93164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42d349be-71c6-41d5-b959-3f787701dad2.info Sep 04 22:42:56 devstack sudo[93164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:56 devstack sudo[93164]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4ae71517-3013-4b79-ae75-f8e70ff6193e tempest-VolumesExtendTest-1086463602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42d349be-71c6-41d5-b959-3f787701dad2.info" returned: 0 in 0.263s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:56 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-4ae71517-3013-4b79-ae75-f8e70ff6193e tempest-VolumesExtendTest-1086463602 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42d349be-71c6-41d5-b959-3f787701dad2.info is being set with open permissions: ugo+rw Sep 04 22:42:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4ae71517-3013-4b79-ae75-f8e70ff6193e tempest-VolumesExtendTest-1086463602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42d349be-71c6-41d5-b959-3f787701dad2.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:56 devstack sudo[93167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42d349be-71c6-41d5-b959-3f787701dad2.info Sep 04 22:42:56 devstack sudo[93167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:57 devstack sudo[93167]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4ae71517-3013-4b79-ae75-f8e70ff6193e tempest-VolumesExtendTest-1086463602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42d349be-71c6-41d5-b959-3f787701dad2.info" returned: 0 in 0.280s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-4ae71517-3013-4b79-ae75-f8e70ff6193e tempest-VolumesExtendTest-1086463602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.535s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:42:57 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-4ae71517-3013-4b79-ae75-f8e70ff6193e tempest-VolumesExtendTest-1086463602 None] Create snapshot completed successfully Sep 04 22:42:57 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-2beb3060-5ced-4672-a6a4-289dda6a446b tempest-GroupSnapshotsTest-65893310 None] Acquiring lock "cinder-quobyte-cd028472-cbf3-4ec9-965b-ffe162e185b9" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:42:57 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-2beb3060-5ced-4672-a6a4-289dda6a446b tempest-GroupSnapshotsTest-65893310 None] Lock "cinder-quobyte-cd028472-cbf3-4ec9-965b-ffe162e185b9" acquired by "delete_volume" :: waited 0.063s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:42:57 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b11417-5678-43b1-a2c3-c6d8497b9f3d]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:42:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2beb3060-5ced-4672-a6a4-289dda6a446b tempest-GroupSnapshotsTest-65893310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-cd028472-cbf3-4ec9-965b-ffe162e185b9 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-fe48a251-27c6-4bea-8503-925b10278cca tempest-VolumesExtendTest-1086463602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:42:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-fe48a251-27c6-4bea-8503-925b10278cca tempest-VolumesExtendTest-1086463602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:42:58 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ff9dec-1627-42e8-85cc-2461ab4b8de1]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:42:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-fe48a251-27c6-4bea-8503-925b10278cca tempest-VolumesExtendTest-1086463602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42d349be-71c6-41d5-b959-3f787701dad2 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:58 devstack sudo[93187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-cd028472-cbf3-4ec9-965b-ffe162e185b9 Sep 04 22:42:58 devstack sudo[93187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:58 devstack sudo[93217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42d349be-71c6-41d5-b959-3f787701dad2 Sep 04 22:42:58 devstack sudo[93217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:58 devstack sudo[93217]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-fe48a251-27c6-4bea-8503-925b10278cca tempest-VolumesExtendTest-1086463602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42d349be-71c6-41d5-b959-3f787701dad2" returned: 0 in 0.654s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:58 devstack sudo[93187]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-fe48a251-27c6-4bea-8503-925b10278cca tempest-VolumesExtendTest-1086463602 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42d349be-71c6-41d5-b959-3f787701dad2.0d54dda7-ebff-4ef7-8b9f-ebd0b7f37737 2G {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2beb3060-5ced-4672-a6a4-289dda6a446b tempest-GroupSnapshotsTest-65893310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-cd028472-cbf3-4ec9-965b-ffe162e185b9" returned: 0 in 1.016s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2beb3060-5ced-4672-a6a4-289dda6a446b tempest-GroupSnapshotsTest-65893310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-cd028472-cbf3-4ec9-965b-ffe162e185b9 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:58 devstack sudo[93272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-cd028472-cbf3-4ec9-965b-ffe162e185b9 Sep 04 22:42:58 devstack sudo[93272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-fe48a251-27c6-4bea-8503-925b10278cca tempest-VolumesExtendTest-1086463602 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42d349be-71c6-41d5-b959-3f787701dad2.0d54dda7-ebff-4ef7-8b9f-ebd0b7f37737 2G" returned: 0 in 0.293s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-fe48a251-27c6-4bea-8503-925b10278cca tempest-VolumesExtendTest-1086463602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.007s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:42:59 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-fe48a251-27c6-4bea-8503-925b10278cca tempest-VolumesExtendTest-1086463602 None] Extend volume completed successfully. Sep 04 22:42:59 devstack sudo[93272]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2beb3060-5ced-4672-a6a4-289dda6a446b tempest-GroupSnapshotsTest-65893310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-cd028472-cbf3-4ec9-965b-ffe162e185b9" returned: 0 in 0.373s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:59 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-2beb3060-5ced-4672-a6a4-289dda6a446b tempest-GroupSnapshotsTest-65893310 None] Lock "cinder-quobyte-cd028472-cbf3-4ec9-965b-ffe162e185b9" released by "delete_volume" :: held 1.588s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:42:59 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-2beb3060-5ced-4672-a6a4-289dda6a446b tempest-GroupSnapshotsTest-65893310 None] Created reservations ['1e7e621e-1c76-4eed-8e49-04e7c9b4c4c8'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:42:59 devstack cinder-volume[87576]: WARNING cinder.quota [None req-2beb3060-5ced-4672-a6a4-289dda6a446b tempest-GroupSnapshotsTest-65893310 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1741504597 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1741504597, it is now deprecated. Please use the default quota class for default quota. Sep 04 22:42:59 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-2beb3060-5ced-4672-a6a4-289dda6a446b tempest-GroupSnapshotsTest-65893310 None] Created reservations ['6431a6a2-e6f2-4cc0-8a59-95ccc2e6bae7', 'f4563bc0-cdeb-4aa3-99f7-cba2ac3023eb', '2455f6cb-5e6d-415b-b21c-cad5c5a861d1', '3e8f462d-1342-4f78-a5b3-34d4eb0fa544'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:42:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-2beb3060-5ced-4672-a6a4-289dda6a446b tempest-GroupSnapshotsTest-65893310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:42:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-2beb3060-5ced-4672-a6a4-289dda6a446b tempest-GroupSnapshotsTest-65893310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:42:59 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-2beb3060-5ced-4672-a6a4-289dda6a446b tempest-GroupSnapshotsTest-65893310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:42:59 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-2beb3060-5ced-4672-a6a4-289dda6a446b tempest-GroupSnapshotsTest-65893310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:42:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-2beb3060-5ced-4672-a6a4-289dda6a446b tempest-GroupSnapshotsTest-65893310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:42:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2beb3060-5ced-4672-a6a4-289dda6a446b tempest-GroupSnapshotsTest-65893310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:42:59 devstack sudo[93281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:42:59 devstack sudo[93281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:42:59 devstack sudo[93281]: pam_unix(sudo:session): session closed for user root Sep 04 22:42:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2beb3060-5ced-4672-a6a4-289dda6a446b tempest-GroupSnapshotsTest-65893310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.340s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:42:59 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-2beb3060-5ced-4672-a6a4-289dda6a446b tempest-GroupSnapshotsTest-65893310 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:42:59 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-2beb3060-5ced-4672-a6a4-289dda6a446b tempest-GroupSnapshotsTest-65893310 None] Delete group completed successfully. Sep 04 22:43:00 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-95d036c6-44cd-4050-b998-40932e3a3c96 tempest-VolumesExtendTest-1086463602 None] Acquiring lock "cinder-0d54dda7-ebff-4ef7-8b9f-ebd0b7f37737-delete_snapshot" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:43:00 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-95d036c6-44cd-4050-b998-40932e3a3c96 tempest-VolumesExtendTest-1086463602 None] Lock "cinder-0d54dda7-ebff-4ef7-8b9f-ebd0b7f37737-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:43:00 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-95d036c6-44cd-4050-b998-40932e3a3c96 tempest-VolumesExtendTest-1086463602 None] Acquiring lock "cinder-quobyte-42d349be-71c6-41d5-b959-3f787701dad2" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:43:00 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-95d036c6-44cd-4050-b998-40932e3a3c96 tempest-VolumesExtendTest-1086463602 None] Lock "cinder-quobyte-42d349be-71c6-41d5-b959-3f787701dad2" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:43:00 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-95d036c6-44cd-4050-b998-40932e3a3c96 tempest-VolumesExtendTest-1086463602 None] Acquiring lock "cinder-quobyte-0d54dda7-ebff-4ef7-8b9f-ebd0b7f37737" by "_delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:43:00 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-95d036c6-44cd-4050-b998-40932e3a3c96 tempest-VolumesExtendTest-1086463602 None] Lock "cinder-quobyte-0d54dda7-ebff-4ef7-8b9f-ebd0b7f37737" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:43:00 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-95d036c6-44cd-4050-b998-40932e3a3c96 tempest-VolumesExtendTest-1086463602 None] Deleting offline snapshot 0d54dda7-ebff-4ef7-8b9f-ebd0b7f37737 of volume 42d349be-71c6-41d5-b959-3f787701dad2 {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 22:43:00 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-95d036c6-44cd-4050-b998-40932e3a3c96 tempest-VolumesExtendTest-1086463602 None] snapshot_file for this snap is: volume-42d349be-71c6-41d5-b959-3f787701dad2.0d54dda7-ebff-4ef7-8b9f-ebd0b7f37737 {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 22:43:00 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9f552f-2f01-495d-a1e6-10c13d0f20fe]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:43:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-95d036c6-44cd-4050-b998-40932e3a3c96 tempest-VolumesExtendTest-1086463602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42d349be-71c6-41d5-b959-3f787701dad2.0d54dda7-ebff-4ef7-8b9f-ebd0b7f37737 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:43:00 devstack sudo[93284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42d349be-71c6-41d5-b959-3f787701dad2.0d54dda7-ebff-4ef7-8b9f-ebd0b7f37737 Sep 04 22:43:00 devstack sudo[93284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:43:01 devstack sudo[93284]: pam_unix(sudo:session): session closed for user root Sep 04 22:43:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-95d036c6-44cd-4050-b998-40932e3a3c96 tempest-VolumesExtendTest-1086463602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42d349be-71c6-41d5-b959-3f787701dad2.0d54dda7-ebff-4ef7-8b9f-ebd0b7f37737" returned: 0 in 0.588s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:43:01 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-95d036c6-44cd-4050-b998-40932e3a3c96 tempest-VolumesExtendTest-1086463602 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42d349be-71c6-41d5-b959-3f787701dad2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 22:43:01 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[a135190a-6d20-4b17-8ae9-28ef496ee8ad]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:43:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-95d036c6-44cd-4050-b998-40932e3a3c96 tempest-VolumesExtendTest-1086463602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42d349be-71c6-41d5-b959-3f787701dad2 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:43:01 devstack sudo[93290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42d349be-71c6-41d5-b959-3f787701dad2 Sep 04 22:43:01 devstack sudo[93290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:43:01 devstack sudo[93290]: pam_unix(sudo:session): session closed for user root Sep 04 22:43:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-95d036c6-44cd-4050-b998-40932e3a3c96 tempest-VolumesExtendTest-1086463602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42d349be-71c6-41d5-b959-3f787701dad2" returned: 0 in 0.780s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:43:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-95d036c6-44cd-4050-b998-40932e3a3c96 tempest-VolumesExtendTest-1086463602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42d349be-71c6-41d5-b959-3f787701dad2.0d54dda7-ebff-4ef7-8b9f-ebd0b7f37737 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:43:02 devstack sudo[93295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42d349be-71c6-41d5-b959-3f787701dad2.0d54dda7-ebff-4ef7-8b9f-ebd0b7f37737 Sep 04 22:43:02 devstack sudo[93295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:43:02 devstack sudo[93295]: pam_unix(sudo:session): session closed for user root Sep 04 22:43:02 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-95d036c6-44cd-4050-b998-40932e3a3c96 tempest-VolumesExtendTest-1086463602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42d349be-71c6-41d5-b959-3f787701dad2.0d54dda7-ebff-4ef7-8b9f-ebd0b7f37737" returned: 0 in 0.709s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:43:02 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-95d036c6-44cd-4050-b998-40932e3a3c96 tempest-VolumesExtendTest-1086463602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42d349be-71c6-41d5-b959-3f787701dad2.0d54dda7-ebff-4ef7-8b9f-ebd0b7f37737 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:43:02 devstack sudo[93305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42d349be-71c6-41d5-b959-3f787701dad2.0d54dda7-ebff-4ef7-8b9f-ebd0b7f37737 Sep 04 22:43:02 devstack sudo[93305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:43:03 devstack sudo[93305]: pam_unix(sudo:session): session closed for user root Sep 04 22:43:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-95d036c6-44cd-4050-b998-40932e3a3c96 tempest-VolumesExtendTest-1086463602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42d349be-71c6-41d5-b959-3f787701dad2.0d54dda7-ebff-4ef7-8b9f-ebd0b7f37737" returned: 0 in 0.417s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:43:03 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-95d036c6-44cd-4050-b998-40932e3a3c96 tempest-VolumesExtendTest-1086463602 None] Lock "cinder-quobyte-0d54dda7-ebff-4ef7-8b9f-ebd0b7f37737" released by "_delete_snapshot" :: held 2.690s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:43:03 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-95d036c6-44cd-4050-b998-40932e3a3c96 tempest-VolumesExtendTest-1086463602 None] Lock "cinder-quobyte-42d349be-71c6-41d5-b959-3f787701dad2" released by "delete_snapshot" :: held 2.718s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:43:03 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-95d036c6-44cd-4050-b998-40932e3a3c96 tempest-VolumesExtendTest-1086463602 None] Created reservations ['111b08c7-9244-4db9-a2bd-83da487e4266', '46b30d59-9bc7-4a54-8beb-2a2ee2b2e508', 'fb3dae5e-4089-4a26-9551-ff83db54ecbe', '66d1dede-53b0-4fe7-bd82-5ff0dcac81f5'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:43:03 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-95d036c6-44cd-4050-b998-40932e3a3c96 tempest-VolumesExtendTest-1086463602 None] Delete snapshot completed successfully. Sep 04 22:43:03 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-95d036c6-44cd-4050-b998-40932e3a3c96 tempest-VolumesExtendTest-1086463602 None] Lock "cinder-0d54dda7-ebff-4ef7-8b9f-ebd0b7f37737-delete_snapshot" released by "delete_snapshot" :: held 3.000s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:43:03 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-583f7361-a043-4a2e-84e1-b71cd31319eb tempest-VolumesExtendTest-1086463602 None] Acquiring lock "cinder-42d349be-71c6-41d5-b959-3f787701dad2-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:43:03 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-583f7361-a043-4a2e-84e1-b71cd31319eb tempest-VolumesExtendTest-1086463602 None] Lock "cinder-42d349be-71c6-41d5-b959-3f787701dad2-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:43:04 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-583f7361-a043-4a2e-84e1-b71cd31319eb tempest-VolumesExtendTest-1086463602 None] Acquiring lock "cinder-quobyte-42d349be-71c6-41d5-b959-3f787701dad2" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:43:04 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-583f7361-a043-4a2e-84e1-b71cd31319eb tempest-VolumesExtendTest-1086463602 None] Lock "cinder-quobyte-42d349be-71c6-41d5-b959-3f787701dad2" acquired by "delete_volume" :: waited 0.041s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:43:04 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[db47e662-e987-457b-94ba-fabfa5825538]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:43:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-583f7361-a043-4a2e-84e1-b71cd31319eb tempest-VolumesExtendTest-1086463602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42d349be-71c6-41d5-b959-3f787701dad2 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:43:04 devstack sudo[93310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42d349be-71c6-41d5-b959-3f787701dad2 Sep 04 22:43:04 devstack sudo[93310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:43:04 devstack sudo[93310]: pam_unix(sudo:session): session closed for user root Sep 04 22:43:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-583f7361-a043-4a2e-84e1-b71cd31319eb tempest-VolumesExtendTest-1086463602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42d349be-71c6-41d5-b959-3f787701dad2" returned: 0 in 0.551s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:43:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-583f7361-a043-4a2e-84e1-b71cd31319eb tempest-VolumesExtendTest-1086463602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42d349be-71c6-41d5-b959-3f787701dad2 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:43:04 devstack sudo[93315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42d349be-71c6-41d5-b959-3f787701dad2 Sep 04 22:43:04 devstack sudo[93315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:43:05 devstack sudo[93315]: pam_unix(sudo:session): session closed for user root Sep 04 22:43:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-583f7361-a043-4a2e-84e1-b71cd31319eb tempest-VolumesExtendTest-1086463602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42d349be-71c6-41d5-b959-3f787701dad2" returned: 0 in 0.425s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:43:05 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-583f7361-a043-4a2e-84e1-b71cd31319eb tempest-VolumesExtendTest-1086463602 None] Lock "cinder-quobyte-42d349be-71c6-41d5-b959-3f787701dad2" released by "delete_volume" :: held 1.173s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:43:05 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-583f7361-a043-4a2e-84e1-b71cd31319eb tempest-VolumesExtendTest-1086463602 None] Created reservations ['38adef2c-395d-465f-a19a-eda1a0e5e4c1', 'c7841edf-1313-45fd-af58-54687088d970', 'c8d0cc70-ed2b-4895-b386-7f8d0711813e', 'fa41cca6-d1c3-4a3f-806b-c7317efa8bbd'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:43:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-583f7361-a043-4a2e-84e1-b71cd31319eb tempest-VolumesExtendTest-1086463602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:43:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-583f7361-a043-4a2e-84e1-b71cd31319eb tempest-VolumesExtendTest-1086463602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:43:05 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-583f7361-a043-4a2e-84e1-b71cd31319eb tempest-VolumesExtendTest-1086463602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:43:05 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-583f7361-a043-4a2e-84e1-b71cd31319eb tempest-VolumesExtendTest-1086463602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:43:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-583f7361-a043-4a2e-84e1-b71cd31319eb tempest-VolumesExtendTest-1086463602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:43:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-583f7361-a043-4a2e-84e1-b71cd31319eb tempest-VolumesExtendTest-1086463602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:43:05 devstack sudo[93323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:43:05 devstack sudo[93323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:43:06 devstack sudo[93323]: pam_unix(sudo:session): session closed for user root Sep 04 22:43:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-583f7361-a043-4a2e-84e1-b71cd31319eb tempest-VolumesExtendTest-1086463602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.584s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:43:06 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-583f7361-a043-4a2e-84e1-b71cd31319eb tempest-VolumesExtendTest-1086463602 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:43:06 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-583f7361-a043-4a2e-84e1-b71cd31319eb tempest-VolumesExtendTest-1086463602 None] Deleted volume successfully. Sep 04 22:43:06 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-583f7361-a043-4a2e-84e1-b71cd31319eb tempest-VolumesExtendTest-1086463602 None] Lock "cinder-42d349be-71c6-41d5-b959-3f787701dad2-delete_volume" released by "delete_volume" :: held 2.391s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:43:07 devstack cinder-volume[87576]: INFO cinder.volume.manager [req-670e2c0e-8a2f-4ce3-afa3-8ca07c9ab3b1 req-51e3ff66-73f4-4691-9051-ca81a095641b tempest-ServerActionsTestOtherA-1336516134 None] Terminate volume connection completed successfully. Sep 04 22:43:07 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-670e2c0e-8a2f-4ce3-afa3-8ca07c9ab3b1 req-51e3ff66-73f4-4691-9051-ca81a095641b tempest-ServerActionsTestOtherA-1336516134 None] Deleting attachment 2442aee8-5376-42e5-8852-5c5c614795d0. {{(pid=87576) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 22:43:11 devstack cinder-volume[87576]: DEBUG oslo_service.periodic_task [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87576) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 22:43:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:43:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:43:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:43:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:43:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:43:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:43:11 devstack sudo[93411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:43:11 devstack sudo[93411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:43:12 devstack sudo[93411]: pam_unix(sudo:session): session closed for user root Sep 04 22:43:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.448s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:43:12 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:43:12 devstack cinder-volume[87576]: DEBUG oslo_service.periodic_task [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Running periodic task VolumeManager._thread_info {{(pid=87576) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 22:43:12 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] thread count: 28 {{(pid=87576) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 22:43:12 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] thread info: [<_MainThread(MainThread, started 125730416963712)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87576) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 22:43:14 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-de4ec88d-65db-432e-bf80-90524c811c32 tempest-VolumesListTestJSON-2026633540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:43:14 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-de4ec88d-65db-432e-bf80-90524c811c32 tempest-VolumesListTestJSON-2026633540 None] Flow 'volume_create_manager' (cc36e79c-ffd6-45f9-8f98-46fdce8df774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:43:14 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-de4ec88d-65db-432e-bf80-90524c811c32 tempest-VolumesListTestJSON-2026633540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ef678aa-cc76-444c-bf56-179d6ba06ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:43:14 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-de4ec88d-65db-432e-bf80-90524c811c32 tempest-VolumesListTestJSON-2026633540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ef678aa-cc76-444c-bf56-179d6ba06ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:43:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-220384817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24e77bb2-7651-467c-80ec-17cf3cefa296,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fa43d89bc8f1416c94ae572afec4bdfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:43:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:43:15Z,use_quota=True,user_id='6870ccd13bcd44aab0a6c1dfd4e42606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:43:14 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-de4ec88d-65db-432e-bf80-90524c811c32 tempest-VolumesListTestJSON-2026633540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b90f40df-2c7b-4e5c-88e5-16be58b27d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:43:14 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-de4ec88d-65db-432e-bf80-90524c811c32 tempest-VolumesListTestJSON-2026633540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b90f40df-2c7b-4e5c-88e5-16be58b27d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:43:14 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-de4ec88d-65db-432e-bf80-90524c811c32 tempest-VolumesListTestJSON-2026633540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f96f86f-1bd8-4e5b-9fe6-00f53327f80f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:43:14 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-de4ec88d-65db-432e-bf80-90524c811c32 tempest-VolumesListTestJSON-2026633540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f96f86f-1bd8-4e5b-9fe6-00f53327f80f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24e77bb2-7651-467c-80ec-17cf3cefa296', 'volume_name': 'volume-24e77bb2-7651-467c-80ec-17cf3cefa296', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:43:14 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-de4ec88d-65db-432e-bf80-90524c811c32 tempest-VolumesListTestJSON-2026633540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00b32850-9738-42d2-b888-f2b5a28e60d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:43:14 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-de4ec88d-65db-432e-bf80-90524c811c32 tempest-VolumesListTestJSON-2026633540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00b32850-9738-42d2-b888-f2b5a28e60d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:43:14 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-de4ec88d-65db-432e-bf80-90524c811c32 tempest-VolumesListTestJSON-2026633540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55176a38-4e1e-4013-a847-8fd711f1f816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:43:14 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-de4ec88d-65db-432e-bf80-90524c811c32 tempest-VolumesListTestJSON-2026633540 None] Volume 24e77bb2-7651-467c-80ec-17cf3cefa296: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24e77bb2-7651-467c-80ec-17cf3cefa296', 'volume_size': 1} Sep 04 22:43:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-de4ec88d-65db-432e-bf80-90524c811c32 tempest-VolumesListTestJSON-2026633540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:43:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-de4ec88d-65db-432e-bf80-90524c811c32 tempest-VolumesListTestJSON-2026633540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:43:14 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-de4ec88d-65db-432e-bf80-90524c811c32 tempest-VolumesListTestJSON-2026633540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:43:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-220384817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24e77bb2-7651-467c-80ec-17cf3cefa296,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fa43d89bc8f1416c94ae572afec4bdfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:43:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:43:15Z,use_quota=True,user_id='6870ccd13bcd44aab0a6c1dfd4e42606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:43:14 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-de4ec88d-65db-432e-bf80-90524c811c32 tempest-VolumesListTestJSON-2026633540 None] Creating volume 24e77bb2-7651-467c-80ec-17cf3cefa296 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:43:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-de4ec88d-65db-432e-bf80-90524c811c32 tempest-VolumesListTestJSON-2026633540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:43:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-de4ec88d-65db-432e-bf80-90524c811c32 tempest-VolumesListTestJSON-2026633540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:43:14 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-de4ec88d-65db-432e-bf80-90524c811c32 tempest-VolumesListTestJSON-2026633540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:43:14 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-de4ec88d-65db-432e-bf80-90524c811c32 tempest-VolumesListTestJSON-2026633540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:43:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-de4ec88d-65db-432e-bf80-90524c811c32 tempest-VolumesListTestJSON-2026633540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:43:14 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-de4ec88d-65db-432e-bf80-90524c811c32 tempest-VolumesListTestJSON-2026633540 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:43:14 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-de4ec88d-65db-432e-bf80-90524c811c32 tempest-VolumesListTestJSON-2026633540 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:43:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-de4ec88d-65db-432e-bf80-90524c811c32 tempest-VolumesListTestJSON-2026633540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-24e77bb2-7651-467c-80ec-17cf3cefa296 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:43:14 devstack sudo[93442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-24e77bb2-7651-467c-80ec-17cf3cefa296 1073741824 Sep 04 22:43:14 devstack sudo[93442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:43:15 devstack sudo[93442]: pam_unix(sudo:session): session closed for user root Sep 04 22:43:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-de4ec88d-65db-432e-bf80-90524c811c32 tempest-VolumesListTestJSON-2026633540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-24e77bb2-7651-467c-80ec-17cf3cefa296 1073741824" returned: 0 in 0.565s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:43:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-de4ec88d-65db-432e-bf80-90524c811c32 tempest-VolumesListTestJSON-2026633540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-24e77bb2-7651-467c-80ec-17cf3cefa296 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:43:15 devstack sudo[93448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-24e77bb2-7651-467c-80ec-17cf3cefa296 Sep 04 22:43:15 devstack sudo[93448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:43:15 devstack sudo[93448]: pam_unix(sudo:session): session closed for user root Sep 04 22:43:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-de4ec88d-65db-432e-bf80-90524c811c32 tempest-VolumesListTestJSON-2026633540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-24e77bb2-7651-467c-80ec-17cf3cefa296" returned: 0 in 0.461s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:43:15 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-de4ec88d-65db-432e-bf80-90524c811c32 tempest-VolumesListTestJSON-2026633540 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:43:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-de4ec88d-65db-432e-bf80-90524c811c32 tempest-VolumesListTestJSON-2026633540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:43:15 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-de4ec88d-65db-432e-bf80-90524c811c32 tempest-VolumesListTestJSON-2026633540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55176a38-4e1e-4013-a847-8fd711f1f816) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24e77bb2-7651-467c-80ec-17cf3cefa296', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:43:15 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-de4ec88d-65db-432e-bf80-90524c811c32 tempest-VolumesListTestJSON-2026633540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4aa432b2-241d-4f45-a11a-9e4ddda80040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:43:15 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-de4ec88d-65db-432e-bf80-90524c811c32 tempest-VolumesListTestJSON-2026633540 None] Volume volume-24e77bb2-7651-467c-80ec-17cf3cefa296 (24e77bb2-7651-467c-80ec-17cf3cefa296): created successfully Sep 04 22:43:15 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-de4ec88d-65db-432e-bf80-90524c811c32 tempest-VolumesListTestJSON-2026633540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4aa432b2-241d-4f45-a11a-9e4ddda80040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:43:15 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-de4ec88d-65db-432e-bf80-90524c811c32 tempest-VolumesListTestJSON-2026633540 None] Flow 'volume_create_manager' (cc36e79c-ffd6-45f9-8f98-46fdce8df774) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:43:15 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-de4ec88d-65db-432e-bf80-90524c811c32 tempest-VolumesListTestJSON-2026633540 None] Created volume successfully. Sep 04 22:43:17 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c55511f-3461-406a-ad50-4e4f56584892 tempest-VolumesListTestJSON-2026633540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:43:17 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0c55511f-3461-406a-ad50-4e4f56584892 tempest-VolumesListTestJSON-2026633540 None] Flow 'volume_create_manager' (846633a5-8263-47e1-bbf7-7ecde78f1c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:43:17 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0c55511f-3461-406a-ad50-4e4f56584892 tempest-VolumesListTestJSON-2026633540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bbd8766-671b-4d52-9b48-f267b3212cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:43:17 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0c55511f-3461-406a-ad50-4e4f56584892 tempest-VolumesListTestJSON-2026633540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bbd8766-671b-4d52-9b48-f267b3212cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:43:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1018299812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5682053c-40e5-4b0a-b742-27c460b969e9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fa43d89bc8f1416c94ae572afec4bdfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:43:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:43:17Z,use_quota=True,user_id='6870ccd13bcd44aab0a6c1dfd4e42606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:43:17 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0c55511f-3461-406a-ad50-4e4f56584892 tempest-VolumesListTestJSON-2026633540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b45091e2-117a-4e02-be31-420b5cb2453b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:43:17 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0c55511f-3461-406a-ad50-4e4f56584892 tempest-VolumesListTestJSON-2026633540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b45091e2-117a-4e02-be31-420b5cb2453b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:43:17 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0c55511f-3461-406a-ad50-4e4f56584892 tempest-VolumesListTestJSON-2026633540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff29b091-4c0f-498e-8774-c0101fce5828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:43:17 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0c55511f-3461-406a-ad50-4e4f56584892 tempest-VolumesListTestJSON-2026633540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff29b091-4c0f-498e-8774-c0101fce5828) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5682053c-40e5-4b0a-b742-27c460b969e9', 'volume_name': 'volume-5682053c-40e5-4b0a-b742-27c460b969e9', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:43:17 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0c55511f-3461-406a-ad50-4e4f56584892 tempest-VolumesListTestJSON-2026633540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d719aff-0630-49b5-9f09-150e2833c3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:43:17 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0c55511f-3461-406a-ad50-4e4f56584892 tempest-VolumesListTestJSON-2026633540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d719aff-0630-49b5-9f09-150e2833c3e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:43:17 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0c55511f-3461-406a-ad50-4e4f56584892 tempest-VolumesListTestJSON-2026633540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0aae80c-9e9a-4769-b4f6-8bfd50ff1658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:43:17 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-0c55511f-3461-406a-ad50-4e4f56584892 tempest-VolumesListTestJSON-2026633540 None] Volume 5682053c-40e5-4b0a-b742-27c460b969e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5682053c-40e5-4b0a-b742-27c460b969e9', 'volume_size': 1} Sep 04 22:43:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-0c55511f-3461-406a-ad50-4e4f56584892 tempest-VolumesListTestJSON-2026633540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:43:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-0c55511f-3461-406a-ad50-4e4f56584892 tempest-VolumesListTestJSON-2026633540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:43:17 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-0c55511f-3461-406a-ad50-4e4f56584892 tempest-VolumesListTestJSON-2026633540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:43:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1018299812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5682053c-40e5-4b0a-b742-27c460b969e9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fa43d89bc8f1416c94ae572afec4bdfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:43:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:43:17Z,use_quota=True,user_id='6870ccd13bcd44aab0a6c1dfd4e42606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:43:17 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-0c55511f-3461-406a-ad50-4e4f56584892 tempest-VolumesListTestJSON-2026633540 None] Creating volume 5682053c-40e5-4b0a-b742-27c460b969e9 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:43:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-0c55511f-3461-406a-ad50-4e4f56584892 tempest-VolumesListTestJSON-2026633540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:43:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-0c55511f-3461-406a-ad50-4e4f56584892 tempest-VolumesListTestJSON-2026633540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:43:17 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-0c55511f-3461-406a-ad50-4e4f56584892 tempest-VolumesListTestJSON-2026633540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:43:17 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-0c55511f-3461-406a-ad50-4e4f56584892 tempest-VolumesListTestJSON-2026633540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:43:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-0c55511f-3461-406a-ad50-4e4f56584892 tempest-VolumesListTestJSON-2026633540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:43:17 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-0c55511f-3461-406a-ad50-4e4f56584892 tempest-VolumesListTestJSON-2026633540 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:43:17 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-0c55511f-3461-406a-ad50-4e4f56584892 tempest-VolumesListTestJSON-2026633540 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:43:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0c55511f-3461-406a-ad50-4e4f56584892 tempest-VolumesListTestJSON-2026633540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5682053c-40e5-4b0a-b742-27c460b969e9 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:43:17 devstack sudo[93476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5682053c-40e5-4b0a-b742-27c460b969e9 1073741824 Sep 04 22:43:17 devstack sudo[93476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:43:18 devstack sudo[93476]: pam_unix(sudo:session): session closed for user root Sep 04 22:43:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0c55511f-3461-406a-ad50-4e4f56584892 tempest-VolumesListTestJSON-2026633540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5682053c-40e5-4b0a-b742-27c460b969e9 1073741824" returned: 0 in 0.575s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:43:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0c55511f-3461-406a-ad50-4e4f56584892 tempest-VolumesListTestJSON-2026633540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5682053c-40e5-4b0a-b742-27c460b969e9 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:43:18 devstack sudo[93483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5682053c-40e5-4b0a-b742-27c460b969e9 Sep 04 22:43:18 devstack sudo[93483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:43:18 devstack sudo[93483]: pam_unix(sudo:session): session closed for user root Sep 04 22:43:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0c55511f-3461-406a-ad50-4e4f56584892 tempest-VolumesListTestJSON-2026633540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5682053c-40e5-4b0a-b742-27c460b969e9" returned: 0 in 0.337s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:43:18 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-0c55511f-3461-406a-ad50-4e4f56584892 tempest-VolumesListTestJSON-2026633540 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:43:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-0c55511f-3461-406a-ad50-4e4f56584892 tempest-VolumesListTestJSON-2026633540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:43:18 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0c55511f-3461-406a-ad50-4e4f56584892 tempest-VolumesListTestJSON-2026633540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0aae80c-9e9a-4769-b4f6-8bfd50ff1658) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5682053c-40e5-4b0a-b742-27c460b969e9', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:43:18 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0c55511f-3461-406a-ad50-4e4f56584892 tempest-VolumesListTestJSON-2026633540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a7854fd-2f5f-466b-a1ce-30e3e5e0e347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:43:18 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-0c55511f-3461-406a-ad50-4e4f56584892 tempest-VolumesListTestJSON-2026633540 None] Volume volume-5682053c-40e5-4b0a-b742-27c460b969e9 (5682053c-40e5-4b0a-b742-27c460b969e9): created successfully Sep 04 22:43:18 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0c55511f-3461-406a-ad50-4e4f56584892 tempest-VolumesListTestJSON-2026633540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a7854fd-2f5f-466b-a1ce-30e3e5e0e347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:43:18 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0c55511f-3461-406a-ad50-4e4f56584892 tempest-VolumesListTestJSON-2026633540 None] Flow 'volume_create_manager' (846633a5-8263-47e1-bbf7-7ecde78f1c6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:43:18 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-0c55511f-3461-406a-ad50-4e4f56584892 tempest-VolumesListTestJSON-2026633540 None] Created volume successfully. Sep 04 22:43:19 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-a329b74b-34fe-47ec-881c-df49c5cc3bf0 tempest-ServerActionsTestOtherA-1336516134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:43:19 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-a329b74b-34fe-47ec-881c-df49c5cc3bf0 tempest-ServerActionsTestOtherA-1336516134 None] Flow 'volume_create_manager' (dd28e3b8-d7d9-44ba-a38c-4eedc1ddde05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:43:19 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-a329b74b-34fe-47ec-881c-df49c5cc3bf0 tempest-ServerActionsTestOtherA-1336516134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfa4ca02-f86e-4a45-99d0-0283daac07e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:43:19 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-a329b74b-34fe-47ec-881c-df49c5cc3bf0 tempest-ServerActionsTestOtherA-1336516134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfa4ca02-f86e-4a45-99d0-0283daac07e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:43:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-905205137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5473867f-cf74-4841-af09-dc103852f634,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fdc6bad46ef4979817afa54137f7e3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:43:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:43:20Z,use_quota=True,user_id='84e4821e04cd47f3b97da2e72e0586f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:43:19 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-a329b74b-34fe-47ec-881c-df49c5cc3bf0 tempest-ServerActionsTestOtherA-1336516134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fdc7500-7038-4b36-adc6-d89fdcb58dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:43:19 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-a329b74b-34fe-47ec-881c-df49c5cc3bf0 tempest-ServerActionsTestOtherA-1336516134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fdc7500-7038-4b36-adc6-d89fdcb58dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:43:19 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-a329b74b-34fe-47ec-881c-df49c5cc3bf0 tempest-ServerActionsTestOtherA-1336516134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73341188-554f-4aa4-a386-1ecc5c6d0cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:43:19 devstack cinder-volume[87576]: DEBUG cinder.image.glance [None req-a329b74b-34fe-47ec-881c-df49c5cc3bf0 tempest-ServerActionsTestOtherA-1336516134 None] Creating Keystone auth plugin from conf {{(pid=87576) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 04 22:43:20 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-1aac55b4-5a46-453e-85ca-74212ed9e601 tempest-GroupsV320Test-589604751 None] Group tempest-GroupsV320Test-Group-1285138043: creating Sep 04 22:43:20 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-1aac55b4-5a46-453e-85ca-74212ed9e601 tempest-GroupsV320Test-589604751 None] Group tempest-GroupsV320Test-Group-1285138043: created successfully Sep 04 22:43:20 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-1aac55b4-5a46-453e-85ca-74212ed9e601 tempest-GroupsV320Test-589604751 None] Create group completed successfully. Sep 04 22:43:20 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-a329b74b-34fe-47ec-881c-df49c5cc3bf0 tempest-ServerActionsTestOtherA-1336516134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73341188-554f-4aa4-a386-1ecc5c6d0cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5473867f-cf74-4841-af09-dc103852f634', 'volume_name': 'volume-5473867f-cf74-4841-af09-dc103852f634', 'volume_size': 1, 'image_id': '4f8d7a81-6282-4f52-a601-d840d8973365', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4f8d7a81-6282-4f52-a601-d840d8973365', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5d1fd1f571ef419184ac7eda6748fdd3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4f8d7a81-6282-4f52-a601-d840d8973365', 'created_at': datetime.datetime(2026, 9, 4, 20, 33, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 20, 33, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f8d7a81-6282-4f52-a601-d840d8973365/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:43:20 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-a329b74b-34fe-47ec-881c-df49c5cc3bf0 tempest-ServerActionsTestOtherA-1336516134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bea7f099-40ed-4ba5-b87a-ee29089f59dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:43:20 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-a329b74b-34fe-47ec-881c-df49c5cc3bf0 tempest-ServerActionsTestOtherA-1336516134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bea7f099-40ed-4ba5-b87a-ee29089f59dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:43:20 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-a329b74b-34fe-47ec-881c-df49c5cc3bf0 tempest-ServerActionsTestOtherA-1336516134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8361e4a4-1ea5-4f3c-b423-5515aac6a4ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:43:20 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-a329b74b-34fe-47ec-881c-df49c5cc3bf0 tempest-ServerActionsTestOtherA-1336516134 None] Volume 5473867f-cf74-4841-af09-dc103852f634: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5473867f-cf74-4841-af09-dc103852f634', 'volume_size': 1, 'image_id': '4f8d7a81-6282-4f52-a601-d840d8973365', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4f8d7a81-6282-4f52-a601-d840d8973365', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5d1fd1f571ef419184ac7eda6748fdd3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4f8d7a81-6282-4f52-a601-d840d8973365', 'created_at': datetime.datetime(2026, 9, 4, 20, 33, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 20, 33, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f8d7a81-6282-4f52-a601-d840d8973365/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 04 22:43:20 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-a329b74b-34fe-47ec-881c-df49c5cc3bf0 tempest-ServerActionsTestOtherA-1336516134 None] Trying to clone 5473867f-cf74-4841-af09-dc103852f634 from image 4f8d7a81-6282-4f52-a601-d840d8973365 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4f8d7a81-6282-4f52-a601-d840d8973365', 'metadata': {}}]). {{(pid=87576) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 04 22:43:20 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-365e38e0-b0e5-4980-9de2-7dbd52792943 tempest-VolumesListTestJSON-2026633540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:43:20 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-365e38e0-b0e5-4980-9de2-7dbd52792943 tempest-VolumesListTestJSON-2026633540 None] Flow 'volume_create_manager' (352a1ff5-d5b3-4581-a731-b91bb94a0c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:43:20 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-365e38e0-b0e5-4980-9de2-7dbd52792943 tempest-VolumesListTestJSON-2026633540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e855d464-a504-47eb-80dc-1153c42d407d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:43:20 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-365e38e0-b0e5-4980-9de2-7dbd52792943 tempest-VolumesListTestJSON-2026633540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e855d464-a504-47eb-80dc-1153c42d407d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:43:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-76799604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c10b798-7624-4baf-8d33-dcb868fb07e6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fa43d89bc8f1416c94ae572afec4bdfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:43:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:43:21Z,use_quota=True,user_id='6870ccd13bcd44aab0a6c1dfd4e42606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:43:20 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-365e38e0-b0e5-4980-9de2-7dbd52792943 tempest-VolumesListTestJSON-2026633540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3cb2d83-eb93-4ae0-99c1-c85801e19713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:43:20 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-365e38e0-b0e5-4980-9de2-7dbd52792943 tempest-VolumesListTestJSON-2026633540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3cb2d83-eb93-4ae0-99c1-c85801e19713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:43:20 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-365e38e0-b0e5-4980-9de2-7dbd52792943 tempest-VolumesListTestJSON-2026633540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e03eecf-8dfd-4345-8972-2bfbe28a3aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:43:20 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-365e38e0-b0e5-4980-9de2-7dbd52792943 tempest-VolumesListTestJSON-2026633540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e03eecf-8dfd-4345-8972-2bfbe28a3aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c10b798-7624-4baf-8d33-dcb868fb07e6', 'volume_name': 'volume-6c10b798-7624-4baf-8d33-dcb868fb07e6', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:43:20 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-365e38e0-b0e5-4980-9de2-7dbd52792943 tempest-VolumesListTestJSON-2026633540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0616abdc-90b6-476c-8777-16df932fa304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:43:20 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-365e38e0-b0e5-4980-9de2-7dbd52792943 tempest-VolumesListTestJSON-2026633540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0616abdc-90b6-476c-8777-16df932fa304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:43:20 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-365e38e0-b0e5-4980-9de2-7dbd52792943 tempest-VolumesListTestJSON-2026633540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03b2f2d6-cb74-426b-80c8-aad2a07d6876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:43:20 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-365e38e0-b0e5-4980-9de2-7dbd52792943 tempest-VolumesListTestJSON-2026633540 None] Volume 6c10b798-7624-4baf-8d33-dcb868fb07e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c10b798-7624-4baf-8d33-dcb868fb07e6', 'volume_size': 1} Sep 04 22:43:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-365e38e0-b0e5-4980-9de2-7dbd52792943 tempest-VolumesListTestJSON-2026633540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:43:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-365e38e0-b0e5-4980-9de2-7dbd52792943 tempest-VolumesListTestJSON-2026633540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:43:20 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-365e38e0-b0e5-4980-9de2-7dbd52792943 tempest-VolumesListTestJSON-2026633540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:43:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-76799604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c10b798-7624-4baf-8d33-dcb868fb07e6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fa43d89bc8f1416c94ae572afec4bdfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:43:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:43:21Z,use_quota=True,user_id='6870ccd13bcd44aab0a6c1dfd4e42606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:43:20 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-365e38e0-b0e5-4980-9de2-7dbd52792943 tempest-VolumesListTestJSON-2026633540 None] Creating volume 6c10b798-7624-4baf-8d33-dcb868fb07e6 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:43:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-365e38e0-b0e5-4980-9de2-7dbd52792943 tempest-VolumesListTestJSON-2026633540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:43:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-365e38e0-b0e5-4980-9de2-7dbd52792943 tempest-VolumesListTestJSON-2026633540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:43:20 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-365e38e0-b0e5-4980-9de2-7dbd52792943 tempest-VolumesListTestJSON-2026633540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:43:20 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-365e38e0-b0e5-4980-9de2-7dbd52792943 tempest-VolumesListTestJSON-2026633540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:43:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-365e38e0-b0e5-4980-9de2-7dbd52792943 tempest-VolumesListTestJSON-2026633540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:43:20 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-365e38e0-b0e5-4980-9de2-7dbd52792943 tempest-VolumesListTestJSON-2026633540 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:43:20 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-365e38e0-b0e5-4980-9de2-7dbd52792943 tempest-VolumesListTestJSON-2026633540 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:43:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-365e38e0-b0e5-4980-9de2-7dbd52792943 tempest-VolumesListTestJSON-2026633540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6c10b798-7624-4baf-8d33-dcb868fb07e6 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:43:20 devstack sudo[93488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6c10b798-7624-4baf-8d33-dcb868fb07e6 1073741824 Sep 04 22:43:20 devstack sudo[93488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:43:21 devstack cinder-volume[87576]: DEBUG cinder.image.image_utils [None req-a329b74b-34fe-47ec-881c-df49c5cc3bf0 tempest-ServerActionsTestOtherA-1336516134 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4f8d7a81-6282-4f52-a601-d840d8973365_eyfc1i1gdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87576) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 04 22:43:21 devstack cinder-volume[87576]: INFO cinder.image.image_utils [None req-a329b74b-34fe-47ec-881c-df49c5cc3bf0 tempest-ServerActionsTestOtherA-1336516134 None] Image download 20.69 MB at 20.69 MB/s Sep 04 22:43:21 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[53acabea-c574-43a4-bcee-67b9ea408d45]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:43:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a329b74b-34fe-47ec-881c-df49c5cc3bf0 tempest-ServerActionsTestOtherA-1336516134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f8d7a81-6282-4f52-a601-d840d8973365_eyfc1i1gdevstack@QuobyteHD {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:43:21 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-4caa2069-24eb-453d-aaa6-3cd8f6a964e2 tempest-ServersNegativeTestJSON-994158042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:43:21 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-4caa2069-24eb-453d-aaa6-3cd8f6a964e2 tempest-ServersNegativeTestJSON-994158042 None] Flow 'volume_create_manager' (aa05e42d-6b97-4a86-9d6f-c8eb40bcebfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:43:21 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-4caa2069-24eb-453d-aaa6-3cd8f6a964e2 tempest-ServersNegativeTestJSON-994158042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00628496-c902-4ccf-b66e-937b83d545d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:43:21 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-4caa2069-24eb-453d-aaa6-3cd8f6a964e2 tempest-ServersNegativeTestJSON-994158042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00628496-c902-4ccf-b66e-937b83d545d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:43:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1633728525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4f3c175-445d-4b1b-aa8f-75707ec098aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='924fb0c1db904953b6a33b3d6c319da5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:43:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:43:21Z,use_quota=True,user_id='dd8a40f248d94bf29bef681806027021',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:43:21 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-4caa2069-24eb-453d-aaa6-3cd8f6a964e2 tempest-ServersNegativeTestJSON-994158042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81d4748e-cb68-483c-8f82-bf3d440f2a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:43:21 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-4caa2069-24eb-453d-aaa6-3cd8f6a964e2 tempest-ServersNegativeTestJSON-994158042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81d4748e-cb68-483c-8f82-bf3d440f2a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:43:21 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-4caa2069-24eb-453d-aaa6-3cd8f6a964e2 tempest-ServersNegativeTestJSON-994158042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d956902-a805-413d-bfb0-4b8b49f82a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:43:21 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-4caa2069-24eb-453d-aaa6-3cd8f6a964e2 tempest-ServersNegativeTestJSON-994158042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d956902-a805-413d-bfb0-4b8b49f82a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4f3c175-445d-4b1b-aa8f-75707ec098aa', 'volume_name': 'volume-a4f3c175-445d-4b1b-aa8f-75707ec098aa', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:43:21 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-4caa2069-24eb-453d-aaa6-3cd8f6a964e2 tempest-ServersNegativeTestJSON-994158042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb995b80-c072-42f1-9cbf-c91dcbcf0aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:43:21 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-4caa2069-24eb-453d-aaa6-3cd8f6a964e2 tempest-ServersNegativeTestJSON-994158042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb995b80-c072-42f1-9cbf-c91dcbcf0aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:43:21 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-4caa2069-24eb-453d-aaa6-3cd8f6a964e2 tempest-ServersNegativeTestJSON-994158042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (015fd3fa-61d6-44ba-9152-988b20b13fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:43:21 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-4caa2069-24eb-453d-aaa6-3cd8f6a964e2 tempest-ServersNegativeTestJSON-994158042 None] Volume a4f3c175-445d-4b1b-aa8f-75707ec098aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4f3c175-445d-4b1b-aa8f-75707ec098aa', 'volume_size': 1} Sep 04 22:43:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-4caa2069-24eb-453d-aaa6-3cd8f6a964e2 tempest-ServersNegativeTestJSON-994158042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:43:21 devstack sudo[93494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f8d7a81-6282-4f52-a601-d840d8973365_eyfc1i1gdevstack@QuobyteHD Sep 04 22:43:21 devstack sudo[93494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:43:21 devstack sudo[93488]: pam_unix(sudo:session): session closed for user root Sep 04 22:43:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-365e38e0-b0e5-4980-9de2-7dbd52792943 tempest-VolumesListTestJSON-2026633540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6c10b798-7624-4baf-8d33-dcb868fb07e6 1073741824" returned: 0 in 0.745s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:43:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-365e38e0-b0e5-4980-9de2-7dbd52792943 tempest-VolumesListTestJSON-2026633540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6c10b798-7624-4baf-8d33-dcb868fb07e6 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:43:21 devstack sudo[93497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6c10b798-7624-4baf-8d33-dcb868fb07e6 Sep 04 22:43:21 devstack sudo[93497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:43:21 devstack sudo[93494]: pam_unix(sudo:session): session closed for user root Sep 04 22:43:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a329b74b-34fe-47ec-881c-df49c5cc3bf0 tempest-ServerActionsTestOtherA-1336516134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f8d7a81-6282-4f52-a601-d840d8973365_eyfc1i1gdevstack@QuobyteHD" returned: 0 in 0.390s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:43:21 devstack cinder-volume[87576]: DEBUG cinder.image.image_utils [None req-a329b74b-34fe-47ec-881c-df49c5cc3bf0 tempest-ServerActionsTestOtherA-1336516134 None] Temporary image 4f8d7a81-6282-4f52-a601-d840d8973365 is fetched for user 84e4821e04cd47f3b97da2e72e0586f3. {{(pid=87576) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 04 22:43:21 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a4ddbd-ac31-401d-93ea-cd91fded50ee]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:43:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a329b74b-34fe-47ec-881c-df49c5cc3bf0 tempest-ServerActionsTestOtherA-1336516134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f8d7a81-6282-4f52-a601-d840d8973365_eyfc1i1gdevstack@QuobyteHD {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:43:21 devstack sudo[93497]: pam_unix(sudo:session): session closed for user root Sep 04 22:43:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-365e38e0-b0e5-4980-9de2-7dbd52792943 tempest-VolumesListTestJSON-2026633540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6c10b798-7624-4baf-8d33-dcb868fb07e6" returned: 0 in 0.286s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:43:21 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-365e38e0-b0e5-4980-9de2-7dbd52792943 tempest-VolumesListTestJSON-2026633540 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:43:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-365e38e0-b0e5-4980-9de2-7dbd52792943 tempest-VolumesListTestJSON-2026633540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:43:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-4caa2069-24eb-453d-aaa6-3cd8f6a964e2 tempest-ServersNegativeTestJSON-994158042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.490s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:43:21 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-4caa2069-24eb-453d-aaa6-3cd8f6a964e2 tempest-ServersNegativeTestJSON-994158042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:43:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1633728525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4f3c175-445d-4b1b-aa8f-75707ec098aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='924fb0c1db904953b6a33b3d6c319da5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:43:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:43:21Z,use_quota=True,user_id='dd8a40f248d94bf29bef681806027021',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:43:21 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-4caa2069-24eb-453d-aaa6-3cd8f6a964e2 tempest-ServersNegativeTestJSON-994158042 None] Creating volume a4f3c175-445d-4b1b-aa8f-75707ec098aa {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:43:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-4caa2069-24eb-453d-aaa6-3cd8f6a964e2 tempest-ServersNegativeTestJSON-994158042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:43:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-4caa2069-24eb-453d-aaa6-3cd8f6a964e2 tempest-ServersNegativeTestJSON-994158042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:43:21 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-4caa2069-24eb-453d-aaa6-3cd8f6a964e2 tempest-ServersNegativeTestJSON-994158042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:43:21 devstack sudo[93502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f8d7a81-6282-4f52-a601-d840d8973365_eyfc1i1gdevstack@QuobyteHD Sep 04 22:43:21 devstack sudo[93502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:43:21 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-4caa2069-24eb-453d-aaa6-3cd8f6a964e2 tempest-ServersNegativeTestJSON-994158042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:43:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-4caa2069-24eb-453d-aaa6-3cd8f6a964e2 tempest-ServersNegativeTestJSON-994158042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:43:21 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-4caa2069-24eb-453d-aaa6-3cd8f6a964e2 tempest-ServersNegativeTestJSON-994158042 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:43:21 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-4caa2069-24eb-453d-aaa6-3cd8f6a964e2 tempest-ServersNegativeTestJSON-994158042 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:43:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4caa2069-24eb-453d-aaa6-3cd8f6a964e2 tempest-ServersNegativeTestJSON-994158042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-a4f3c175-445d-4b1b-aa8f-75707ec098aa 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:43:21 devstack sudo[93505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-a4f3c175-445d-4b1b-aa8f-75707ec098aa 1073741824 Sep 04 22:43:21 devstack sudo[93505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:43:21 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-365e38e0-b0e5-4980-9de2-7dbd52792943 tempest-VolumesListTestJSON-2026633540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03b2f2d6-cb74-426b-80c8-aad2a07d6876) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c10b798-7624-4baf-8d33-dcb868fb07e6', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:43:21 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-365e38e0-b0e5-4980-9de2-7dbd52792943 tempest-VolumesListTestJSON-2026633540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d139c3f6-638c-468e-bec7-6e28dcd562a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:43:21 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-365e38e0-b0e5-4980-9de2-7dbd52792943 tempest-VolumesListTestJSON-2026633540 None] Volume volume-6c10b798-7624-4baf-8d33-dcb868fb07e6 (6c10b798-7624-4baf-8d33-dcb868fb07e6): created successfully Sep 04 22:43:21 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-365e38e0-b0e5-4980-9de2-7dbd52792943 tempest-VolumesListTestJSON-2026633540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d139c3f6-638c-468e-bec7-6e28dcd562a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:43:21 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-365e38e0-b0e5-4980-9de2-7dbd52792943 tempest-VolumesListTestJSON-2026633540 None] Flow 'volume_create_manager' (352a1ff5-d5b3-4581-a731-b91bb94a0c92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:43:21 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-365e38e0-b0e5-4980-9de2-7dbd52792943 tempest-VolumesListTestJSON-2026633540 None] Created volume successfully. Sep 04 22:43:21 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-72118bcc-aaca-4080-9ca6-6ac0e8415ea0 tempest-GroupsV320Test-589604751 None] Created reservations ['280d0112-df7b-44ca-bf91-e8ecf6f8a3af'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:43:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-72118bcc-aaca-4080-9ca6-6ac0e8415ea0 tempest-GroupsV320Test-589604751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:43:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-72118bcc-aaca-4080-9ca6-6ac0e8415ea0 tempest-GroupsV320Test-589604751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:43:21 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-72118bcc-aaca-4080-9ca6-6ac0e8415ea0 tempest-GroupsV320Test-589604751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:43:21 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-72118bcc-aaca-4080-9ca6-6ac0e8415ea0 tempest-GroupsV320Test-589604751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:43:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-72118bcc-aaca-4080-9ca6-6ac0e8415ea0 tempest-GroupsV320Test-589604751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:43:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-72118bcc-aaca-4080-9ca6-6ac0e8415ea0 tempest-GroupsV320Test-589604751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:43:22 devstack sudo[93510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:43:22 devstack sudo[93510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:43:22 devstack sudo[93502]: pam_unix(sudo:session): session closed for user root Sep 04 22:43:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a329b74b-34fe-47ec-881c-df49c5cc3bf0 tempest-ServerActionsTestOtherA-1336516134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f8d7a81-6282-4f52-a601-d840d8973365_eyfc1i1gdevstack@QuobyteHD" returned: 0 in 0.359s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:43:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-a329b74b-34fe-47ec-881c-df49c5cc3bf0 tempest-ServerActionsTestOtherA-1336516134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:43:22 devstack sudo[93510]: pam_unix(sudo:session): session closed for user root Sep 04 22:43:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-72118bcc-aaca-4080-9ca6-6ac0e8415ea0 tempest-GroupsV320Test-589604751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.272s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:43:22 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-72118bcc-aaca-4080-9ca6-6ac0e8415ea0 tempest-GroupsV320Test-589604751 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:43:22 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-72118bcc-aaca-4080-9ca6-6ac0e8415ea0 tempest-GroupsV320Test-589604751 None] Delete group completed successfully. Sep 04 22:43:22 devstack sudo[93505]: pam_unix(sudo:session): session closed for user root Sep 04 22:43:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4caa2069-24eb-453d-aaa6-3cd8f6a964e2 tempest-ServersNegativeTestJSON-994158042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-a4f3c175-445d-4b1b-aa8f-75707ec098aa 1073741824" returned: 0 in 0.476s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:43:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4caa2069-24eb-453d-aaa6-3cd8f6a964e2 tempest-ServersNegativeTestJSON-994158042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-a4f3c175-445d-4b1b-aa8f-75707ec098aa {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:43:22 devstack sudo[93517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-a4f3c175-445d-4b1b-aa8f-75707ec098aa Sep 04 22:43:22 devstack sudo[93517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:43:22 devstack sudo[93517]: pam_unix(sudo:session): session closed for user root Sep 04 22:43:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4caa2069-24eb-453d-aaa6-3cd8f6a964e2 tempest-ServersNegativeTestJSON-994158042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-a4f3c175-445d-4b1b-aa8f-75707ec098aa" returned: 0 in 0.258s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:43:22 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-4caa2069-24eb-453d-aaa6-3cd8f6a964e2 tempest-ServersNegativeTestJSON-994158042 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:43:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-4caa2069-24eb-453d-aaa6-3cd8f6a964e2 tempest-ServersNegativeTestJSON-994158042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:43:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-a329b74b-34fe-47ec-881c-df49c5cc3bf0 tempest-ServerActionsTestOtherA-1336516134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.547s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:43:22 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-a329b74b-34fe-47ec-881c-df49c5cc3bf0 tempest-ServerActionsTestOtherA-1336516134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:43:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-905205137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5473867f-cf74-4841-af09-dc103852f634,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fdc6bad46ef4979817afa54137f7e3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:43:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:43:20Z,use_quota=True,user_id='84e4821e04cd47f3b97da2e72e0586f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:43:22 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-a329b74b-34fe-47ec-881c-df49c5cc3bf0 tempest-ServerActionsTestOtherA-1336516134 None] Creating volume 5473867f-cf74-4841-af09-dc103852f634 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:43:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-a329b74b-34fe-47ec-881c-df49c5cc3bf0 tempest-ServerActionsTestOtherA-1336516134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:43:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-a329b74b-34fe-47ec-881c-df49c5cc3bf0 tempest-ServerActionsTestOtherA-1336516134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:43:22 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-a329b74b-34fe-47ec-881c-df49c5cc3bf0 tempest-ServerActionsTestOtherA-1336516134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:43:22 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-a329b74b-34fe-47ec-881c-df49c5cc3bf0 tempest-ServerActionsTestOtherA-1336516134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:43:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-a329b74b-34fe-47ec-881c-df49c5cc3bf0 tempest-ServerActionsTestOtherA-1336516134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:43:22 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-a329b74b-34fe-47ec-881c-df49c5cc3bf0 tempest-ServerActionsTestOtherA-1336516134 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:43:22 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-a329b74b-34fe-47ec-881c-df49c5cc3bf0 tempest-ServerActionsTestOtherA-1336516134 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:43:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a329b74b-34fe-47ec-881c-df49c5cc3bf0 tempest-ServerActionsTestOtherA-1336516134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5473867f-cf74-4841-af09-dc103852f634 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:43:22 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-4caa2069-24eb-453d-aaa6-3cd8f6a964e2 tempest-ServersNegativeTestJSON-994158042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (015fd3fa-61d6-44ba-9152-988b20b13fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4f3c175-445d-4b1b-aa8f-75707ec098aa', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:43:22 devstack sudo[93520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5473867f-cf74-4841-af09-dc103852f634 1073741824 Sep 04 22:43:22 devstack sudo[93520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:43:22 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-4caa2069-24eb-453d-aaa6-3cd8f6a964e2 tempest-ServersNegativeTestJSON-994158042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f273208-c587-4acc-b790-33e4391d622d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:43:22 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-4caa2069-24eb-453d-aaa6-3cd8f6a964e2 tempest-ServersNegativeTestJSON-994158042 None] Volume volume-a4f3c175-445d-4b1b-aa8f-75707ec098aa (a4f3c175-445d-4b1b-aa8f-75707ec098aa): created successfully Sep 04 22:43:22 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-4caa2069-24eb-453d-aaa6-3cd8f6a964e2 tempest-ServersNegativeTestJSON-994158042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f273208-c587-4acc-b790-33e4391d622d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:43:22 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-4caa2069-24eb-453d-aaa6-3cd8f6a964e2 tempest-ServersNegativeTestJSON-994158042 None] Flow 'volume_create_manager' (aa05e42d-6b97-4a86-9d6f-c8eb40bcebfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:43:22 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-4caa2069-24eb-453d-aaa6-3cd8f6a964e2 tempest-ServersNegativeTestJSON-994158042 None] Created volume successfully. Sep 04 22:43:23 devstack sudo[93520]: pam_unix(sudo:session): session closed for user root Sep 04 22:43:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a329b74b-34fe-47ec-881c-df49c5cc3bf0 tempest-ServerActionsTestOtherA-1336516134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5473867f-cf74-4841-af09-dc103852f634 1073741824" returned: 0 in 0.497s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:43:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a329b74b-34fe-47ec-881c-df49c5cc3bf0 tempest-ServerActionsTestOtherA-1336516134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5473867f-cf74-4841-af09-dc103852f634 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:43:23 devstack sudo[93526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5473867f-cf74-4841-af09-dc103852f634 Sep 04 22:43:23 devstack sudo[93526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:43:23 devstack sudo[93526]: pam_unix(sudo:session): session closed for user root Sep 04 22:43:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a329b74b-34fe-47ec-881c-df49c5cc3bf0 tempest-ServerActionsTestOtherA-1336516134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5473867f-cf74-4841-af09-dc103852f634" returned: 0 in 0.307s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:43:23 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-a329b74b-34fe-47ec-881c-df49c5cc3bf0 tempest-ServerActionsTestOtherA-1336516134 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:43:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-a329b74b-34fe-47ec-881c-df49c5cc3bf0 tempest-ServerActionsTestOtherA-1336516134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:43:23 devstack cinder-volume[87576]: DEBUG cinder.volume.volume_utils [None req-a329b74b-34fe-47ec-881c-df49c5cc3bf0 tempest-ServerActionsTestOtherA-1336516134 None] Attempting download of 4f8d7a81-6282-4f52-a601-d840d8973365 ((None, [{'url': 'file:///opt/stack/data/glance/images/4f8d7a81-6282-4f52-a601-d840d8973365', 'metadata': {}}])) to volume 5473867f-cf74-4841-af09-dc103852f634. {{(pid=87576) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 04 22:43:23 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[af3cb03d-0c38-42f8-ace5-87745f9d4ca6]: (4, 'raw') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:43:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a329b74b-34fe-47ec-881c-df49c5cc3bf0 tempest-ServerActionsTestOtherA-1336516134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4f8d7a81-6282-4f52-a601-d840d8973365_fe6jmhqq {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:43:23 devstack sudo[93529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4f8d7a81-6282-4f52-a601-d840d8973365_fe6jmhqq Sep 04 22:43:23 devstack sudo[93529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:43:23 devstack sudo[93529]: pam_unix(sudo:session): session closed for user root Sep 04 22:43:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a329b74b-34fe-47ec-881c-df49c5cc3bf0 tempest-ServerActionsTestOtherA-1336516134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4f8d7a81-6282-4f52-a601-d840d8973365_fe6jmhqq" returned: 0 in 0.460s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:43:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a329b74b-34fe-47ec-881c-df49c5cc3bf0 tempest-ServerActionsTestOtherA-1336516134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4f8d7a81-6282-4f52-a601-d840d8973365_fe6jmhqq {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:43:24 devstack sudo[93567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4f8d7a81-6282-4f52-a601-d840d8973365_fe6jmhqq Sep 04 22:43:24 devstack sudo[93567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:43:24 devstack sudo[93567]: pam_unix(sudo:session): session closed for user root Sep 04 22:43:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a329b74b-34fe-47ec-881c-df49c5cc3bf0 tempest-ServerActionsTestOtherA-1336516134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4f8d7a81-6282-4f52-a601-d840d8973365_fe6jmhqq" returned: 1 in 0.676s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:43:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a329b74b-34fe-47ec-881c-df49c5cc3bf0 tempest-ServerActionsTestOtherA-1336516134 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4f8d7a81-6282-4f52-a601-d840d8973365_fe6jmhqq' failed. Not Retrying. {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 22:43:24 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef7a03e5-285b-48b6-ad57-9ddbfdb1f7ed]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:43:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a329b74b-34fe-47ec-881c-df49c5cc3bf0 tempest-ServerActionsTestOtherA-1336516134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f8d7a81-6282-4f52-a601-d840d8973365_eyfc1i1gdevstack@QuobyteHD {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:43:24 devstack sudo[93573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f8d7a81-6282-4f52-a601-d840d8973365_eyfc1i1gdevstack@QuobyteHD Sep 04 22:43:24 devstack sudo[93573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:43:25 devstack sudo[93573]: pam_unix(sudo:session): session closed for user root Sep 04 22:43:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a329b74b-34fe-47ec-881c-df49c5cc3bf0 tempest-ServerActionsTestOtherA-1336516134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f8d7a81-6282-4f52-a601-d840d8973365_eyfc1i1gdevstack@QuobyteHD" returned: 0 in 0.570s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:43:25 devstack cinder-volume[87576]: DEBUG cinder.image.image_utils [None req-a329b74b-34fe-47ec-881c-df49c5cc3bf0 tempest-ServerActionsTestOtherA-1336516134 None] 4f8d7a81-6282-4f52-a601-d840d8973365 was qcow2, converting to qcow2 {{(pid=87576) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 04 22:43:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a329b74b-34fe-47ec-881c-df49c5cc3bf0 tempest-ServerActionsTestOtherA-1336516134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4f8d7a81-6282-4f52-a601-d840d8973365_eyfc1i1gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5473867f-cf74-4841-af09-dc103852f634 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:43:25 devstack sudo[93578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4f8d7a81-6282-4f52-a601-d840d8973365_eyfc1i1gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5473867f-cf74-4841-af09-dc103852f634 Sep 04 22:43:25 devstack sudo[93578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:43:25 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-acb4c1cc-809a-4efe-8fbe-39b82862e415 tempest-VolumesListTestJSON-2026633540 None] Acquiring lock "cinder-6c10b798-7624-4baf-8d33-dcb868fb07e6-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:43:25 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-0aa05046-44c4-4cab-af27-cddff716e461 tempest-ServersNegativeTestJSON-994158042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:43:25 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0aa05046-44c4-4cab-af27-cddff716e461 tempest-ServersNegativeTestJSON-994158042 None] Flow 'volume_create_manager' (87befa1d-c114-4cf5-bb19-3cb2ed79cdc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:43:25 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0aa05046-44c4-4cab-af27-cddff716e461 tempest-ServersNegativeTestJSON-994158042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49e474f1-92a7-4f79-8291-ae8554313f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:43:25 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-acb4c1cc-809a-4efe-8fbe-39b82862e415 tempest-VolumesListTestJSON-2026633540 None] Lock "cinder-6c10b798-7624-4baf-8d33-dcb868fb07e6-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:43:25 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0aa05046-44c4-4cab-af27-cddff716e461 tempest-ServersNegativeTestJSON-994158042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49e474f1-92a7-4f79-8291-ae8554313f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:43:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1863335764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40c3f20c-a1d9-4717-8e8b-f437dba9b1bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='924fb0c1db904953b6a33b3d6c319da5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:43:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:43:25Z,use_quota=True,user_id='dd8a40f248d94bf29bef681806027021',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:43:25 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0aa05046-44c4-4cab-af27-cddff716e461 tempest-ServersNegativeTestJSON-994158042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (580e102b-4830-496a-bbf0-2266fc4b4021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:43:25 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0aa05046-44c4-4cab-af27-cddff716e461 tempest-ServersNegativeTestJSON-994158042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (580e102b-4830-496a-bbf0-2266fc4b4021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:43:25 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0aa05046-44c4-4cab-af27-cddff716e461 tempest-ServersNegativeTestJSON-994158042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f475512-a645-44bc-917b-93e838e6d6a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:43:25 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0aa05046-44c4-4cab-af27-cddff716e461 tempest-ServersNegativeTestJSON-994158042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f475512-a645-44bc-917b-93e838e6d6a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40c3f20c-a1d9-4717-8e8b-f437dba9b1bf', 'volume_name': 'volume-40c3f20c-a1d9-4717-8e8b-f437dba9b1bf', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:43:25 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0aa05046-44c4-4cab-af27-cddff716e461 tempest-ServersNegativeTestJSON-994158042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e288f159-aec6-4144-b52a-82baa83d1b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:43:25 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0aa05046-44c4-4cab-af27-cddff716e461 tempest-ServersNegativeTestJSON-994158042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e288f159-aec6-4144-b52a-82baa83d1b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:43:25 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0aa05046-44c4-4cab-af27-cddff716e461 tempest-ServersNegativeTestJSON-994158042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da3d2c07-0f65-401e-b78d-b3d49d1d6573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:43:25 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-0aa05046-44c4-4cab-af27-cddff716e461 tempest-ServersNegativeTestJSON-994158042 None] Volume 40c3f20c-a1d9-4717-8e8b-f437dba9b1bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40c3f20c-a1d9-4717-8e8b-f437dba9b1bf', 'volume_size': 1} Sep 04 22:43:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-0aa05046-44c4-4cab-af27-cddff716e461 tempest-ServersNegativeTestJSON-994158042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:43:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-0aa05046-44c4-4cab-af27-cddff716e461 tempest-ServersNegativeTestJSON-994158042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:43:25 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-0aa05046-44c4-4cab-af27-cddff716e461 tempest-ServersNegativeTestJSON-994158042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:43:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1863335764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40c3f20c-a1d9-4717-8e8b-f437dba9b1bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='924fb0c1db904953b6a33b3d6c319da5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:43:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:43:25Z,use_quota=True,user_id='dd8a40f248d94bf29bef681806027021',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:43:25 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-0aa05046-44c4-4cab-af27-cddff716e461 tempest-ServersNegativeTestJSON-994158042 None] Creating volume 40c3f20c-a1d9-4717-8e8b-f437dba9b1bf {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:43:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-0aa05046-44c4-4cab-af27-cddff716e461 tempest-ServersNegativeTestJSON-994158042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:43:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-0aa05046-44c4-4cab-af27-cddff716e461 tempest-ServersNegativeTestJSON-994158042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:43:25 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-0aa05046-44c4-4cab-af27-cddff716e461 tempest-ServersNegativeTestJSON-994158042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:43:25 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-0aa05046-44c4-4cab-af27-cddff716e461 tempest-ServersNegativeTestJSON-994158042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:43:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-0aa05046-44c4-4cab-af27-cddff716e461 tempest-ServersNegativeTestJSON-994158042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:43:25 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-0aa05046-44c4-4cab-af27-cddff716e461 tempest-ServersNegativeTestJSON-994158042 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:43:25 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-0aa05046-44c4-4cab-af27-cddff716e461 tempest-ServersNegativeTestJSON-994158042 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:43:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0aa05046-44c4-4cab-af27-cddff716e461 tempest-ServersNegativeTestJSON-994158042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-40c3f20c-a1d9-4717-8e8b-f437dba9b1bf 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:43:25 devstack sudo[93581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-40c3f20c-a1d9-4717-8e8b-f437dba9b1bf 1073741824 Sep 04 22:43:25 devstack sudo[93581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:43:25 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-acb4c1cc-809a-4efe-8fbe-39b82862e415 tempest-VolumesListTestJSON-2026633540 None] Acquiring lock "cinder-quobyte-6c10b798-7624-4baf-8d33-dcb868fb07e6" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:43:25 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-acb4c1cc-809a-4efe-8fbe-39b82862e415 tempest-VolumesListTestJSON-2026633540 None] Lock "cinder-quobyte-6c10b798-7624-4baf-8d33-dcb868fb07e6" acquired by "delete_volume" :: waited 0.036s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:43:25 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd651e35-d23b-4d09-88bc-66fbcbcd7a98]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:43:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-acb4c1cc-809a-4efe-8fbe-39b82862e415 tempest-VolumesListTestJSON-2026633540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6c10b798-7624-4baf-8d33-dcb868fb07e6 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:43:25 devstack sudo[93586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6c10b798-7624-4baf-8d33-dcb868fb07e6 Sep 04 22:43:25 devstack sudo[93586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:43:26 devstack sudo[93581]: pam_unix(sudo:session): session closed for user root Sep 04 22:43:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0aa05046-44c4-4cab-af27-cddff716e461 tempest-ServersNegativeTestJSON-994158042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-40c3f20c-a1d9-4717-8e8b-f437dba9b1bf 1073741824" returned: 0 in 0.561s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:43:26 devstack sudo[93586]: pam_unix(sudo:session): session closed for user root Sep 04 22:43:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-acb4c1cc-809a-4efe-8fbe-39b82862e415 tempest-VolumesListTestJSON-2026633540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6c10b798-7624-4baf-8d33-dcb868fb07e6" returned: 0 in 0.472s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:43:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-acb4c1cc-809a-4efe-8fbe-39b82862e415 tempest-VolumesListTestJSON-2026633540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6c10b798-7624-4baf-8d33-dcb868fb07e6 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:43:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0aa05046-44c4-4cab-af27-cddff716e461 tempest-ServersNegativeTestJSON-994158042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-40c3f20c-a1d9-4717-8e8b-f437dba9b1bf {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:43:26 devstack sudo[93596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6c10b798-7624-4baf-8d33-dcb868fb07e6 Sep 04 22:43:26 devstack sudo[93596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:43:26 devstack sudo[93598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-40c3f20c-a1d9-4717-8e8b-f437dba9b1bf Sep 04 22:43:26 devstack sudo[93598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:43:26 devstack sudo[93598]: pam_unix(sudo:session): session closed for user root Sep 04 22:43:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0aa05046-44c4-4cab-af27-cddff716e461 tempest-ServersNegativeTestJSON-994158042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-40c3f20c-a1d9-4717-8e8b-f437dba9b1bf" returned: 0 in 0.376s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:43:26 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-0aa05046-44c4-4cab-af27-cddff716e461 tempest-ServersNegativeTestJSON-994158042 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:43:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-0aa05046-44c4-4cab-af27-cddff716e461 tempest-ServersNegativeTestJSON-994158042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:43:26 devstack sudo[93596]: pam_unix(sudo:session): session closed for user root Sep 04 22:43:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-acb4c1cc-809a-4efe-8fbe-39b82862e415 tempest-VolumesListTestJSON-2026633540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6c10b798-7624-4baf-8d33-dcb868fb07e6" returned: 0 in 0.431s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:43:26 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0aa05046-44c4-4cab-af27-cddff716e461 tempest-ServersNegativeTestJSON-994158042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da3d2c07-0f65-401e-b78d-b3d49d1d6573) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40c3f20c-a1d9-4717-8e8b-f437dba9b1bf', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:43:26 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0aa05046-44c4-4cab-af27-cddff716e461 tempest-ServersNegativeTestJSON-994158042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15a458b7-60d3-4dcb-aa52-95e27463dc31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:43:26 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-acb4c1cc-809a-4efe-8fbe-39b82862e415 tempest-VolumesListTestJSON-2026633540 None] Lock "cinder-quobyte-6c10b798-7624-4baf-8d33-dcb868fb07e6" released by "delete_volume" :: held 0.972s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:43:26 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-0aa05046-44c4-4cab-af27-cddff716e461 tempest-ServersNegativeTestJSON-994158042 None] Volume volume-40c3f20c-a1d9-4717-8e8b-f437dba9b1bf (40c3f20c-a1d9-4717-8e8b-f437dba9b1bf): created successfully Sep 04 22:43:26 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0aa05046-44c4-4cab-af27-cddff716e461 tempest-ServersNegativeTestJSON-994158042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15a458b7-60d3-4dcb-aa52-95e27463dc31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:43:26 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0aa05046-44c4-4cab-af27-cddff716e461 tempest-ServersNegativeTestJSON-994158042 None] Flow 'volume_create_manager' (87befa1d-c114-4cf5-bb19-3cb2ed79cdc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:43:26 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-0aa05046-44c4-4cab-af27-cddff716e461 tempest-ServersNegativeTestJSON-994158042 None] Created volume successfully. Sep 04 22:43:26 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-acb4c1cc-809a-4efe-8fbe-39b82862e415 tempest-VolumesListTestJSON-2026633540 None] Created reservations ['0ff7d9a2-f8f7-4328-a8a8-d2c7ac6fc9a5', 'c243f3c6-6078-442d-a945-c1cd49d4082a', '3183cefc-0bea-46f5-9dab-55f8f51849cc', 'fcd9afa0-373d-45aa-93c8-d205eddb4f66'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:43:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-acb4c1cc-809a-4efe-8fbe-39b82862e415 tempest-VolumesListTestJSON-2026633540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:43:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-acb4c1cc-809a-4efe-8fbe-39b82862e415 tempest-VolumesListTestJSON-2026633540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:43:26 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-acb4c1cc-809a-4efe-8fbe-39b82862e415 tempest-VolumesListTestJSON-2026633540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:43:26 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-acb4c1cc-809a-4efe-8fbe-39b82862e415 tempest-VolumesListTestJSON-2026633540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:43:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-acb4c1cc-809a-4efe-8fbe-39b82862e415 tempest-VolumesListTestJSON-2026633540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:43:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-acb4c1cc-809a-4efe-8fbe-39b82862e415 tempest-VolumesListTestJSON-2026633540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:43:26 devstack sudo[93602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:43:26 devstack sudo[93602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:43:27 devstack sudo[93602]: pam_unix(sudo:session): session closed for user root Sep 04 22:43:27 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-acb4c1cc-809a-4efe-8fbe-39b82862e415 tempest-VolumesListTestJSON-2026633540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.265s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:43:27 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-acb4c1cc-809a-4efe-8fbe-39b82862e415 tempest-VolumesListTestJSON-2026633540 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:43:27 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-acb4c1cc-809a-4efe-8fbe-39b82862e415 tempest-VolumesListTestJSON-2026633540 None] Deleted volume successfully. Sep 04 22:43:27 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-acb4c1cc-809a-4efe-8fbe-39b82862e415 tempest-VolumesListTestJSON-2026633540 None] Lock "cinder-6c10b798-7624-4baf-8d33-dcb868fb07e6-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:43:27 devstack sudo[93578]: pam_unix(sudo:session): session closed for user root Sep 04 22:43:27 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a329b74b-34fe-47ec-881c-df49c5cc3bf0 tempest-ServerActionsTestOtherA-1336516134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4f8d7a81-6282-4f52-a601-d840d8973365_eyfc1i1gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5473867f-cf74-4841-af09-dc103852f634" returned: 0 in 2.216s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:43:27 devstack cinder-volume[87576]: DEBUG cinder.image.image_utils [None req-a329b74b-34fe-47ec-881c-df49c5cc3bf0 tempest-ServerActionsTestOtherA-1336516134 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4f8d7a81-6282-4f52-a601-d840d8973365_eyfc1i1gdevstack@QuobyteHD, size 112.00 MB, duration 2.22 sec, destination /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5473867f-cf74-4841-af09-dc103852f634 {{(pid=87576) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 22:43:27 devstack cinder-volume[87576]: INFO cinder.image.image_utils [None req-a329b74b-34fe-47ec-881c-df49c5cc3bf0 tempest-ServerActionsTestOtherA-1336516134 None] Converted 112.00 MB image at 50.50 MB/s Sep 04 22:43:27 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a329b74b-34fe-47ec-881c-df49c5cc3bf0 tempest-ServerActionsTestOtherA-1336516134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5473867f-cf74-4841-af09-dc103852f634 1G {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:43:27 devstack sudo[93605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5473867f-cf74-4841-af09-dc103852f634 1G Sep 04 22:43:27 devstack sudo[93605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:43:27 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c342349d-b749-4c16-84fe-abca9719958b tempest-VolumesListTestJSON-2026633540 None] Acquiring lock "cinder-5682053c-40e5-4b0a-b742-27c460b969e9-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:43:27 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c342349d-b749-4c16-84fe-abca9719958b tempest-VolumesListTestJSON-2026633540 None] Lock "cinder-5682053c-40e5-4b0a-b742-27c460b969e9-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:43:27 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c342349d-b749-4c16-84fe-abca9719958b tempest-VolumesListTestJSON-2026633540 None] Acquiring lock "cinder-quobyte-5682053c-40e5-4b0a-b742-27c460b969e9" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:43:27 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c342349d-b749-4c16-84fe-abca9719958b tempest-VolumesListTestJSON-2026633540 None] Lock "cinder-quobyte-5682053c-40e5-4b0a-b742-27c460b969e9" acquired by "delete_volume" :: waited 0.018s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:43:27 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b814e28-90ae-493b-8f4a-ab6321db1ca7]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:43:27 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c342349d-b749-4c16-84fe-abca9719958b tempest-VolumesListTestJSON-2026633540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5682053c-40e5-4b0a-b742-27c460b969e9 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:43:27 devstack sudo[93605]: pam_unix(sudo:session): session closed for user root Sep 04 22:43:27 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a329b74b-34fe-47ec-881c-df49c5cc3bf0 tempest-ServerActionsTestOtherA-1336516134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5473867f-cf74-4841-af09-dc103852f634 1G" returned: 0 in 0.449s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:43:27 devstack cinder-volume[87576]: DEBUG cinder.volume.volume_utils [None req-a329b74b-34fe-47ec-881c-df49c5cc3bf0 tempest-ServerActionsTestOtherA-1336516134 None] Downloaded image 4f8d7a81-6282-4f52-a601-d840d8973365 ((None, [{'url': 'file:///opt/stack/data/glance/images/4f8d7a81-6282-4f52-a601-d840d8973365', 'metadata': {}}])) to volume 5473867f-cf74-4841-af09-dc103852f634 successfully. {{(pid=87576) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 04 22:43:27 devstack cinder-volume[87576]: DEBUG cinder.image.image_utils [None req-a329b74b-34fe-47ec-881c-df49c5cc3bf0 tempest-ServerActionsTestOtherA-1336516134 None] Temporary image 4f8d7a81-6282-4f52-a601-d840d8973365 for user 84e4821e04cd47f3b97da2e72e0586f3 is deleted. {{(pid=87576) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 04 22:43:27 devstack cinder-volume[87576]: DEBUG cinder.volume.volume_utils [None req-a329b74b-34fe-47ec-881c-df49c5cc3bf0 tempest-ServerActionsTestOtherA-1336516134 None] Marking volume 5473867f-cf74-4841-af09-dc103852f634 as bootable. {{(pid=87576) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 04 22:43:27 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-5c95c0c9-e8dc-4180-9a8f-bb89d957b77d tempest-ServersNegativeTestJSON-994158042 None] Acquiring lock "cinder-40c3f20c-a1d9-4717-8e8b-f437dba9b1bf-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:43:27 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-a329b74b-34fe-47ec-881c-df49c5cc3bf0 tempest-ServerActionsTestOtherA-1336516134 None] Copying metadata from image 4f8d7a81-6282-4f52-a601-d840d8973365 to 5473867f-cf74-4841-af09-dc103852f634. {{(pid=87576) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 04 22:43:27 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-a329b74b-34fe-47ec-881c-df49c5cc3bf0 tempest-ServerActionsTestOtherA-1336516134 None] Creating volume glance metadata for volume 5473867f-cf74-4841-af09-dc103852f634 backed by image 4f8d7a81-6282-4f52-a601-d840d8973365 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4f8d7a81-6282-4f52-a601-d840d8973365', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87576) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 04 22:43:27 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-5c95c0c9-e8dc-4180-9a8f-bb89d957b77d tempest-ServersNegativeTestJSON-994158042 None] Lock "cinder-40c3f20c-a1d9-4717-8e8b-f437dba9b1bf-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:43:28 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-5c95c0c9-e8dc-4180-9a8f-bb89d957b77d tempest-ServersNegativeTestJSON-994158042 None] Acquiring lock "cinder-quobyte-40c3f20c-a1d9-4717-8e8b-f437dba9b1bf" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:43:28 devstack sudo[93610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5682053c-40e5-4b0a-b742-27c460b969e9 Sep 04 22:43:28 devstack sudo[93610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:43:28 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-5c95c0c9-e8dc-4180-9a8f-bb89d957b77d tempest-ServersNegativeTestJSON-994158042 None] Lock "cinder-quobyte-40c3f20c-a1d9-4717-8e8b-f437dba9b1bf" acquired by "delete_volume" :: waited 0.025s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:43:28 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac463c8-98fc-47ae-9ad7-2eba32c23e67]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:43:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5c95c0c9-e8dc-4180-9a8f-bb89d957b77d tempest-ServersNegativeTestJSON-994158042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-40c3f20c-a1d9-4717-8e8b-f437dba9b1bf {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:43:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-a329b74b-34fe-47ec-881c-df49c5cc3bf0 tempest-ServerActionsTestOtherA-1336516134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8361e4a4-1ea5-4f3c-b423-5515aac6a4ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5473867f-cf74-4841-af09-dc103852f634', 'volume_size': 1, 'image_id': '4f8d7a81-6282-4f52-a601-d840d8973365', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4f8d7a81-6282-4f52-a601-d840d8973365', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5d1fd1f571ef419184ac7eda6748fdd3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4f8d7a81-6282-4f52-a601-d840d8973365', 'created_at': datetime.datetime(2026, 9, 4, 20, 33, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 20, 33, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f8d7a81-6282-4f52-a601-d840d8973365/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:43:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-a329b74b-34fe-47ec-881c-df49c5cc3bf0 tempest-ServerActionsTestOtherA-1336516134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fb3806e-c60e-4cca-8497-0401d57e859f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:43:28 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-a329b74b-34fe-47ec-881c-df49c5cc3bf0 tempest-ServerActionsTestOtherA-1336516134 None] Volume volume-5473867f-cf74-4841-af09-dc103852f634 (5473867f-cf74-4841-af09-dc103852f634): created successfully Sep 04 22:43:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-a329b74b-34fe-47ec-881c-df49c5cc3bf0 tempest-ServerActionsTestOtherA-1336516134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fb3806e-c60e-4cca-8497-0401d57e859f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:43:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-a329b74b-34fe-47ec-881c-df49c5cc3bf0 tempest-ServerActionsTestOtherA-1336516134 None] Flow 'volume_create_manager' (dd28e3b8-d7d9-44ba-a38c-4eedc1ddde05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:43:28 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-a329b74b-34fe-47ec-881c-df49c5cc3bf0 tempest-ServerActionsTestOtherA-1336516134 None] Created volume successfully. Sep 04 22:43:28 devstack sudo[93612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-40c3f20c-a1d9-4717-8e8b-f437dba9b1bf Sep 04 22:43:28 devstack sudo[93612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:43:28 devstack sudo[93610]: pam_unix(sudo:session): session closed for user root Sep 04 22:43:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c342349d-b749-4c16-84fe-abca9719958b tempest-VolumesListTestJSON-2026633540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5682053c-40e5-4b0a-b742-27c460b969e9" returned: 0 in 0.455s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:43:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c342349d-b749-4c16-84fe-abca9719958b tempest-VolumesListTestJSON-2026633540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5682053c-40e5-4b0a-b742-27c460b969e9 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:43:28 devstack sudo[93617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5682053c-40e5-4b0a-b742-27c460b969e9 Sep 04 22:43:28 devstack sudo[93617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:43:28 devstack sudo[93612]: pam_unix(sudo:session): session closed for user root Sep 04 22:43:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5c95c0c9-e8dc-4180-9a8f-bb89d957b77d tempest-ServersNegativeTestJSON-994158042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-40c3f20c-a1d9-4717-8e8b-f437dba9b1bf" returned: 0 in 0.439s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:43:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5c95c0c9-e8dc-4180-9a8f-bb89d957b77d tempest-ServersNegativeTestJSON-994158042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-40c3f20c-a1d9-4717-8e8b-f437dba9b1bf {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:43:28 devstack sudo[93622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-40c3f20c-a1d9-4717-8e8b-f437dba9b1bf Sep 04 22:43:28 devstack sudo[93622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:43:28 devstack sudo[93617]: pam_unix(sudo:session): session closed for user root Sep 04 22:43:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c342349d-b749-4c16-84fe-abca9719958b tempest-VolumesListTestJSON-2026633540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5682053c-40e5-4b0a-b742-27c460b969e9" returned: 0 in 0.328s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:43:28 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c342349d-b749-4c16-84fe-abca9719958b tempest-VolumesListTestJSON-2026633540 None] Lock "cinder-quobyte-5682053c-40e5-4b0a-b742-27c460b969e9" released by "delete_volume" :: held 0.835s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:43:28 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-c342349d-b749-4c16-84fe-abca9719958b tempest-VolumesListTestJSON-2026633540 None] Created reservations ['27dd2f73-968f-44b7-ab74-1bf86f8040a7', '69db887a-f571-463b-943f-fcd3bfc580d4', 'be384f85-bb30-47a5-8823-65bb2e859c7c', '5af9edda-2f8b-4933-b144-e626c388914b'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:43:28 devstack sudo[93622]: pam_unix(sudo:session): session closed for user root Sep 04 22:43:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-c342349d-b749-4c16-84fe-abca9719958b tempest-VolumesListTestJSON-2026633540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:43:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-c342349d-b749-4c16-84fe-abca9719958b tempest-VolumesListTestJSON-2026633540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:43:28 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-c342349d-b749-4c16-84fe-abca9719958b tempest-VolumesListTestJSON-2026633540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:43:28 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-c342349d-b749-4c16-84fe-abca9719958b tempest-VolumesListTestJSON-2026633540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:43:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-c342349d-b749-4c16-84fe-abca9719958b tempest-VolumesListTestJSON-2026633540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:43:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c342349d-b749-4c16-84fe-abca9719958b tempest-VolumesListTestJSON-2026633540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:43:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5c95c0c9-e8dc-4180-9a8f-bb89d957b77d tempest-ServersNegativeTestJSON-994158042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-40c3f20c-a1d9-4717-8e8b-f437dba9b1bf" returned: 0 in 0.341s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:43:28 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-5c95c0c9-e8dc-4180-9a8f-bb89d957b77d tempest-ServersNegativeTestJSON-994158042 None] Lock "cinder-quobyte-40c3f20c-a1d9-4717-8e8b-f437dba9b1bf" released by "delete_volume" :: held 0.847s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:43:28 devstack sudo[93626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:43:28 devstack sudo[93626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:43:28 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-5c95c0c9-e8dc-4180-9a8f-bb89d957b77d tempest-ServersNegativeTestJSON-994158042 None] Created reservations ['2245d2e1-8e84-41fb-944f-5988ac58b2e3', '0f96e550-177f-4fba-a68c-24c8589e41a5', 'a0815b4d-a009-4ad3-908a-e957ba6ac08f', '0db841c9-298a-411b-8b21-092e8bb3178a'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:43:29 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-bb815911-2562-40f0-a4f6-1f2116fc10d2 tempest-VolumesListTestJSON-2026633540 None] Acquiring lock "cinder-24e77bb2-7651-467c-80ec-17cf3cefa296-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:43:29 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-bb815911-2562-40f0-a4f6-1f2116fc10d2 tempest-VolumesListTestJSON-2026633540 None] Lock "cinder-24e77bb2-7651-467c-80ec-17cf3cefa296-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:43:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-5c95c0c9-e8dc-4180-9a8f-bb89d957b77d tempest-ServersNegativeTestJSON-994158042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:43:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-5c95c0c9-e8dc-4180-9a8f-bb89d957b77d tempest-ServersNegativeTestJSON-994158042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:43:29 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-5c95c0c9-e8dc-4180-9a8f-bb89d957b77d tempest-ServersNegativeTestJSON-994158042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:43:29 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-5c95c0c9-e8dc-4180-9a8f-bb89d957b77d tempest-ServersNegativeTestJSON-994158042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:43:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-5c95c0c9-e8dc-4180-9a8f-bb89d957b77d tempest-ServersNegativeTestJSON-994158042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:43:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5c95c0c9-e8dc-4180-9a8f-bb89d957b77d tempest-ServersNegativeTestJSON-994158042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:43:29 devstack sudo[93629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:43:29 devstack sudo[93629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:43:29 devstack sudo[93626]: pam_unix(sudo:session): session closed for user root Sep 04 22:43:29 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-107585cb-8097-4610-819e-f6e96864847b tempest-ServersNegativeTestJSON-994158042 None] Acquiring lock "cinder-a4f3c175-445d-4b1b-aa8f-75707ec098aa-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:43:29 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-bb815911-2562-40f0-a4f6-1f2116fc10d2 tempest-VolumesListTestJSON-2026633540 None] Acquiring lock "cinder-quobyte-24e77bb2-7651-467c-80ec-17cf3cefa296" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:43:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c342349d-b749-4c16-84fe-abca9719958b tempest-VolumesListTestJSON-2026633540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.422s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:43:29 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-c342349d-b749-4c16-84fe-abca9719958b tempest-VolumesListTestJSON-2026633540 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:43:29 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-c342349d-b749-4c16-84fe-abca9719958b tempest-VolumesListTestJSON-2026633540 None] Deleted volume successfully. Sep 04 22:43:29 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-107585cb-8097-4610-819e-f6e96864847b tempest-ServersNegativeTestJSON-994158042 None] Lock "cinder-a4f3c175-445d-4b1b-aa8f-75707ec098aa-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:43:29 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-bb815911-2562-40f0-a4f6-1f2116fc10d2 tempest-VolumesListTestJSON-2026633540 None] Lock "cinder-quobyte-24e77bb2-7651-467c-80ec-17cf3cefa296" acquired by "delete_volume" :: waited 0.049s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:43:29 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c342349d-b749-4c16-84fe-abca9719958b tempest-VolumesListTestJSON-2026633540 None] Lock "cinder-5682053c-40e5-4b0a-b742-27c460b969e9-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:43:29 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc728d33-e2de-4436-b868-9c6e64e03abc]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:43:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-bb815911-2562-40f0-a4f6-1f2116fc10d2 tempest-VolumesListTestJSON-2026633540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-24e77bb2-7651-467c-80ec-17cf3cefa296 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:43:29 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-107585cb-8097-4610-819e-f6e96864847b tempest-ServersNegativeTestJSON-994158042 None] Acquiring lock "cinder-quobyte-a4f3c175-445d-4b1b-aa8f-75707ec098aa" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:43:29 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-107585cb-8097-4610-819e-f6e96864847b tempest-ServersNegativeTestJSON-994158042 None] Lock "cinder-quobyte-a4f3c175-445d-4b1b-aa8f-75707ec098aa" acquired by "delete_volume" :: waited 0.021s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:43:29 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e95f41-bee4-4849-af4a-59e35f6a64f4]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:43:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-107585cb-8097-4610-819e-f6e96864847b tempest-ServersNegativeTestJSON-994158042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-a4f3c175-445d-4b1b-aa8f-75707ec098aa {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:43:29 devstack sudo[93631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-24e77bb2-7651-467c-80ec-17cf3cefa296 Sep 04 22:43:29 devstack sudo[93631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:43:29 devstack sudo[93629]: pam_unix(sudo:session): session closed for user root Sep 04 22:43:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5c95c0c9-e8dc-4180-9a8f-bb89d957b77d tempest-ServersNegativeTestJSON-994158042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.440s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:43:29 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-5c95c0c9-e8dc-4180-9a8f-bb89d957b77d tempest-ServersNegativeTestJSON-994158042 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:43:29 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-5c95c0c9-e8dc-4180-9a8f-bb89d957b77d tempest-ServersNegativeTestJSON-994158042 None] Deleted volume successfully. Sep 04 22:43:29 devstack sudo[93632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-a4f3c175-445d-4b1b-aa8f-75707ec098aa Sep 04 22:43:29 devstack sudo[93632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:43:29 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-5c95c0c9-e8dc-4180-9a8f-bb89d957b77d tempest-ServersNegativeTestJSON-994158042 None] Lock "cinder-40c3f20c-a1d9-4717-8e8b-f437dba9b1bf-delete_volume" released by "delete_volume" :: held 1.704s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:43:29 devstack sudo[93631]: pam_unix(sudo:session): session closed for user root Sep 04 22:43:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-bb815911-2562-40f0-a4f6-1f2116fc10d2 tempest-VolumesListTestJSON-2026633540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-24e77bb2-7651-467c-80ec-17cf3cefa296" returned: 0 in 0.500s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:43:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-bb815911-2562-40f0-a4f6-1f2116fc10d2 tempest-VolumesListTestJSON-2026633540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-24e77bb2-7651-467c-80ec-17cf3cefa296 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:43:29 devstack sudo[93639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-24e77bb2-7651-467c-80ec-17cf3cefa296 Sep 04 22:43:29 devstack sudo[93639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:43:29 devstack sudo[93632]: pam_unix(sudo:session): session closed for user root Sep 04 22:43:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-107585cb-8097-4610-819e-f6e96864847b tempest-ServersNegativeTestJSON-994158042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-a4f3c175-445d-4b1b-aa8f-75707ec098aa" returned: 0 in 0.522s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:43:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-107585cb-8097-4610-819e-f6e96864847b tempest-ServersNegativeTestJSON-994158042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-a4f3c175-445d-4b1b-aa8f-75707ec098aa {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:43:30 devstack sudo[93644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-a4f3c175-445d-4b1b-aa8f-75707ec098aa Sep 04 22:43:30 devstack sudo[93644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:43:30 devstack sudo[93639]: pam_unix(sudo:session): session closed for user root Sep 04 22:43:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-bb815911-2562-40f0-a4f6-1f2116fc10d2 tempest-VolumesListTestJSON-2026633540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-24e77bb2-7651-467c-80ec-17cf3cefa296" returned: 0 in 0.297s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:43:30 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-bb815911-2562-40f0-a4f6-1f2116fc10d2 tempest-VolumesListTestJSON-2026633540 None] Lock "cinder-quobyte-24e77bb2-7651-467c-80ec-17cf3cefa296" released by "delete_volume" :: held 0.872s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:43:30 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-bb815911-2562-40f0-a4f6-1f2116fc10d2 tempest-VolumesListTestJSON-2026633540 None] Created reservations ['17eaeb5b-b5db-453b-af50-21173388cfe4', '15da969a-1f83-4ccf-9a68-bddc3253c0ba', 'e6f7d74c-a191-4f34-9029-58226e94d3f8', 'c8b61635-80a3-4fba-b417-dde9a8dbe6df'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:43:30 devstack sudo[93644]: pam_unix(sudo:session): session closed for user root Sep 04 22:43:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-bb815911-2562-40f0-a4f6-1f2116fc10d2 tempest-VolumesListTestJSON-2026633540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:43:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-bb815911-2562-40f0-a4f6-1f2116fc10d2 tempest-VolumesListTestJSON-2026633540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:43:30 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-bb815911-2562-40f0-a4f6-1f2116fc10d2 tempest-VolumesListTestJSON-2026633540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:43:30 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-bb815911-2562-40f0-a4f6-1f2116fc10d2 tempest-VolumesListTestJSON-2026633540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:43:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-bb815911-2562-40f0-a4f6-1f2116fc10d2 tempest-VolumesListTestJSON-2026633540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:43:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-bb815911-2562-40f0-a4f6-1f2116fc10d2 tempest-VolumesListTestJSON-2026633540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:43:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-107585cb-8097-4610-819e-f6e96864847b tempest-ServersNegativeTestJSON-994158042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-a4f3c175-445d-4b1b-aa8f-75707ec098aa" returned: 0 in 0.416s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:43:30 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-107585cb-8097-4610-819e-f6e96864847b tempest-ServersNegativeTestJSON-994158042 None] Lock "cinder-quobyte-a4f3c175-445d-4b1b-aa8f-75707ec098aa" released by "delete_volume" :: held 1.009s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:43:30 devstack sudo[93651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:43:30 devstack sudo[93651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:43:30 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-107585cb-8097-4610-819e-f6e96864847b tempest-ServersNegativeTestJSON-994158042 None] Created reservations ['b8bc80f6-876f-4fe4-9c48-a80d22d38886', '9a1be877-4c10-4a09-8224-04b61ab6115c', 'b054a888-1d0e-4c8a-b91c-b73ec864ff86', 'b8c94f06-b17a-408f-8043-a96292a3b9cd'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:43:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-107585cb-8097-4610-819e-f6e96864847b tempest-ServersNegativeTestJSON-994158042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:43:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-107585cb-8097-4610-819e-f6e96864847b tempest-ServersNegativeTestJSON-994158042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:43:30 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-107585cb-8097-4610-819e-f6e96864847b tempest-ServersNegativeTestJSON-994158042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:43:30 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-107585cb-8097-4610-819e-f6e96864847b tempest-ServersNegativeTestJSON-994158042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:43:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-107585cb-8097-4610-819e-f6e96864847b tempest-ServersNegativeTestJSON-994158042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:43:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-107585cb-8097-4610-819e-f6e96864847b tempest-ServersNegativeTestJSON-994158042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:43:30 devstack sudo[93653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:43:30 devstack sudo[93653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:43:30 devstack sudo[93651]: pam_unix(sudo:session): session closed for user root Sep 04 22:43:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-bb815911-2562-40f0-a4f6-1f2116fc10d2 tempest-VolumesListTestJSON-2026633540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.333s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:43:30 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-bb815911-2562-40f0-a4f6-1f2116fc10d2 tempest-VolumesListTestJSON-2026633540 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:43:30 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-bb815911-2562-40f0-a4f6-1f2116fc10d2 tempest-VolumesListTestJSON-2026633540 None] Deleted volume successfully. Sep 04 22:43:30 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-bb815911-2562-40f0-a4f6-1f2116fc10d2 tempest-VolumesListTestJSON-2026633540 None] Lock "cinder-24e77bb2-7651-467c-80ec-17cf3cefa296-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:43:30 devstack sudo[93653]: pam_unix(sudo:session): session closed for user root Sep 04 22:43:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-107585cb-8097-4610-819e-f6e96864847b tempest-ServersNegativeTestJSON-994158042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.292s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:43:30 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-107585cb-8097-4610-819e-f6e96864847b tempest-ServersNegativeTestJSON-994158042 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:43:30 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-107585cb-8097-4610-819e-f6e96864847b tempest-ServersNegativeTestJSON-994158042 None] Deleted volume successfully. Sep 04 22:43:30 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-107585cb-8097-4610-819e-f6e96864847b tempest-ServersNegativeTestJSON-994158042 None] Lock "cinder-a4f3c175-445d-4b1b-aa8f-75707ec098aa-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:43:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-a533d26d-06d0-412d-8fd4-676110e48f17 req-14ae9861-2d6c-4837-aaac-8473da22c3b5 tempest-ServerActionsTestOtherA-1336516134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:43:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-a533d26d-06d0-412d-8fd4-676110e48f17 req-14ae9861-2d6c-4837-aaac-8473da22c3b5 tempest-ServerActionsTestOtherA-1336516134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:43:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-a533d26d-06d0-412d-8fd4-676110e48f17 req-14ae9861-2d6c-4837-aaac-8473da22c3b5 tempest-ServerActionsTestOtherA-1336516134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:43:33 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-a533d26d-06d0-412d-8fd4-676110e48f17 req-14ae9861-2d6c-4837-aaac-8473da22c3b5 tempest-ServerActionsTestOtherA-1336516134 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4', 'name': 'volume-5473867f-cf74-4841-af09-dc103852f634', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f0e303d9-99a3-4731-8bcc-d7fbfbfb9221', 'enforce_multipath': True} {{(pid=87576) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 22:43:33 devstack cinder-volume[87576]: INFO cinder.volume.manager [req-a533d26d-06d0-412d-8fd4-676110e48f17 req-14ae9861-2d6c-4837-aaac-8473da22c3b5 tempest-ServerActionsTestOtherA-1336516134 None] attachment_update completed successfully. Sep 04 22:43:36 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f8f8f67-9645-4ed8-8159-3a78fc0f87ab tempest-VolumesNegativeTest-1132389996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:43:36 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-1f8f8f67-9645-4ed8-8159-3a78fc0f87ab tempest-VolumesNegativeTest-1132389996 None] Flow 'volume_create_manager' (9ba4eefb-1c70-4d11-abbd-0dcc26a11ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:43:36 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-1f8f8f67-9645-4ed8-8159-3a78fc0f87ab tempest-VolumesNegativeTest-1132389996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9364697-2706-48a7-8349-c159ad24f12c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:43:36 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-1f8f8f67-9645-4ed8-8159-3a78fc0f87ab tempest-VolumesNegativeTest-1132389996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9364697-2706-48a7-8349-c159ad24f12c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:43:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2028732778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa271657-4350-4414-846b-ebf25404bd69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7beb43b65225424bbda6adde5400d056',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:43:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:43:36Z,use_quota=True,user_id='66763798b91249b0a98bf7f681c85e18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:43:36 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-1f8f8f67-9645-4ed8-8159-3a78fc0f87ab tempest-VolumesNegativeTest-1132389996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79cd505c-d807-4f7c-83fd-e944ebc2c540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:43:36 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-1f8f8f67-9645-4ed8-8159-3a78fc0f87ab tempest-VolumesNegativeTest-1132389996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79cd505c-d807-4f7c-83fd-e944ebc2c540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:43:36 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-1f8f8f67-9645-4ed8-8159-3a78fc0f87ab tempest-VolumesNegativeTest-1132389996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (187b9956-c7d4-4138-a59d-68e2e5f4b76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:43:36 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-1f8f8f67-9645-4ed8-8159-3a78fc0f87ab tempest-VolumesNegativeTest-1132389996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (187b9956-c7d4-4138-a59d-68e2e5f4b76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa271657-4350-4414-846b-ebf25404bd69', 'volume_name': 'volume-aa271657-4350-4414-846b-ebf25404bd69', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:43:36 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-1f8f8f67-9645-4ed8-8159-3a78fc0f87ab tempest-VolumesNegativeTest-1132389996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c2f7477-7a4c-483e-9713-034467899f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:43:36 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-1f8f8f67-9645-4ed8-8159-3a78fc0f87ab tempest-VolumesNegativeTest-1132389996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c2f7477-7a4c-483e-9713-034467899f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:43:36 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-1f8f8f67-9645-4ed8-8159-3a78fc0f87ab tempest-VolumesNegativeTest-1132389996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f286660e-8fa2-4c73-bb7e-dab47ca2056c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:43:36 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-1f8f8f67-9645-4ed8-8159-3a78fc0f87ab tempest-VolumesNegativeTest-1132389996 None] Volume aa271657-4350-4414-846b-ebf25404bd69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa271657-4350-4414-846b-ebf25404bd69', 'volume_size': 1} Sep 04 22:43:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-1f8f8f67-9645-4ed8-8159-3a78fc0f87ab tempest-VolumesNegativeTest-1132389996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:43:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-1f8f8f67-9645-4ed8-8159-3a78fc0f87ab tempest-VolumesNegativeTest-1132389996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:43:36 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-1f8f8f67-9645-4ed8-8159-3a78fc0f87ab tempest-VolumesNegativeTest-1132389996 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:43:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2028732778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa271657-4350-4414-846b-ebf25404bd69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7beb43b65225424bbda6adde5400d056',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:43:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:43:36Z,use_quota=True,user_id='66763798b91249b0a98bf7f681c85e18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:43:36 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-1f8f8f67-9645-4ed8-8159-3a78fc0f87ab tempest-VolumesNegativeTest-1132389996 None] Creating volume aa271657-4350-4414-846b-ebf25404bd69 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:43:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-1f8f8f67-9645-4ed8-8159-3a78fc0f87ab tempest-VolumesNegativeTest-1132389996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:43:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-1f8f8f67-9645-4ed8-8159-3a78fc0f87ab tempest-VolumesNegativeTest-1132389996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:43:36 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-1f8f8f67-9645-4ed8-8159-3a78fc0f87ab tempest-VolumesNegativeTest-1132389996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:43:36 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-1f8f8f67-9645-4ed8-8159-3a78fc0f87ab tempest-VolumesNegativeTest-1132389996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:43:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-1f8f8f67-9645-4ed8-8159-3a78fc0f87ab tempest-VolumesNegativeTest-1132389996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:43:36 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-1f8f8f67-9645-4ed8-8159-3a78fc0f87ab tempest-VolumesNegativeTest-1132389996 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:43:36 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-1f8f8f67-9645-4ed8-8159-3a78fc0f87ab tempest-VolumesNegativeTest-1132389996 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:43:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-1f8f8f67-9645-4ed8-8159-3a78fc0f87ab tempest-VolumesNegativeTest-1132389996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-aa271657-4350-4414-846b-ebf25404bd69 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:43:36 devstack sudo[93691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-aa271657-4350-4414-846b-ebf25404bd69 1073741824 Sep 04 22:43:36 devstack sudo[93691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:43:37 devstack sudo[93691]: pam_unix(sudo:session): session closed for user root Sep 04 22:43:37 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-1f8f8f67-9645-4ed8-8159-3a78fc0f87ab tempest-VolumesNegativeTest-1132389996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-aa271657-4350-4414-846b-ebf25404bd69 1073741824" returned: 0 in 0.604s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:43:37 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-1f8f8f67-9645-4ed8-8159-3a78fc0f87ab tempest-VolumesNegativeTest-1132389996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-aa271657-4350-4414-846b-ebf25404bd69 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:43:37 devstack sudo[93699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-aa271657-4350-4414-846b-ebf25404bd69 Sep 04 22:43:37 devstack sudo[93699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:43:37 devstack sudo[93699]: pam_unix(sudo:session): session closed for user root Sep 04 22:43:37 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-1f8f8f67-9645-4ed8-8159-3a78fc0f87ab tempest-VolumesNegativeTest-1132389996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-aa271657-4350-4414-846b-ebf25404bd69" returned: 0 in 0.302s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:43:37 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-1f8f8f67-9645-4ed8-8159-3a78fc0f87ab tempest-VolumesNegativeTest-1132389996 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:43:37 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-1f8f8f67-9645-4ed8-8159-3a78fc0f87ab tempest-VolumesNegativeTest-1132389996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:43:37 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-1f8f8f67-9645-4ed8-8159-3a78fc0f87ab tempest-VolumesNegativeTest-1132389996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f286660e-8fa2-4c73-bb7e-dab47ca2056c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa271657-4350-4414-846b-ebf25404bd69', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:43:37 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-1f8f8f67-9645-4ed8-8159-3a78fc0f87ab tempest-VolumesNegativeTest-1132389996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edc633df-953b-444d-9a0d-4ad47fbd77e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:43:37 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-1f8f8f67-9645-4ed8-8159-3a78fc0f87ab tempest-VolumesNegativeTest-1132389996 None] Volume volume-aa271657-4350-4414-846b-ebf25404bd69 (aa271657-4350-4414-846b-ebf25404bd69): created successfully Sep 04 22:43:37 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-1f8f8f67-9645-4ed8-8159-3a78fc0f87ab tempest-VolumesNegativeTest-1132389996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edc633df-953b-444d-9a0d-4ad47fbd77e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:43:37 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-1f8f8f67-9645-4ed8-8159-3a78fc0f87ab tempest-VolumesNegativeTest-1132389996 None] Flow 'volume_create_manager' (9ba4eefb-1c70-4d11-abbd-0dcc26a11ab7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:43:37 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-1f8f8f67-9645-4ed8-8159-3a78fc0f87ab tempest-VolumesNegativeTest-1132389996 None] Created volume successfully. Sep 04 22:43:47 devstack cinder-volume[87576]: DEBUG dbcounter [-] [87576] Writing DB stats cinder:SELECT=98,cinder:INSERT=32,cinder:UPDATE=89,cinder:DELETE=5 {{(pid=87576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 22:43:47 devstack cinder-volume[87576]: DEBUG dbcounter [-] [87576] Writing DB stats cinder:SELECT=78,cinder:INSERT=27,cinder:UPDATE=113,cinder:DELETE=9 {{(pid=87576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 22:44:02 devstack cinder-volume[87576]: INFO cinder.volume.manager [req-9ce266cc-c854-407e-8ebd-01434d033533 req-36f90666-9cc0-4b5a-a277-b23028b8bb3d tempest-ServerActionsTestOtherA-1336516134 None] Terminate volume connection completed successfully. Sep 04 22:44:02 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-9ce266cc-c854-407e-8ebd-01434d033533 req-36f90666-9cc0-4b5a-a277-b23028b8bb3d tempest-ServerActionsTestOtherA-1336516134 None] Deleting attachment f0e303d9-99a3-4731-8bcc-d7fbfbfb9221. {{(pid=87576) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 22:44:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-9ce266cc-c854-407e-8ebd-01434d033533 req-cc8d11af-caa3-46b2-9d2a-7b23089121b4 tempest-ServerActionsTestOtherA-1336516134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:44:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-9ce266cc-c854-407e-8ebd-01434d033533 req-cc8d11af-caa3-46b2-9d2a-7b23089121b4 tempest-ServerActionsTestOtherA-1336516134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:44:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-9ce266cc-c854-407e-8ebd-01434d033533 req-cc8d11af-caa3-46b2-9d2a-7b23089121b4 tempest-ServerActionsTestOtherA-1336516134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:44:05 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-9ce266cc-c854-407e-8ebd-01434d033533 req-cc8d11af-caa3-46b2-9d2a-7b23089121b4 tempest-ServerActionsTestOtherA-1336516134 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4', 'name': 'volume-5473867f-cf74-4841-af09-dc103852f634', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '11bde93b-154d-4d81-b425-6c05167fc3ea', 'enforce_multipath': True} {{(pid=87576) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 22:44:06 devstack cinder-volume[87576]: INFO cinder.volume.manager [req-9ce266cc-c854-407e-8ebd-01434d033533 req-cc8d11af-caa3-46b2-9d2a-7b23089121b4 tempest-ServerActionsTestOtherA-1336516134 None] attachment_update completed successfully. Sep 04 22:44:11 devstack cinder-volume[87576]: DEBUG oslo_service.periodic_task [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87576) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 22:44:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:44:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:44:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:44:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:44:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:44:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:44:11 devstack sudo[94772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:44:11 devstack sudo[94772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:44:12 devstack sudo[94772]: pam_unix(sudo:session): session closed for user root Sep 04 22:44:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.432s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:44:12 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:44:12 devstack cinder-volume[87576]: DEBUG oslo_service.periodic_task [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Running periodic task VolumeManager._thread_info {{(pid=87576) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 22:44:12 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] thread count: 28 {{(pid=87576) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 22:44:12 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] thread info: [<_MainThread(MainThread, started 125730416963712)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87576) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 22:44:14 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-125298ff-fb54-47b9-93c7-8ba715f83a89 tempest-VolumesNegativeTest-1132389996 None] Acquiring lock "cinder-aa271657-4350-4414-846b-ebf25404bd69-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:44:14 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-125298ff-fb54-47b9-93c7-8ba715f83a89 tempest-VolumesNegativeTest-1132389996 None] Lock "cinder-aa271657-4350-4414-846b-ebf25404bd69-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:44:14 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-125298ff-fb54-47b9-93c7-8ba715f83a89 tempest-VolumesNegativeTest-1132389996 None] Acquiring lock "cinder-quobyte-aa271657-4350-4414-846b-ebf25404bd69" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:44:14 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-125298ff-fb54-47b9-93c7-8ba715f83a89 tempest-VolumesNegativeTest-1132389996 None] Lock "cinder-quobyte-aa271657-4350-4414-846b-ebf25404bd69" acquired by "delete_volume" :: waited 0.025s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:44:14 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9c91c2-a090-43dc-bcad-8dff399fc74a]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:44:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-125298ff-fb54-47b9-93c7-8ba715f83a89 tempest-VolumesNegativeTest-1132389996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-aa271657-4350-4414-846b-ebf25404bd69 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:44:15 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-32308646-c358-4f0c-9a12-0972fc0424dc tempest-AbsoluteLimitsTests-1513413614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:44:15 devstack sudo[94779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-aa271657-4350-4414-846b-ebf25404bd69 Sep 04 22:44:15 devstack sudo[94779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:44:15 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-32308646-c358-4f0c-9a12-0972fc0424dc tempest-AbsoluteLimitsTests-1513413614 None] Flow 'volume_create_manager' (e7b716c8-e889-4248-b81a-ac67ec0bb20d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:44:15 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-32308646-c358-4f0c-9a12-0972fc0424dc tempest-AbsoluteLimitsTests-1513413614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fa49825-788b-4e40-9572-2fb1c32c2ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:44:15 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-32308646-c358-4f0c-9a12-0972fc0424dc tempest-AbsoluteLimitsTests-1513413614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fa49825-788b-4e40-9572-2fb1c32c2ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:44:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1973459745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7076ee2-f876-4520-a426-2c2c161e3106,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f4a94e0260549f4a0594c6fb2116abd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:44:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:44:15Z,use_quota=True,user_id='5c4eaa7ee7fb40f988ca0b7ed8e3b9d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:44:15 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-32308646-c358-4f0c-9a12-0972fc0424dc tempest-AbsoluteLimitsTests-1513413614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2316fb09-f0eb-4c4b-8ef7-101b9f7e4254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:44:15 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-32308646-c358-4f0c-9a12-0972fc0424dc tempest-AbsoluteLimitsTests-1513413614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2316fb09-f0eb-4c4b-8ef7-101b9f7e4254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:44:15 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-32308646-c358-4f0c-9a12-0972fc0424dc tempest-AbsoluteLimitsTests-1513413614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43ff67d1-e093-415a-ab66-23f744fbf746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:44:15 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-32308646-c358-4f0c-9a12-0972fc0424dc tempest-AbsoluteLimitsTests-1513413614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43ff67d1-e093-415a-ab66-23f744fbf746) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7076ee2-f876-4520-a426-2c2c161e3106', 'volume_name': 'volume-b7076ee2-f876-4520-a426-2c2c161e3106', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:44:15 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-32308646-c358-4f0c-9a12-0972fc0424dc tempest-AbsoluteLimitsTests-1513413614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62e6375f-5ea8-45c8-8a39-c476caae82ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:44:15 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-32308646-c358-4f0c-9a12-0972fc0424dc tempest-AbsoluteLimitsTests-1513413614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62e6375f-5ea8-45c8-8a39-c476caae82ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:44:15 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-32308646-c358-4f0c-9a12-0972fc0424dc tempest-AbsoluteLimitsTests-1513413614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2e20fc9-f004-4177-97ea-0c8d240e98be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:44:15 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-32308646-c358-4f0c-9a12-0972fc0424dc tempest-AbsoluteLimitsTests-1513413614 None] Volume b7076ee2-f876-4520-a426-2c2c161e3106: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7076ee2-f876-4520-a426-2c2c161e3106', 'volume_size': 1} Sep 04 22:44:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-32308646-c358-4f0c-9a12-0972fc0424dc tempest-AbsoluteLimitsTests-1513413614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:44:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-32308646-c358-4f0c-9a12-0972fc0424dc tempest-AbsoluteLimitsTests-1513413614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:44:15 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-32308646-c358-4f0c-9a12-0972fc0424dc tempest-AbsoluteLimitsTests-1513413614 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:44:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1973459745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7076ee2-f876-4520-a426-2c2c161e3106,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f4a94e0260549f4a0594c6fb2116abd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:44:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:44:15Z,use_quota=True,user_id='5c4eaa7ee7fb40f988ca0b7ed8e3b9d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:44:15 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-32308646-c358-4f0c-9a12-0972fc0424dc tempest-AbsoluteLimitsTests-1513413614 None] Creating volume b7076ee2-f876-4520-a426-2c2c161e3106 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:44:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-32308646-c358-4f0c-9a12-0972fc0424dc tempest-AbsoluteLimitsTests-1513413614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:44:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-32308646-c358-4f0c-9a12-0972fc0424dc tempest-AbsoluteLimitsTests-1513413614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:44:15 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-32308646-c358-4f0c-9a12-0972fc0424dc tempest-AbsoluteLimitsTests-1513413614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:44:15 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-32308646-c358-4f0c-9a12-0972fc0424dc tempest-AbsoluteLimitsTests-1513413614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:44:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-32308646-c358-4f0c-9a12-0972fc0424dc tempest-AbsoluteLimitsTests-1513413614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:44:15 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-32308646-c358-4f0c-9a12-0972fc0424dc tempest-AbsoluteLimitsTests-1513413614 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:44:15 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-32308646-c358-4f0c-9a12-0972fc0424dc tempest-AbsoluteLimitsTests-1513413614 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:44:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-32308646-c358-4f0c-9a12-0972fc0424dc tempest-AbsoluteLimitsTests-1513413614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b7076ee2-f876-4520-a426-2c2c161e3106 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:44:15 devstack sudo[94781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b7076ee2-f876-4520-a426-2c2c161e3106 1073741824 Sep 04 22:44:15 devstack sudo[94781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:44:15 devstack sudo[94779]: pam_unix(sudo:session): session closed for user root Sep 04 22:44:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-125298ff-fb54-47b9-93c7-8ba715f83a89 tempest-VolumesNegativeTest-1132389996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-aa271657-4350-4414-846b-ebf25404bd69" returned: 0 in 0.599s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:44:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-125298ff-fb54-47b9-93c7-8ba715f83a89 tempest-VolumesNegativeTest-1132389996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-aa271657-4350-4414-846b-ebf25404bd69 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:44:15 devstack sudo[94789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-aa271657-4350-4414-846b-ebf25404bd69 Sep 04 22:44:15 devstack sudo[94789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:44:15 devstack sudo[94781]: pam_unix(sudo:session): session closed for user root Sep 04 22:44:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-32308646-c358-4f0c-9a12-0972fc0424dc tempest-AbsoluteLimitsTests-1513413614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b7076ee2-f876-4520-a426-2c2c161e3106 1073741824" returned: 0 in 0.683s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:44:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-125298ff-fb54-47b9-93c7-8ba715f83a89 tempest-VolumesNegativeTest-1132389996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-aa271657-4350-4414-846b-ebf25404bd69" returned: 0 in 0.454s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:44:15 devstack sudo[94789]: pam_unix(sudo:session): session closed for user root Sep 04 22:44:16 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-32308646-c358-4f0c-9a12-0972fc0424dc tempest-AbsoluteLimitsTests-1513413614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b7076ee2-f876-4520-a426-2c2c161e3106 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:44:16 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-125298ff-fb54-47b9-93c7-8ba715f83a89 tempest-VolumesNegativeTest-1132389996 None] Lock "cinder-quobyte-aa271657-4350-4414-846b-ebf25404bd69" released by "delete_volume" :: held 1.156s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:44:16 devstack sudo[94796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b7076ee2-f876-4520-a426-2c2c161e3106 Sep 04 22:44:16 devstack sudo[94796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:44:16 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-125298ff-fb54-47b9-93c7-8ba715f83a89 tempest-VolumesNegativeTest-1132389996 None] Created reservations ['a69d604d-630e-4a50-ac57-c9ca12232d99', '3d51e439-9734-4755-ab13-6013ec4f3b39', 'b3013bb3-58db-4c96-bda8-1ed706ea4c37', 'ee261989-01d3-4d49-9d6f-af543dfb284f'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:44:16 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-125298ff-fb54-47b9-93c7-8ba715f83a89 tempest-VolumesNegativeTest-1132389996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:44:16 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-125298ff-fb54-47b9-93c7-8ba715f83a89 tempest-VolumesNegativeTest-1132389996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:44:16 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-125298ff-fb54-47b9-93c7-8ba715f83a89 tempest-VolumesNegativeTest-1132389996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:44:16 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-125298ff-fb54-47b9-93c7-8ba715f83a89 tempest-VolumesNegativeTest-1132389996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:44:16 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-125298ff-fb54-47b9-93c7-8ba715f83a89 tempest-VolumesNegativeTest-1132389996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:44:16 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-125298ff-fb54-47b9-93c7-8ba715f83a89 tempest-VolumesNegativeTest-1132389996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:44:16 devstack sudo[94798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:44:16 devstack sudo[94798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:44:16 devstack sudo[94796]: pam_unix(sudo:session): session closed for user root Sep 04 22:44:16 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-32308646-c358-4f0c-9a12-0972fc0424dc tempest-AbsoluteLimitsTests-1513413614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b7076ee2-f876-4520-a426-2c2c161e3106" returned: 0 in 0.385s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:44:16 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-32308646-c358-4f0c-9a12-0972fc0424dc tempest-AbsoluteLimitsTests-1513413614 None] <== create_volume: return (1161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:44:16 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-32308646-c358-4f0c-9a12-0972fc0424dc tempest-AbsoluteLimitsTests-1513413614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.164s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:44:16 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-32308646-c358-4f0c-9a12-0972fc0424dc tempest-AbsoluteLimitsTests-1513413614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2e20fc9-f004-4177-97ea-0c8d240e98be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7076ee2-f876-4520-a426-2c2c161e3106', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:44:16 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-32308646-c358-4f0c-9a12-0972fc0424dc tempest-AbsoluteLimitsTests-1513413614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2614fb3-5c03-4ec5-895e-a8d478689a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:44:16 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-32308646-c358-4f0c-9a12-0972fc0424dc tempest-AbsoluteLimitsTests-1513413614 None] Volume volume-b7076ee2-f876-4520-a426-2c2c161e3106 (b7076ee2-f876-4520-a426-2c2c161e3106): created successfully Sep 04 22:44:16 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-32308646-c358-4f0c-9a12-0972fc0424dc tempest-AbsoluteLimitsTests-1513413614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2614fb3-5c03-4ec5-895e-a8d478689a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:44:16 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-32308646-c358-4f0c-9a12-0972fc0424dc tempest-AbsoluteLimitsTests-1513413614 None] Flow 'volume_create_manager' (e7b716c8-e889-4248-b81a-ac67ec0bb20d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:44:16 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-32308646-c358-4f0c-9a12-0972fc0424dc tempest-AbsoluteLimitsTests-1513413614 None] Created volume successfully. Sep 04 22:44:16 devstack sudo[94798]: pam_unix(sudo:session): session closed for user root Sep 04 22:44:16 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-125298ff-fb54-47b9-93c7-8ba715f83a89 tempest-VolumesNegativeTest-1132389996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.319s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:44:16 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-125298ff-fb54-47b9-93c7-8ba715f83a89 tempest-VolumesNegativeTest-1132389996 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:44:16 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-125298ff-fb54-47b9-93c7-8ba715f83a89 tempest-VolumesNegativeTest-1132389996 None] Deleted volume successfully. Sep 04 22:44:16 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-125298ff-fb54-47b9-93c7-8ba715f83a89 tempest-VolumesNegativeTest-1132389996 None] Lock "cinder-aa271657-4350-4414-846b-ebf25404bd69-delete_volume" released by "delete_volume" :: held 1.824s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:44:17 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c7eed5ba-0c2f-4bf4-bcc1-dc6ac67afb39 tempest-AbsoluteLimitsTests-1513413614 None] Acquiring lock "cinder-b7076ee2-f876-4520-a426-2c2c161e3106-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:44:17 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c7eed5ba-0c2f-4bf4-bcc1-dc6ac67afb39 tempest-AbsoluteLimitsTests-1513413614 None] Lock "cinder-b7076ee2-f876-4520-a426-2c2c161e3106-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:44:17 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c7eed5ba-0c2f-4bf4-bcc1-dc6ac67afb39 tempest-AbsoluteLimitsTests-1513413614 None] Acquiring lock "cinder-quobyte-b7076ee2-f876-4520-a426-2c2c161e3106" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:44:17 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c7eed5ba-0c2f-4bf4-bcc1-dc6ac67afb39 tempest-AbsoluteLimitsTests-1513413614 None] Lock "cinder-quobyte-b7076ee2-f876-4520-a426-2c2c161e3106" acquired by "delete_volume" :: waited 0.049s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:44:17 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[36887a7a-f52e-4ed9-a468-93ae83590f22]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:44:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c7eed5ba-0c2f-4bf4-bcc1-dc6ac67afb39 tempest-AbsoluteLimitsTests-1513413614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b7076ee2-f876-4520-a426-2c2c161e3106 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:44:17 devstack sudo[94804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b7076ee2-f876-4520-a426-2c2c161e3106 Sep 04 22:44:17 devstack sudo[94804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:44:18 devstack sudo[94804]: pam_unix(sudo:session): session closed for user root Sep 04 22:44:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c7eed5ba-0c2f-4bf4-bcc1-dc6ac67afb39 tempest-AbsoluteLimitsTests-1513413614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b7076ee2-f876-4520-a426-2c2c161e3106" returned: 0 in 0.516s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:44:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c7eed5ba-0c2f-4bf4-bcc1-dc6ac67afb39 tempest-AbsoluteLimitsTests-1513413614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b7076ee2-f876-4520-a426-2c2c161e3106 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:44:18 devstack sudo[94824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b7076ee2-f876-4520-a426-2c2c161e3106 Sep 04 22:44:18 devstack sudo[94824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:44:18 devstack sudo[94824]: pam_unix(sudo:session): session closed for user root Sep 04 22:44:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c7eed5ba-0c2f-4bf4-bcc1-dc6ac67afb39 tempest-AbsoluteLimitsTests-1513413614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b7076ee2-f876-4520-a426-2c2c161e3106" returned: 0 in 0.448s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:44:18 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c7eed5ba-0c2f-4bf4-bcc1-dc6ac67afb39 tempest-AbsoluteLimitsTests-1513413614 None] Lock "cinder-quobyte-b7076ee2-f876-4520-a426-2c2c161e3106" released by "delete_volume" :: held 1.053s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:44:18 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-c7eed5ba-0c2f-4bf4-bcc1-dc6ac67afb39 tempest-AbsoluteLimitsTests-1513413614 None] Created reservations ['4975cb79-31e2-4cc3-96a7-d0af78fa7bc1', '4a504f76-bf43-4c62-8b37-005d36f8ac5c', '55607fe7-c918-4490-9885-1f6e5002037d', '4e139e5b-28a1-4736-bf7d-18ea46f133af'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:44:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-c7eed5ba-0c2f-4bf4-bcc1-dc6ac67afb39 tempest-AbsoluteLimitsTests-1513413614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:44:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-c7eed5ba-0c2f-4bf4-bcc1-dc6ac67afb39 tempest-AbsoluteLimitsTests-1513413614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:44:18 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-c7eed5ba-0c2f-4bf4-bcc1-dc6ac67afb39 tempest-AbsoluteLimitsTests-1513413614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:44:18 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-c7eed5ba-0c2f-4bf4-bcc1-dc6ac67afb39 tempest-AbsoluteLimitsTests-1513413614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:44:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-c7eed5ba-0c2f-4bf4-bcc1-dc6ac67afb39 tempest-AbsoluteLimitsTests-1513413614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:44:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c7eed5ba-0c2f-4bf4-bcc1-dc6ac67afb39 tempest-AbsoluteLimitsTests-1513413614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:44:19 devstack sudo[94832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:44:19 devstack sudo[94832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:44:19 devstack sudo[94832]: pam_unix(sudo:session): session closed for user root Sep 04 22:44:19 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c7eed5ba-0c2f-4bf4-bcc1-dc6ac67afb39 tempest-AbsoluteLimitsTests-1513413614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.295s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:44:19 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-c7eed5ba-0c2f-4bf4-bcc1-dc6ac67afb39 tempest-AbsoluteLimitsTests-1513413614 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:44:19 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-c7eed5ba-0c2f-4bf4-bcc1-dc6ac67afb39 tempest-AbsoluteLimitsTests-1513413614 None] Deleted volume successfully. Sep 04 22:44:19 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c7eed5ba-0c2f-4bf4-bcc1-dc6ac67afb39 tempest-AbsoluteLimitsTests-1513413614 None] Lock "cinder-b7076ee2-f876-4520-a426-2c2c161e3106-delete_volume" released by "delete_volume" :: held 1.807s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:44:22 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-691701db-c829-446a-a56a-99d7808fc098 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:44:22 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-691701db-c829-446a-a56a-99d7808fc098 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Flow 'volume_create_manager' (ea2ca65f-0231-4c53-85bd-04254e753bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:44:22 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-691701db-c829-446a-a56a-99d7808fc098 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15f39b3c-1d18-49a7-85f3-86f455137671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:44:22 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-691701db-c829-446a-a56a-99d7808fc098 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15f39b3c-1d18-49a7-85f3-86f455137671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:44:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1502681902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e200eea08dc46f78443783a7d47201c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:44:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:44:23Z,use_quota=True,user_id='d1b8d0f62a174c509f88cb9d3153849c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:44:22 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-691701db-c829-446a-a56a-99d7808fc098 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dd2b853-fee4-47df-8024-2b2ca99234a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:44:22 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-691701db-c829-446a-a56a-99d7808fc098 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dd2b853-fee4-47df-8024-2b2ca99234a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:44:22 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-691701db-c829-446a-a56a-99d7808fc098 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54eff3e8-d964-4d4b-89b4-13eb4f733b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:44:22 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-691701db-c829-446a-a56a-99d7808fc098 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54eff3e8-d964-4d4b-89b4-13eb4f733b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8', 'volume_name': 'volume-5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8', 'volume_size': 2}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:44:22 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-691701db-c829-446a-a56a-99d7808fc098 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e48b7d90-cd5c-43eb-bf72-78dad6bbf6b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:44:22 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-691701db-c829-446a-a56a-99d7808fc098 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e48b7d90-cd5c-43eb-bf72-78dad6bbf6b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:44:22 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-691701db-c829-446a-a56a-99d7808fc098 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4fb3a18-6014-4d57-a4b4-7ec168008e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:44:22 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-691701db-c829-446a-a56a-99d7808fc098 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Volume 5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8', 'volume_size': 2} Sep 04 22:44:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-691701db-c829-446a-a56a-99d7808fc098 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:44:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-691701db-c829-446a-a56a-99d7808fc098 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:44:22 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-691701db-c829-446a-a56a-99d7808fc098 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:44:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1502681902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e200eea08dc46f78443783a7d47201c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:44:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:44:23Z,use_quota=True,user_id='d1b8d0f62a174c509f88cb9d3153849c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:44:22 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-691701db-c829-446a-a56a-99d7808fc098 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Creating volume 5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:44:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-691701db-c829-446a-a56a-99d7808fc098 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:44:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-691701db-c829-446a-a56a-99d7808fc098 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:44:22 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-691701db-c829-446a-a56a-99d7808fc098 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:44:22 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-691701db-c829-446a-a56a-99d7808fc098 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:44:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-691701db-c829-446a-a56a-99d7808fc098 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:44:22 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-691701db-c829-446a-a56a-99d7808fc098 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:44:22 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-691701db-c829-446a-a56a-99d7808fc098 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:44:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-691701db-c829-446a-a56a-99d7808fc098 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8 2147483648 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:44:23 devstack sudo[94899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8 2147483648 Sep 04 22:44:23 devstack sudo[94899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:44:24 devstack sudo[94899]: pam_unix(sudo:session): session closed for user root Sep 04 22:44:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-691701db-c829-446a-a56a-99d7808fc098 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8 2147483648" returned: 0 in 1.100s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:44:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-691701db-c829-446a-a56a-99d7808fc098 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:44:24 devstack sudo[94912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8 Sep 04 22:44:24 devstack sudo[94912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:44:24 devstack sudo[94912]: pam_unix(sudo:session): session closed for user root Sep 04 22:44:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-691701db-c829-446a-a56a-99d7808fc098 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8" returned: 0 in 0.639s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:44:24 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-691701db-c829-446a-a56a-99d7808fc098 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] <== create_volume: return (1887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:44:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-691701db-c829-446a-a56a-99d7808fc098 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.893s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:44:24 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-691701db-c829-446a-a56a-99d7808fc098 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4fb3a18-6014-4d57-a4b4-7ec168008e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8', 'volume_size': 2}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:44:24 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-691701db-c829-446a-a56a-99d7808fc098 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efbb860a-a5f6-407b-9ae5-dd7890cdd732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:44:24 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-691701db-c829-446a-a56a-99d7808fc098 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Volume volume-5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8 (5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8): created successfully Sep 04 22:44:24 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-691701db-c829-446a-a56a-99d7808fc098 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efbb860a-a5f6-407b-9ae5-dd7890cdd732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:44:24 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-691701db-c829-446a-a56a-99d7808fc098 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Flow 'volume_create_manager' (ea2ca65f-0231-4c53-85bd-04254e753bf0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:44:24 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-691701db-c829-446a-a56a-99d7808fc098 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Created volume successfully. Sep 04 22:44:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-485116aa-066f-43cd-8b65-20138b5d3e09 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:44:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-485116aa-066f-43cd-8b65-20138b5d3e09 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:44:26 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-485116aa-066f-43cd-8b65-20138b5d3e09 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Creating offline snapshot 611c60e5-6da7-4a03-bced-293485dd4b10 of volume 5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8 {{(pid=87576) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 22:44:26 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68f9b02-4f90-4037-846a-2f2b73ed527d]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:44:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-485116aa-066f-43cd-8b65-20138b5d3e09 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:44:26 devstack sudo[94955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8 Sep 04 22:44:26 devstack sudo[94955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:44:26 devstack sudo[94955]: pam_unix(sudo:session): session closed for user root Sep 04 22:44:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-485116aa-066f-43cd-8b65-20138b5d3e09 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8" returned: 0 in 0.568s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:44:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-485116aa-066f-43cd-8b65-20138b5d3e09 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8.611c60e5-6da7-4a03-bced-293485dd4b10 2G {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:44:26 devstack sudo[94984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8.611c60e5-6da7-4a03-bced-293485dd4b10 2G Sep 04 22:44:26 devstack sudo[94984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:44:27 devstack sudo[94984]: pam_unix(sudo:session): session closed for user root Sep 04 22:44:27 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-485116aa-066f-43cd-8b65-20138b5d3e09 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8.611c60e5-6da7-4a03-bced-293485dd4b10 2G" returned: 0 in 0.577s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:44:27 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-485116aa-066f-43cd-8b65-20138b5d3e09 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8.611c60e5-6da7-4a03-bced-293485dd4b10 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:44:27 devstack sudo[94991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8.611c60e5-6da7-4a03-bced-293485dd4b10 Sep 04 22:44:27 devstack sudo[94991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:44:27 devstack sudo[94991]: pam_unix(sudo:session): session closed for user root Sep 04 22:44:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-485116aa-066f-43cd-8b65-20138b5d3e09 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8.611c60e5-6da7-4a03-bced-293485dd4b10" returned: 0 in 0.487s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:44:28 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-485116aa-066f-43cd-8b65-20138b5d3e09 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8.611c60e5-6da7-4a03-bced-293485dd4b10 is being set with open permissions: ugo+rw Sep 04 22:44:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-485116aa-066f-43cd-8b65-20138b5d3e09 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8.611c60e5-6da7-4a03-bced-293485dd4b10 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:44:28 devstack sudo[94998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8.611c60e5-6da7-4a03-bced-293485dd4b10 Sep 04 22:44:28 devstack sudo[94998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:44:28 devstack sudo[94998]: pam_unix(sudo:session): session closed for user root Sep 04 22:44:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-485116aa-066f-43cd-8b65-20138b5d3e09 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8.611c60e5-6da7-4a03-bced-293485dd4b10" returned: 0 in 0.311s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:44:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-485116aa-066f-43cd-8b65-20138b5d3e09 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:44:28 devstack sudo[95001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8.info Sep 04 22:44:28 devstack sudo[95001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:44:28 devstack sudo[95001]: pam_unix(sudo:session): session closed for user root Sep 04 22:44:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-485116aa-066f-43cd-8b65-20138b5d3e09 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8.info" returned: 0 in 0.331s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:44:28 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-485116aa-066f-43cd-8b65-20138b5d3e09 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8.info is being set with open permissions: ugo+rw Sep 04 22:44:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-485116aa-066f-43cd-8b65-20138b5d3e09 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:44:28 devstack sudo[95004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8.info Sep 04 22:44:28 devstack sudo[95004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:44:29 devstack sudo[95004]: pam_unix(sudo:session): session closed for user root Sep 04 22:44:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-485116aa-066f-43cd-8b65-20138b5d3e09 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8.info" returned: 0 in 0.308s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:44:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-485116aa-066f-43cd-8b65-20138b5d3e09 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.742s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:44:29 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-485116aa-066f-43cd-8b65-20138b5d3e09 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Create snapshot completed successfully Sep 04 22:44:29 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-9216bc4d-8202-4984-9edb-d6509a987635 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Acquiring lock "cinder-611c60e5-6da7-4a03-bced-293485dd4b10-delete_snapshot" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:44:29 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-9216bc4d-8202-4984-9edb-d6509a987635 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Lock "cinder-611c60e5-6da7-4a03-bced-293485dd4b10-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:44:29 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-9216bc4d-8202-4984-9edb-d6509a987635 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Acquiring lock "cinder-quobyte-5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:44:29 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-9216bc4d-8202-4984-9edb-d6509a987635 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Lock "cinder-quobyte-5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:44:29 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-9216bc4d-8202-4984-9edb-d6509a987635 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Acquiring lock "cinder-quobyte-611c60e5-6da7-4a03-bced-293485dd4b10" by "_delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:44:29 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-9216bc4d-8202-4984-9edb-d6509a987635 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Lock "cinder-quobyte-611c60e5-6da7-4a03-bced-293485dd4b10" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:44:29 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-9216bc4d-8202-4984-9edb-d6509a987635 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Deleting offline snapshot 611c60e5-6da7-4a03-bced-293485dd4b10 of volume 5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8 {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 22:44:29 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-9216bc4d-8202-4984-9edb-d6509a987635 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] snapshot_file for this snap is: volume-5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8.611c60e5-6da7-4a03-bced-293485dd4b10 {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 22:44:29 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[db177252-a4e3-4875-b09a-c7432abeb991]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:44:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-9216bc4d-8202-4984-9edb-d6509a987635 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8.611c60e5-6da7-4a03-bced-293485dd4b10 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:44:29 devstack sudo[95007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8.611c60e5-6da7-4a03-bced-293485dd4b10 Sep 04 22:44:29 devstack sudo[95007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:44:30 devstack sudo[95007]: pam_unix(sudo:session): session closed for user root Sep 04 22:44:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-9216bc4d-8202-4984-9edb-d6509a987635 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8.611c60e5-6da7-4a03-bced-293485dd4b10" returned: 0 in 0.406s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:44:30 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-9216bc4d-8202-4984-9edb-d6509a987635 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 22:44:30 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7898c8-6905-4799-90ea-69e6e6d988f6]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:44:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-9216bc4d-8202-4984-9edb-d6509a987635 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:44:30 devstack sudo[95012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8 Sep 04 22:44:30 devstack sudo[95012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:44:30 devstack sudo[95012]: pam_unix(sudo:session): session closed for user root Sep 04 22:44:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-9216bc4d-8202-4984-9edb-d6509a987635 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8" returned: 0 in 0.405s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:44:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-9216bc4d-8202-4984-9edb-d6509a987635 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8.611c60e5-6da7-4a03-bced-293485dd4b10 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:44:30 devstack sudo[95017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8.611c60e5-6da7-4a03-bced-293485dd4b10 Sep 04 22:44:30 devstack sudo[95017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:44:30 devstack sudo[95017]: pam_unix(sudo:session): session closed for user root Sep 04 22:44:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-9216bc4d-8202-4984-9edb-d6509a987635 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8.611c60e5-6da7-4a03-bced-293485dd4b10" returned: 0 in 0.375s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:44:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-9216bc4d-8202-4984-9edb-d6509a987635 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8.611c60e5-6da7-4a03-bced-293485dd4b10 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:44:30 devstack sudo[95023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8.611c60e5-6da7-4a03-bced-293485dd4b10 Sep 04 22:44:30 devstack sudo[95023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:44:31 devstack sudo[95023]: pam_unix(sudo:session): session closed for user root Sep 04 22:44:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-9216bc4d-8202-4984-9edb-d6509a987635 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8.611c60e5-6da7-4a03-bced-293485dd4b10" returned: 0 in 0.276s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:44:31 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-9216bc4d-8202-4984-9edb-d6509a987635 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Lock "cinder-quobyte-611c60e5-6da7-4a03-bced-293485dd4b10" released by "_delete_snapshot" :: held 1.637s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:44:31 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-9216bc4d-8202-4984-9edb-d6509a987635 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Lock "cinder-quobyte-5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8" released by "delete_snapshot" :: held 1.684s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:44:31 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-9216bc4d-8202-4984-9edb-d6509a987635 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Created reservations ['c3ea687b-adee-41dd-9b36-67c94a6ba569', '4d3e9ad0-a961-4660-aa55-b360893651c1', '58b0841a-4961-4b22-af67-663dab133b63', 'cc4ffa0d-acbb-41e1-8f9a-e92e23dd8ad5'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:44:31 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-9216bc4d-8202-4984-9edb-d6509a987635 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Delete snapshot completed successfully. Sep 04 22:44:31 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-9216bc4d-8202-4984-9edb-d6509a987635 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Lock "cinder-611c60e5-6da7-4a03-bced-293485dd4b10-delete_snapshot" released by "delete_snapshot" :: held 1.883s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:44:31 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-e64bc5ee-509a-4f31-8339-62c7b17f6116 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Acquiring lock "cinder-5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:44:31 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-e64bc5ee-509a-4f31-8339-62c7b17f6116 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Lock "cinder-5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:44:31 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-e64bc5ee-509a-4f31-8339-62c7b17f6116 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Acquiring lock "cinder-quobyte-5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:44:31 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-e64bc5ee-509a-4f31-8339-62c7b17f6116 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Lock "cinder-quobyte-5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8" acquired by "delete_volume" :: waited 0.021s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:44:31 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[8288458a-0d3d-489a-b77f-97511e506a25]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:44:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e64bc5ee-509a-4f31-8339-62c7b17f6116 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:44:32 devstack sudo[95026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8 Sep 04 22:44:32 devstack sudo[95026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:44:32 devstack sudo[95026]: pam_unix(sudo:session): session closed for user root Sep 04 22:44:32 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e64bc5ee-509a-4f31-8339-62c7b17f6116 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8" returned: 0 in 0.409s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:44:32 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e64bc5ee-509a-4f31-8339-62c7b17f6116 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:44:32 devstack sudo[95032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8 Sep 04 22:44:32 devstack sudo[95032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:44:32 devstack sudo[95032]: pam_unix(sudo:session): session closed for user root Sep 04 22:44:32 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e64bc5ee-509a-4f31-8339-62c7b17f6116 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8" returned: 0 in 0.343s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:44:32 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-e64bc5ee-509a-4f31-8339-62c7b17f6116 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Lock "cinder-quobyte-5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8" released by "delete_volume" :: held 0.894s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:44:32 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-e64bc5ee-509a-4f31-8339-62c7b17f6116 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Created reservations ['d28808c1-72d4-40b9-a62a-33289d2ba388', 'ccf9084b-957b-4424-9a61-973cebf76c2c', '938cb897-f989-450f-b4c7-fed6a9a82f08', 'd9891185-f3aa-43a4-866a-13a8043bbeec'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:44:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-e64bc5ee-509a-4f31-8339-62c7b17f6116 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:44:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-e64bc5ee-509a-4f31-8339-62c7b17f6116 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:44:33 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-e64bc5ee-509a-4f31-8339-62c7b17f6116 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:44:33 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-e64bc5ee-509a-4f31-8339-62c7b17f6116 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:44:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-e64bc5ee-509a-4f31-8339-62c7b17f6116 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:44:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e64bc5ee-509a-4f31-8339-62c7b17f6116 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:44:33 devstack sudo[95035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:44:33 devstack sudo[95035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:44:33 devstack sudo[95035]: pam_unix(sudo:session): session closed for user root Sep 04 22:44:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e64bc5ee-509a-4f31-8339-62c7b17f6116 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.459s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:44:33 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-e64bc5ee-509a-4f31-8339-62c7b17f6116 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:44:33 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-e64bc5ee-509a-4f31-8339-62c7b17f6116 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Deleted volume successfully. Sep 04 22:44:33 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-e64bc5ee-509a-4f31-8339-62c7b17f6116 tempest-VolumesSnapshotNegativeTestJSON-1258899996 None] Lock "cinder-5ad3ab3e-c508-4aa8-94f1-d1202d2ca7e8-delete_volume" released by "delete_volume" :: held 1.728s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:44:42 devstack cinder-volume[87576]: INFO cinder.volume.manager [req-3c056bfc-4c75-4e7a-ae27-e48d22c0b52a req-eea65f9e-d3a2-4a30-b0f0-d62ec3ad30cd tempest-ServerActionsTestOtherA-1336516134 None] Terminate volume connection completed successfully. Sep 04 22:44:42 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-3c056bfc-4c75-4e7a-ae27-e48d22c0b52a req-eea65f9e-d3a2-4a30-b0f0-d62ec3ad30cd tempest-ServerActionsTestOtherA-1336516134 None] Deleting attachment 11bde93b-154d-4d81-b425-6c05167fc3ea. {{(pid=87576) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 22:44:42 devstack cinder-volume[87576]: DEBUG cinder.coordination [req-3c056bfc-4c75-4e7a-ae27-e48d22c0b52a req-719d675b-9520-4e88-9eaf-5b4596962423 tempest-ServerActionsTestOtherA-1336516134 None] Acquiring lock "cinder-5473867f-cf74-4841-af09-dc103852f634-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:44:42 devstack cinder-volume[87576]: DEBUG cinder.coordination [req-3c056bfc-4c75-4e7a-ae27-e48d22c0b52a req-719d675b-9520-4e88-9eaf-5b4596962423 tempest-ServerActionsTestOtherA-1336516134 None] Lock "cinder-5473867f-cf74-4841-af09-dc103852f634-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:44:42 devstack cinder-volume[87576]: DEBUG cinder.coordination [req-3c056bfc-4c75-4e7a-ae27-e48d22c0b52a req-719d675b-9520-4e88-9eaf-5b4596962423 tempest-ServerActionsTestOtherA-1336516134 None] Acquiring lock "cinder-quobyte-5473867f-cf74-4841-af09-dc103852f634" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:44:42 devstack cinder-volume[87576]: DEBUG cinder.coordination [req-3c056bfc-4c75-4e7a-ae27-e48d22c0b52a req-719d675b-9520-4e88-9eaf-5b4596962423 tempest-ServerActionsTestOtherA-1336516134 None] Lock "cinder-quobyte-5473867f-cf74-4841-af09-dc103852f634" acquired by "delete_volume" :: waited 0.021s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:44:42 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f3501da-4a09-4bc5-ad97-adead1cb5e0b]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:44:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [req-3c056bfc-4c75-4e7a-ae27-e48d22c0b52a req-719d675b-9520-4e88-9eaf-5b4596962423 tempest-ServerActionsTestOtherA-1336516134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5473867f-cf74-4841-af09-dc103852f634 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:44:42 devstack sudo[95096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5473867f-cf74-4841-af09-dc103852f634 Sep 04 22:44:42 devstack sudo[95096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:44:43 devstack sudo[95096]: pam_unix(sudo:session): session closed for user root Sep 04 22:44:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [req-3c056bfc-4c75-4e7a-ae27-e48d22c0b52a req-719d675b-9520-4e88-9eaf-5b4596962423 tempest-ServerActionsTestOtherA-1336516134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5473867f-cf74-4841-af09-dc103852f634" returned: 0 in 0.488s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:44:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [req-3c056bfc-4c75-4e7a-ae27-e48d22c0b52a req-719d675b-9520-4e88-9eaf-5b4596962423 tempest-ServerActionsTestOtherA-1336516134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5473867f-cf74-4841-af09-dc103852f634 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:44:43 devstack sudo[95101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5473867f-cf74-4841-af09-dc103852f634 Sep 04 22:44:43 devstack sudo[95101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:44:43 devstack sudo[95101]: pam_unix(sudo:session): session closed for user root Sep 04 22:44:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [req-3c056bfc-4c75-4e7a-ae27-e48d22c0b52a req-719d675b-9520-4e88-9eaf-5b4596962423 tempest-ServerActionsTestOtherA-1336516134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5473867f-cf74-4841-af09-dc103852f634" returned: 0 in 0.310s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:44:43 devstack cinder-volume[87576]: DEBUG cinder.coordination [req-3c056bfc-4c75-4e7a-ae27-e48d22c0b52a req-719d675b-9520-4e88-9eaf-5b4596962423 tempest-ServerActionsTestOtherA-1336516134 None] Lock "cinder-quobyte-5473867f-cf74-4841-af09-dc103852f634" released by "delete_volume" :: held 0.863s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:44:43 devstack cinder-volume[87576]: DEBUG cinder.quota [req-3c056bfc-4c75-4e7a-ae27-e48d22c0b52a req-719d675b-9520-4e88-9eaf-5b4596962423 tempest-ServerActionsTestOtherA-1336516134 None] Created reservations ['edcd5b4d-cc63-47f5-b934-a9b4c6173cf0', 'f54597d1-b321-49f4-83db-031f8e6b85f8', 'd97e3481-677b-463b-afbf-dec25d69eaf1', 'd3c0c43e-def3-4465-ae21-c226cc442c9c'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:44:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-3c056bfc-4c75-4e7a-ae27-e48d22c0b52a req-719d675b-9520-4e88-9eaf-5b4596962423 tempest-ServerActionsTestOtherA-1336516134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:44:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-3c056bfc-4c75-4e7a-ae27-e48d22c0b52a req-719d675b-9520-4e88-9eaf-5b4596962423 tempest-ServerActionsTestOtherA-1336516134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:44:43 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [req-3c056bfc-4c75-4e7a-ae27-e48d22c0b52a req-719d675b-9520-4e88-9eaf-5b4596962423 tempest-ServerActionsTestOtherA-1336516134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:44:43 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [req-3c056bfc-4c75-4e7a-ae27-e48d22c0b52a req-719d675b-9520-4e88-9eaf-5b4596962423 tempest-ServerActionsTestOtherA-1336516134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:44:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-3c056bfc-4c75-4e7a-ae27-e48d22c0b52a req-719d675b-9520-4e88-9eaf-5b4596962423 tempest-ServerActionsTestOtherA-1336516134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.052s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:44:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [req-3c056bfc-4c75-4e7a-ae27-e48d22c0b52a req-719d675b-9520-4e88-9eaf-5b4596962423 tempest-ServerActionsTestOtherA-1336516134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:44:43 devstack sudo[95105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:44:43 devstack sudo[95105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:44:44 devstack sudo[95105]: pam_unix(sudo:session): session closed for user root Sep 04 22:44:44 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [req-3c056bfc-4c75-4e7a-ae27-e48d22c0b52a req-719d675b-9520-4e88-9eaf-5b4596962423 tempest-ServerActionsTestOtherA-1336516134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.452s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:44:44 devstack cinder-volume[87576]: DEBUG cinder.manager [req-3c056bfc-4c75-4e7a-ae27-e48d22c0b52a req-719d675b-9520-4e88-9eaf-5b4596962423 tempest-ServerActionsTestOtherA-1336516134 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:44:44 devstack cinder-volume[87576]: INFO cinder.volume.manager [req-3c056bfc-4c75-4e7a-ae27-e48d22c0b52a req-719d675b-9520-4e88-9eaf-5b4596962423 tempest-ServerActionsTestOtherA-1336516134 None] Deleted volume successfully. Sep 04 22:44:44 devstack cinder-volume[87576]: DEBUG cinder.coordination [req-3c056bfc-4c75-4e7a-ae27-e48d22c0b52a req-719d675b-9520-4e88-9eaf-5b4596962423 tempest-ServerActionsTestOtherA-1336516134 None] Lock "cinder-5473867f-cf74-4841-af09-dc103852f634-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:44:45 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-70b5a479-b8ac-4c9a-b4de-5205778fe306 tempest-ServerActionsTestOtherA-1336516134 None] Acquiring lock "cinder-281ffbed-1bd7-47c6-80d4-f79b85b22826-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:44:45 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-70b5a479-b8ac-4c9a-b4de-5205778fe306 tempest-ServerActionsTestOtherA-1336516134 None] Lock "cinder-281ffbed-1bd7-47c6-80d4-f79b85b22826-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:44:45 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-70b5a479-b8ac-4c9a-b4de-5205778fe306 tempest-ServerActionsTestOtherA-1336516134 None] Acquiring lock "cinder-quobyte-281ffbed-1bd7-47c6-80d4-f79b85b22826" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:44:45 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-70b5a479-b8ac-4c9a-b4de-5205778fe306 tempest-ServerActionsTestOtherA-1336516134 None] Lock "cinder-quobyte-281ffbed-1bd7-47c6-80d4-f79b85b22826" acquired by "delete_volume" :: waited 0.027s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:44:45 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e951f3d-202b-4742-ba05-625d873a5854]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:44:45 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-70b5a479-b8ac-4c9a-b4de-5205778fe306 tempest-ServerActionsTestOtherA-1336516134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-281ffbed-1bd7-47c6-80d4-f79b85b22826 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:44:45 devstack sudo[95108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-281ffbed-1bd7-47c6-80d4-f79b85b22826 Sep 04 22:44:45 devstack sudo[95108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:44:46 devstack sudo[95108]: pam_unix(sudo:session): session closed for user root Sep 04 22:44:46 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-70b5a479-b8ac-4c9a-b4de-5205778fe306 tempest-ServerActionsTestOtherA-1336516134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-281ffbed-1bd7-47c6-80d4-f79b85b22826" returned: 0 in 0.469s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:44:46 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-70b5a479-b8ac-4c9a-b4de-5205778fe306 tempest-ServerActionsTestOtherA-1336516134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-281ffbed-1bd7-47c6-80d4-f79b85b22826 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:44:46 devstack sudo[95114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-281ffbed-1bd7-47c6-80d4-f79b85b22826 Sep 04 22:44:46 devstack sudo[95114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:44:46 devstack sudo[95114]: pam_unix(sudo:session): session closed for user root Sep 04 22:44:46 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-70b5a479-b8ac-4c9a-b4de-5205778fe306 tempest-ServerActionsTestOtherA-1336516134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-281ffbed-1bd7-47c6-80d4-f79b85b22826" returned: 0 in 0.396s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:44:46 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-70b5a479-b8ac-4c9a-b4de-5205778fe306 tempest-ServerActionsTestOtherA-1336516134 None] Lock "cinder-quobyte-281ffbed-1bd7-47c6-80d4-f79b85b22826" released by "delete_volume" :: held 0.917s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:44:46 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-70b5a479-b8ac-4c9a-b4de-5205778fe306 tempest-ServerActionsTestOtherA-1336516134 None] Created reservations ['c36aabf2-b8f0-4044-9d2a-3c597ece8bfa', '2ad06c3e-27bb-4b86-824c-7baadba96f51', 'ee981619-7a28-467e-8f4b-6995cf3e2ac6', '984c9783-7ab2-4a5d-aedd-bc062401fec9'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:44:46 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-70b5a479-b8ac-4c9a-b4de-5205778fe306 tempest-ServerActionsTestOtherA-1336516134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:44:46 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-70b5a479-b8ac-4c9a-b4de-5205778fe306 tempest-ServerActionsTestOtherA-1336516134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:44:46 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-70b5a479-b8ac-4c9a-b4de-5205778fe306 tempest-ServerActionsTestOtherA-1336516134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:44:46 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-70b5a479-b8ac-4c9a-b4de-5205778fe306 tempest-ServerActionsTestOtherA-1336516134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:44:46 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-70b5a479-b8ac-4c9a-b4de-5205778fe306 tempest-ServerActionsTestOtherA-1336516134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:44:46 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-70b5a479-b8ac-4c9a-b4de-5205778fe306 tempest-ServerActionsTestOtherA-1336516134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:44:46 devstack sudo[95124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:44:46 devstack sudo[95124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:44:47 devstack sudo[95124]: pam_unix(sudo:session): session closed for user root Sep 04 22:44:47 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-70b5a479-b8ac-4c9a-b4de-5205778fe306 tempest-ServerActionsTestOtherA-1336516134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.429s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:44:47 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-70b5a479-b8ac-4c9a-b4de-5205778fe306 tempest-ServerActionsTestOtherA-1336516134 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:44:47 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-70b5a479-b8ac-4c9a-b4de-5205778fe306 tempest-ServerActionsTestOtherA-1336516134 None] Deleted volume successfully. Sep 04 22:44:47 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-70b5a479-b8ac-4c9a-b4de-5205778fe306 tempest-ServerActionsTestOtherA-1336516134 None] Lock "cinder-281ffbed-1bd7-47c6-80d4-f79b85b22826-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:44:48 devstack cinder-volume[87576]: DEBUG dbcounter [-] [87576] Writing DB stats cinder:UPDATE=46,cinder:SELECT=50,cinder:INSERT=13,cinder:DELETE=2 {{(pid=87576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 22:44:48 devstack cinder-volume[87576]: DEBUG dbcounter [-] [87576] Writing DB stats cinder:SELECT=45,cinder:UPDATE=65,cinder:INSERT=14,cinder:DELETE=6 {{(pid=87576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 22:44:48 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-fce98349-ab5e-4f6f-b4fe-6444839f2044 tempest-AttachVolumeTestJSON-1147748540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:44:48 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-fce98349-ab5e-4f6f-b4fe-6444839f2044 tempest-AttachVolumeTestJSON-1147748540 None] Flow 'volume_create_manager' (bddf5df1-4005-4af5-8bdc-75582ce58a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:44:48 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-fce98349-ab5e-4f6f-b4fe-6444839f2044 tempest-AttachVolumeTestJSON-1147748540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e12f9759-100b-4176-8207-d38ed1ecd41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:44:48 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-fce98349-ab5e-4f6f-b4fe-6444839f2044 tempest-AttachVolumeTestJSON-1147748540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e12f9759-100b-4176-8207-d38ed1ecd41e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:44:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1980496555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=835ac009-3ab0-4394-9610-dd40ebca0fd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='493b0f7420a046b0bd5c132949c7b031',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:44:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:44:49Z,use_quota=True,user_id='834efb407c6844138d24708f548e3d7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:44:48 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-fce98349-ab5e-4f6f-b4fe-6444839f2044 tempest-AttachVolumeTestJSON-1147748540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9239bf5-7949-4a68-ae09-d47abc7e7d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:44:48 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-fce98349-ab5e-4f6f-b4fe-6444839f2044 tempest-AttachVolumeTestJSON-1147748540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9239bf5-7949-4a68-ae09-d47abc7e7d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:44:48 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-fce98349-ab5e-4f6f-b4fe-6444839f2044 tempest-AttachVolumeTestJSON-1147748540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f04eb439-1d87-4217-929a-d0405dd4159b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:44:48 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-fce98349-ab5e-4f6f-b4fe-6444839f2044 tempest-AttachVolumeTestJSON-1147748540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f04eb439-1d87-4217-929a-d0405dd4159b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '835ac009-3ab0-4394-9610-dd40ebca0fd6', 'volume_name': 'volume-835ac009-3ab0-4394-9610-dd40ebca0fd6', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:44:48 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-fce98349-ab5e-4f6f-b4fe-6444839f2044 tempest-AttachVolumeTestJSON-1147748540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40a62004-9896-4e8c-9a26-5c185beb1abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:44:48 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-fce98349-ab5e-4f6f-b4fe-6444839f2044 tempest-AttachVolumeTestJSON-1147748540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40a62004-9896-4e8c-9a26-5c185beb1abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:44:48 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-fce98349-ab5e-4f6f-b4fe-6444839f2044 tempest-AttachVolumeTestJSON-1147748540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8e9cb88-cf46-4834-a6a4-ce3f10fa7d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:44:48 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-fce98349-ab5e-4f6f-b4fe-6444839f2044 tempest-AttachVolumeTestJSON-1147748540 None] Volume 835ac009-3ab0-4394-9610-dd40ebca0fd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-835ac009-3ab0-4394-9610-dd40ebca0fd6', 'volume_size': 1} Sep 04 22:44:48 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-fce98349-ab5e-4f6f-b4fe-6444839f2044 tempest-AttachVolumeTestJSON-1147748540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:44:48 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-fce98349-ab5e-4f6f-b4fe-6444839f2044 tempest-AttachVolumeTestJSON-1147748540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:44:48 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-fce98349-ab5e-4f6f-b4fe-6444839f2044 tempest-AttachVolumeTestJSON-1147748540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:44:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1980496555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=835ac009-3ab0-4394-9610-dd40ebca0fd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='493b0f7420a046b0bd5c132949c7b031',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:44:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:44:49Z,use_quota=True,user_id='834efb407c6844138d24708f548e3d7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:44:48 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-fce98349-ab5e-4f6f-b4fe-6444839f2044 tempest-AttachVolumeTestJSON-1147748540 None] Creating volume 835ac009-3ab0-4394-9610-dd40ebca0fd6 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:44:48 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-fce98349-ab5e-4f6f-b4fe-6444839f2044 tempest-AttachVolumeTestJSON-1147748540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:44:48 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-fce98349-ab5e-4f6f-b4fe-6444839f2044 tempest-AttachVolumeTestJSON-1147748540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:44:48 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-fce98349-ab5e-4f6f-b4fe-6444839f2044 tempest-AttachVolumeTestJSON-1147748540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:44:48 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-fce98349-ab5e-4f6f-b4fe-6444839f2044 tempest-AttachVolumeTestJSON-1147748540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:44:48 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-fce98349-ab5e-4f6f-b4fe-6444839f2044 tempest-AttachVolumeTestJSON-1147748540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:44:48 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-fce98349-ab5e-4f6f-b4fe-6444839f2044 tempest-AttachVolumeTestJSON-1147748540 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:44:48 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-fce98349-ab5e-4f6f-b4fe-6444839f2044 tempest-AttachVolumeTestJSON-1147748540 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:44:48 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-fce98349-ab5e-4f6f-b4fe-6444839f2044 tempest-AttachVolumeTestJSON-1147748540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-835ac009-3ab0-4394-9610-dd40ebca0fd6 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:44:48 devstack sudo[95156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-835ac009-3ab0-4394-9610-dd40ebca0fd6 1073741824 Sep 04 22:44:48 devstack sudo[95156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:44:49 devstack sudo[95156]: pam_unix(sudo:session): session closed for user root Sep 04 22:44:49 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-fce98349-ab5e-4f6f-b4fe-6444839f2044 tempest-AttachVolumeTestJSON-1147748540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-835ac009-3ab0-4394-9610-dd40ebca0fd6 1073741824" returned: 0 in 0.662s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:44:49 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-fce98349-ab5e-4f6f-b4fe-6444839f2044 tempest-AttachVolumeTestJSON-1147748540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-835ac009-3ab0-4394-9610-dd40ebca0fd6 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:44:49 devstack sudo[95163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-835ac009-3ab0-4394-9610-dd40ebca0fd6 Sep 04 22:44:49 devstack sudo[95163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:44:49 devstack sudo[95163]: pam_unix(sudo:session): session closed for user root Sep 04 22:44:49 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-fce98349-ab5e-4f6f-b4fe-6444839f2044 tempest-AttachVolumeTestJSON-1147748540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-835ac009-3ab0-4394-9610-dd40ebca0fd6" returned: 0 in 0.393s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:44:49 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-fce98349-ab5e-4f6f-b4fe-6444839f2044 tempest-AttachVolumeTestJSON-1147748540 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:44:49 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-fce98349-ab5e-4f6f-b4fe-6444839f2044 tempest-AttachVolumeTestJSON-1147748540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:44:49 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-fce98349-ab5e-4f6f-b4fe-6444839f2044 tempest-AttachVolumeTestJSON-1147748540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8e9cb88-cf46-4834-a6a4-ce3f10fa7d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-835ac009-3ab0-4394-9610-dd40ebca0fd6', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:44:49 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-fce98349-ab5e-4f6f-b4fe-6444839f2044 tempest-AttachVolumeTestJSON-1147748540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff76c736-9114-4919-a091-e5643ef95650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:44:49 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-fce98349-ab5e-4f6f-b4fe-6444839f2044 tempest-AttachVolumeTestJSON-1147748540 None] Volume volume-835ac009-3ab0-4394-9610-dd40ebca0fd6 (835ac009-3ab0-4394-9610-dd40ebca0fd6): created successfully Sep 04 22:44:49 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-fce98349-ab5e-4f6f-b4fe-6444839f2044 tempest-AttachVolumeTestJSON-1147748540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff76c736-9114-4919-a091-e5643ef95650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:44:49 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-fce98349-ab5e-4f6f-b4fe-6444839f2044 tempest-AttachVolumeTestJSON-1147748540 None] Flow 'volume_create_manager' (bddf5df1-4005-4af5-8bdc-75582ce58a87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:44:49 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-fce98349-ab5e-4f6f-b4fe-6444839f2044 tempest-AttachVolumeTestJSON-1147748540 None] Created volume successfully. Sep 04 22:44:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-c85b2297-f1dd-4838-b880-d612de7be162 req-0ca16ae5-d60f-4a1e-9867-4206e5392dd9 tempest-AttachVolumeTestJSON-1147748540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:44:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-c85b2297-f1dd-4838-b880-d612de7be162 req-0ca16ae5-d60f-4a1e-9867-4206e5392dd9 tempest-AttachVolumeTestJSON-1147748540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:44:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-c85b2297-f1dd-4838-b880-d612de7be162 req-0ca16ae5-d60f-4a1e-9867-4206e5392dd9 tempest-AttachVolumeTestJSON-1147748540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.037s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:44:52 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-c85b2297-f1dd-4838-b880-d612de7be162 req-0ca16ae5-d60f-4a1e-9867-4206e5392dd9 tempest-AttachVolumeTestJSON-1147748540 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4', 'name': 'volume-835ac009-3ab0-4394-9610-dd40ebca0fd6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b6df8ed8-6a09-47fa-b120-c6b85c555b2d', 'enforce_multipath': True} {{(pid=87576) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 22:44:52 devstack cinder-volume[87576]: INFO cinder.volume.manager [req-c85b2297-f1dd-4838-b880-d612de7be162 req-0ca16ae5-d60f-4a1e-9867-4206e5392dd9 tempest-AttachVolumeTestJSON-1147748540 None] attachment_update completed successfully. Sep 04 22:45:02 devstack cinder-volume[87576]: DEBUG dbcounter [-] [87576] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=87576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 22:45:02 devstack cinder-volume[87576]: DEBUG dbcounter [-] [87576] Writing DB stats cinder:SELECT=10,cinder:UPDATE=5,cinder:INSERT=1 {{(pid=87576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 22:45:11 devstack cinder-volume[87576]: DEBUG oslo_service.periodic_task [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87576) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 22:45:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:45:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:45:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:45:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:45:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:45:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:45:11 devstack sudo[96120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:45:11 devstack sudo[96120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:45:12 devstack sudo[96120]: pam_unix(sudo:session): session closed for user root Sep 04 22:45:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.613s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:45:12 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:45:12 devstack cinder-volume[87576]: DEBUG oslo_service.periodic_task [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Running periodic task VolumeManager._thread_info {{(pid=87576) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 22:45:12 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] thread count: 28 {{(pid=87576) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 22:45:12 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] thread info: [<_MainThread(MainThread, started 125730416963712)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87576) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 22:45:15 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-5e907a48-f514-446e-a996-c56c0904ebb3 tempest-GroupsTest-70886851 None] Group tempest-Group1-1456658753: creating Sep 04 22:45:15 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-5e907a48-f514-446e-a996-c56c0904ebb3 tempest-GroupsTest-70886851 None] Group tempest-Group1-1456658753: created successfully Sep 04 22:45:15 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-5e907a48-f514-446e-a996-c56c0904ebb3 tempest-GroupsTest-70886851 None] Create group completed successfully. Sep 04 22:45:17 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-8c4b7b9d-f0b9-43d4-827f-88f8a28dbb6c tempest-GroupsTest-70886851 None] Group tempest-Group2-1636241884: creating Sep 04 22:45:17 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-8c4b7b9d-f0b9-43d4-827f-88f8a28dbb6c tempest-GroupsTest-70886851 None] Group tempest-Group2-1636241884: created successfully Sep 04 22:45:17 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-8c4b7b9d-f0b9-43d4-827f-88f8a28dbb6c tempest-GroupsTest-70886851 None] Create group completed successfully. Sep 04 22:45:19 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e5f8666-7b67-42da-a066-eed0a28be886 tempest-GroupsTest-70886851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:45:19 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3e5f8666-7b67-42da-a066-eed0a28be886 tempest-GroupsTest-70886851 None] Flow 'volume_create_manager' (a1aa84d5-7b03-4a31-93ba-3d961ba91ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:45:19 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3e5f8666-7b67-42da-a066-eed0a28be886 tempest-GroupsTest-70886851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64973f21-fb05-4f0a-ae5d-9d5ebb4e7983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:45:19 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3e5f8666-7b67-42da-a066-eed0a28be886 tempest-GroupsTest-70886851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64973f21-fb05-4f0a-ae5d-9d5ebb4e7983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1744080703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=22e07b56-ef6d-4ecb-afe9-23d0d4b153c9,host='devstack@QuobyteHD#QuobyteHD',id=3a03c2ea-759c-454e-9c4b-bd09b294488f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ae0c90c23204c0984988169d465fa7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:45:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:45:20Z,use_quota=True,user_id='dc976e9bed164e7092bba4811306f41b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c748a107-9ac9-4b75-9a64-07629193ebf2),volume_type_id=c748a107-9ac9-4b75-9a64-07629193ebf2)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:45:19 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3e5f8666-7b67-42da-a066-eed0a28be886 tempest-GroupsTest-70886851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee4cb2b2-d106-4586-b57b-6cb5ed3d2701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:45:19 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3e5f8666-7b67-42da-a066-eed0a28be886 tempest-GroupsTest-70886851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee4cb2b2-d106-4586-b57b-6cb5ed3d2701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:45:19 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3e5f8666-7b67-42da-a066-eed0a28be886 tempest-GroupsTest-70886851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12485251-304f-4ccc-bf21-e985c5d55237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:45:19 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3e5f8666-7b67-42da-a066-eed0a28be886 tempest-GroupsTest-70886851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12485251-304f-4ccc-bf21-e985c5d55237) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a03c2ea-759c-454e-9c4b-bd09b294488f', 'volume_name': 'volume-3a03c2ea-759c-454e-9c4b-bd09b294488f', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:45:19 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3e5f8666-7b67-42da-a066-eed0a28be886 tempest-GroupsTest-70886851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a38e851-078c-4e35-937f-155206a7ed6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:45:19 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3e5f8666-7b67-42da-a066-eed0a28be886 tempest-GroupsTest-70886851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a38e851-078c-4e35-937f-155206a7ed6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:45:19 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3e5f8666-7b67-42da-a066-eed0a28be886 tempest-GroupsTest-70886851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e32761e2-0897-4c5c-955a-b80abc69c681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:45:19 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-3e5f8666-7b67-42da-a066-eed0a28be886 tempest-GroupsTest-70886851 None] Volume 3a03c2ea-759c-454e-9c4b-bd09b294488f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a03c2ea-759c-454e-9c4b-bd09b294488f', 'volume_size': 1} Sep 04 22:45:19 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-3e5f8666-7b67-42da-a066-eed0a28be886 tempest-GroupsTest-70886851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:45:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-3e5f8666-7b67-42da-a066-eed0a28be886 tempest-GroupsTest-70886851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:45:20 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-3e5f8666-7b67-42da-a066-eed0a28be886 tempest-GroupsTest-70886851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=22e07b56-ef6d-4ecb-afe9-23d0d4b153c9,created_at=2026-09-04T20:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1744080703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=22e07b56-ef6d-4ecb-afe9-23d0d4b153c9,host='devstack@QuobyteHD#QuobyteHD',id=3a03c2ea-759c-454e-9c4b-bd09b294488f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ae0c90c23204c0984988169d465fa7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:45:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:45:20Z,use_quota=True,user_id='dc976e9bed164e7092bba4811306f41b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c748a107-9ac9-4b75-9a64-07629193ebf2),volume_type_id=c748a107-9ac9-4b75-9a64-07629193ebf2)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:45:20 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-3e5f8666-7b67-42da-a066-eed0a28be886 tempest-GroupsTest-70886851 None] Creating volume 3a03c2ea-759c-454e-9c4b-bd09b294488f {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:45:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-3e5f8666-7b67-42da-a066-eed0a28be886 tempest-GroupsTest-70886851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:45:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-3e5f8666-7b67-42da-a066-eed0a28be886 tempest-GroupsTest-70886851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:45:20 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-3e5f8666-7b67-42da-a066-eed0a28be886 tempest-GroupsTest-70886851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:45:20 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-3e5f8666-7b67-42da-a066-eed0a28be886 tempest-GroupsTest-70886851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:45:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-3e5f8666-7b67-42da-a066-eed0a28be886 tempest-GroupsTest-70886851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:45:20 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-3e5f8666-7b67-42da-a066-eed0a28be886 tempest-GroupsTest-70886851 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:45:20 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-3e5f8666-7b67-42da-a066-eed0a28be886 tempest-GroupsTest-70886851 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:45:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3e5f8666-7b67-42da-a066-eed0a28be886 tempest-GroupsTest-70886851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-3a03c2ea-759c-454e-9c4b-bd09b294488f 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:45:20 devstack sudo[96275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-3a03c2ea-759c-454e-9c4b-bd09b294488f 1073741824 Sep 04 22:45:20 devstack sudo[96275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:45:21 devstack sudo[96275]: pam_unix(sudo:session): session closed for user root Sep 04 22:45:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3e5f8666-7b67-42da-a066-eed0a28be886 tempest-GroupsTest-70886851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-3a03c2ea-759c-454e-9c4b-bd09b294488f 1073741824" returned: 0 in 1.118s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:45:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3e5f8666-7b67-42da-a066-eed0a28be886 tempest-GroupsTest-70886851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-3a03c2ea-759c-454e-9c4b-bd09b294488f {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:45:21 devstack sudo[96300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-3a03c2ea-759c-454e-9c4b-bd09b294488f Sep 04 22:45:21 devstack sudo[96300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:45:21 devstack sudo[96300]: pam_unix(sudo:session): session closed for user root Sep 04 22:45:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3e5f8666-7b67-42da-a066-eed0a28be886 tempest-GroupsTest-70886851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-3a03c2ea-759c-454e-9c4b-bd09b294488f" returned: 0 in 0.544s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:45:21 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-3e5f8666-7b67-42da-a066-eed0a28be886 tempest-GroupsTest-70886851 None] <== create_volume: return (1749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:45:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-3e5f8666-7b67-42da-a066-eed0a28be886 tempest-GroupsTest-70886851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.752s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:45:21 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3e5f8666-7b67-42da-a066-eed0a28be886 tempest-GroupsTest-70886851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e32761e2-0897-4c5c-955a-b80abc69c681) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a03c2ea-759c-454e-9c4b-bd09b294488f', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:45:21 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3e5f8666-7b67-42da-a066-eed0a28be886 tempest-GroupsTest-70886851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6f3a758-052c-49e2-ad1c-c280cde74d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:45:21 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-3e5f8666-7b67-42da-a066-eed0a28be886 tempest-GroupsTest-70886851 None] Volume volume-3a03c2ea-759c-454e-9c4b-bd09b294488f (3a03c2ea-759c-454e-9c4b-bd09b294488f): created successfully Sep 04 22:45:21 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3e5f8666-7b67-42da-a066-eed0a28be886 tempest-GroupsTest-70886851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6f3a758-052c-49e2-ad1c-c280cde74d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:45:21 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3e5f8666-7b67-42da-a066-eed0a28be886 tempest-GroupsTest-70886851 None] Flow 'volume_create_manager' (a1aa84d5-7b03-4a31-93ba-3d961ba91ffa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:45:21 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-3e5f8666-7b67-42da-a066-eed0a28be886 tempest-GroupsTest-70886851 None] Created volume successfully. Sep 04 22:45:23 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-7ea3939c-5818-46c7-a5b7-97abaa099650 tempest-GroupsTest-70886851 None] Acquiring lock "cinder-quobyte-3a03c2ea-759c-454e-9c4b-bd09b294488f" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:45:23 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-7ea3939c-5818-46c7-a5b7-97abaa099650 tempest-GroupsTest-70886851 None] Lock "cinder-quobyte-3a03c2ea-759c-454e-9c4b-bd09b294488f" acquired by "delete_volume" :: waited 0.055s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:45:23 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c20564-c48f-4111-9e54-65abe50ae6eb]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:45:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-7ea3939c-5818-46c7-a5b7-97abaa099650 tempest-GroupsTest-70886851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-3a03c2ea-759c-454e-9c4b-bd09b294488f {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:45:24 devstack sudo[96313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-3a03c2ea-759c-454e-9c4b-bd09b294488f Sep 04 22:45:24 devstack sudo[96313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:45:24 devstack sudo[96313]: pam_unix(sudo:session): session closed for user root Sep 04 22:45:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-7ea3939c-5818-46c7-a5b7-97abaa099650 tempest-GroupsTest-70886851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-3a03c2ea-759c-454e-9c4b-bd09b294488f" returned: 0 in 0.706s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:45:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-7ea3939c-5818-46c7-a5b7-97abaa099650 tempest-GroupsTest-70886851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-3a03c2ea-759c-454e-9c4b-bd09b294488f {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:45:24 devstack sudo[96323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-3a03c2ea-759c-454e-9c4b-bd09b294488f Sep 04 22:45:24 devstack sudo[96323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:45:24 devstack sudo[96323]: pam_unix(sudo:session): session closed for user root Sep 04 22:45:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-7ea3939c-5818-46c7-a5b7-97abaa099650 tempest-GroupsTest-70886851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-3a03c2ea-759c-454e-9c4b-bd09b294488f" returned: 0 in 0.304s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:45:24 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-7ea3939c-5818-46c7-a5b7-97abaa099650 tempest-GroupsTest-70886851 None] Lock "cinder-quobyte-3a03c2ea-759c-454e-9c4b-bd09b294488f" released by "delete_volume" :: held 1.135s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:45:25 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-7ea3939c-5818-46c7-a5b7-97abaa099650 tempest-GroupsTest-70886851 None] Created reservations ['070a0253-faf7-49a2-b8f9-0a9fdff91a65'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:45:25 devstack cinder-volume[87576]: WARNING cinder.quota [None req-7ea3939c-5818-46c7-a5b7-97abaa099650 tempest-GroupsTest-70886851 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1916557577 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1916557577, it is now deprecated. Please use the default quota class for default quota. Sep 04 22:45:25 devstack cinder-volume[87576]: WARNING cinder.quota [None req-7ea3939c-5818-46c7-a5b7-97abaa099650 tempest-GroupsTest-70886851 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1916557577 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1916557577, it is now deprecated. Please use the default quota class for default quota. Sep 04 22:45:25 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-7ea3939c-5818-46c7-a5b7-97abaa099650 tempest-GroupsTest-70886851 None] Created reservations ['70629f4c-168f-4599-aff3-950ef45e7023', 'efcc15e4-78e7-4dc0-a704-c2db9d773a05', '6df3c19b-02fa-472f-9b3b-76e16fba15e6', '3ac91477-0d80-4a5f-8611-369138f105a5'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:45:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-7ea3939c-5818-46c7-a5b7-97abaa099650 tempest-GroupsTest-70886851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:45:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-7ea3939c-5818-46c7-a5b7-97abaa099650 tempest-GroupsTest-70886851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:45:25 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-7ea3939c-5818-46c7-a5b7-97abaa099650 tempest-GroupsTest-70886851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:45:25 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-7ea3939c-5818-46c7-a5b7-97abaa099650 tempest-GroupsTest-70886851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:45:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-7ea3939c-5818-46c7-a5b7-97abaa099650 tempest-GroupsTest-70886851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:45:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-7ea3939c-5818-46c7-a5b7-97abaa099650 tempest-GroupsTest-70886851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:45:25 devstack sudo[96384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:45:25 devstack sudo[96384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:45:25 devstack sudo[96384]: pam_unix(sudo:session): session closed for user root Sep 04 22:45:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-7ea3939c-5818-46c7-a5b7-97abaa099650 tempest-GroupsTest-70886851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.342s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:45:25 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-7ea3939c-5818-46c7-a5b7-97abaa099650 tempest-GroupsTest-70886851 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:45:25 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-7ea3939c-5818-46c7-a5b7-97abaa099650 tempest-GroupsTest-70886851 None] Delete group completed successfully. Sep 04 22:45:26 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fda7483-b3f8-48eb-81cc-11b3983d5ec5 tempest-TestMinimumBasicScenario-279502674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:45:26 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-1fda7483-b3f8-48eb-81cc-11b3983d5ec5 tempest-TestMinimumBasicScenario-279502674 None] Flow 'volume_create_manager' (cd82d0c1-4994-47f1-8db4-82b89b0cbb25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:45:26 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-1fda7483-b3f8-48eb-81cc-11b3983d5ec5 tempest-TestMinimumBasicScenario-279502674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (935c5f46-db08-46e5-bb87-7216059e2c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:45:26 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-1fda7483-b3f8-48eb-81cc-11b3983d5ec5 tempest-TestMinimumBasicScenario-279502674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (935c5f46-db08-46e5-bb87-7216059e2c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:45:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1266189570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dc54a97-3000-471d-844d-65755d28185e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fb4b04bde0a4c008758080e09e8facb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:45:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:45:26Z,use_quota=True,user_id='117f02f225394f46a85665601f1160c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:45:26 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-1fda7483-b3f8-48eb-81cc-11b3983d5ec5 tempest-TestMinimumBasicScenario-279502674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40bb4377-e51d-408d-a07a-afc2378777c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:45:26 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-1fda7483-b3f8-48eb-81cc-11b3983d5ec5 tempest-TestMinimumBasicScenario-279502674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40bb4377-e51d-408d-a07a-afc2378777c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:45:26 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-1fda7483-b3f8-48eb-81cc-11b3983d5ec5 tempest-TestMinimumBasicScenario-279502674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b60ba24d-8b4f-4f94-abea-49f018bce715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:45:26 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-1fda7483-b3f8-48eb-81cc-11b3983d5ec5 tempest-TestMinimumBasicScenario-279502674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b60ba24d-8b4f-4f94-abea-49f018bce715) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dc54a97-3000-471d-844d-65755d28185e', 'volume_name': 'volume-6dc54a97-3000-471d-844d-65755d28185e', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:45:26 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-1fda7483-b3f8-48eb-81cc-11b3983d5ec5 tempest-TestMinimumBasicScenario-279502674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10dc3634-65a0-4763-a83c-9bda639fc287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:45:26 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-1fda7483-b3f8-48eb-81cc-11b3983d5ec5 tempest-TestMinimumBasicScenario-279502674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10dc3634-65a0-4763-a83c-9bda639fc287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:45:26 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-1fda7483-b3f8-48eb-81cc-11b3983d5ec5 tempest-TestMinimumBasicScenario-279502674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67959745-e6a2-4000-b6c3-b221638c0a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:45:26 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-1fda7483-b3f8-48eb-81cc-11b3983d5ec5 tempest-TestMinimumBasicScenario-279502674 None] Volume 6dc54a97-3000-471d-844d-65755d28185e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dc54a97-3000-471d-844d-65755d28185e', 'volume_size': 1} Sep 04 22:45:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-1fda7483-b3f8-48eb-81cc-11b3983d5ec5 tempest-TestMinimumBasicScenario-279502674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:45:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-1fda7483-b3f8-48eb-81cc-11b3983d5ec5 tempest-TestMinimumBasicScenario-279502674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:45:26 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-1fda7483-b3f8-48eb-81cc-11b3983d5ec5 tempest-TestMinimumBasicScenario-279502674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:45:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1266189570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dc54a97-3000-471d-844d-65755d28185e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fb4b04bde0a4c008758080e09e8facb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:45:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:45:26Z,use_quota=True,user_id='117f02f225394f46a85665601f1160c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:45:26 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-1fda7483-b3f8-48eb-81cc-11b3983d5ec5 tempest-TestMinimumBasicScenario-279502674 None] Creating volume 6dc54a97-3000-471d-844d-65755d28185e {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:45:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-1fda7483-b3f8-48eb-81cc-11b3983d5ec5 tempest-TestMinimumBasicScenario-279502674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:45:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-1fda7483-b3f8-48eb-81cc-11b3983d5ec5 tempest-TestMinimumBasicScenario-279502674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:45:26 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-1fda7483-b3f8-48eb-81cc-11b3983d5ec5 tempest-TestMinimumBasicScenario-279502674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:45:26 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-1fda7483-b3f8-48eb-81cc-11b3983d5ec5 tempest-TestMinimumBasicScenario-279502674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:45:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-1fda7483-b3f8-48eb-81cc-11b3983d5ec5 tempest-TestMinimumBasicScenario-279502674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:45:26 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-1fda7483-b3f8-48eb-81cc-11b3983d5ec5 tempest-TestMinimumBasicScenario-279502674 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:45:26 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-1fda7483-b3f8-48eb-81cc-11b3983d5ec5 tempest-TestMinimumBasicScenario-279502674 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:45:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-1fda7483-b3f8-48eb-81cc-11b3983d5ec5 tempest-TestMinimumBasicScenario-279502674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6dc54a97-3000-471d-844d-65755d28185e 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:45:26 devstack sudo[96389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6dc54a97-3000-471d-844d-65755d28185e 1073741824 Sep 04 22:45:26 devstack sudo[96389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:45:26 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-5e322f48-de83-4a4a-bd84-8644bf5fb3ee tempest-GroupsTest-70886851 None] Created reservations ['22b69e79-2e21-4558-ac5b-9f7e50a08449'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:45:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-5e322f48-de83-4a4a-bd84-8644bf5fb3ee tempest-GroupsTest-70886851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:45:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-5e322f48-de83-4a4a-bd84-8644bf5fb3ee tempest-GroupsTest-70886851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:45:26 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-5e322f48-de83-4a4a-bd84-8644bf5fb3ee tempest-GroupsTest-70886851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:45:26 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-5e322f48-de83-4a4a-bd84-8644bf5fb3ee tempest-GroupsTest-70886851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:45:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-5e322f48-de83-4a4a-bd84-8644bf5fb3ee tempest-GroupsTest-70886851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:45:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5e322f48-de83-4a4a-bd84-8644bf5fb3ee tempest-GroupsTest-70886851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:45:26 devstack sudo[96394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:45:26 devstack sudo[96394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:45:26 devstack sudo[96389]: pam_unix(sudo:session): session closed for user root Sep 04 22:45:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-1fda7483-b3f8-48eb-81cc-11b3983d5ec5 tempest-TestMinimumBasicScenario-279502674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6dc54a97-3000-471d-844d-65755d28185e 1073741824" returned: 0 in 0.619s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:45:27 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-1fda7483-b3f8-48eb-81cc-11b3983d5ec5 tempest-TestMinimumBasicScenario-279502674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6dc54a97-3000-471d-844d-65755d28185e {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:45:27 devstack sudo[96394]: pam_unix(sudo:session): session closed for user root Sep 04 22:45:27 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5e322f48-de83-4a4a-bd84-8644bf5fb3ee tempest-GroupsTest-70886851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.374s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:45:27 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-5e322f48-de83-4a4a-bd84-8644bf5fb3ee tempest-GroupsTest-70886851 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:45:27 devstack sudo[96398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6dc54a97-3000-471d-844d-65755d28185e Sep 04 22:45:27 devstack sudo[96398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:45:27 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-5e322f48-de83-4a4a-bd84-8644bf5fb3ee tempest-GroupsTest-70886851 None] Delete group completed successfully. Sep 04 22:45:27 devstack sudo[96398]: pam_unix(sudo:session): session closed for user root Sep 04 22:45:27 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-1fda7483-b3f8-48eb-81cc-11b3983d5ec5 tempest-TestMinimumBasicScenario-279502674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6dc54a97-3000-471d-844d-65755d28185e" returned: 0 in 0.293s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:45:27 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-1fda7483-b3f8-48eb-81cc-11b3983d5ec5 tempest-TestMinimumBasicScenario-279502674 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:45:27 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-1fda7483-b3f8-48eb-81cc-11b3983d5ec5 tempest-TestMinimumBasicScenario-279502674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:45:27 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-1fda7483-b3f8-48eb-81cc-11b3983d5ec5 tempest-TestMinimumBasicScenario-279502674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67959745-e6a2-4000-b6c3-b221638c0a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dc54a97-3000-471d-844d-65755d28185e', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:45:27 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-1fda7483-b3f8-48eb-81cc-11b3983d5ec5 tempest-TestMinimumBasicScenario-279502674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (127bf8ea-8578-4d60-94de-ce4b9d2531ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:45:27 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-1fda7483-b3f8-48eb-81cc-11b3983d5ec5 tempest-TestMinimumBasicScenario-279502674 None] Volume volume-6dc54a97-3000-471d-844d-65755d28185e (6dc54a97-3000-471d-844d-65755d28185e): created successfully Sep 04 22:45:27 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-1fda7483-b3f8-48eb-81cc-11b3983d5ec5 tempest-TestMinimumBasicScenario-279502674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (127bf8ea-8578-4d60-94de-ce4b9d2531ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:45:27 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-1fda7483-b3f8-48eb-81cc-11b3983d5ec5 tempest-TestMinimumBasicScenario-279502674 None] Flow 'volume_create_manager' (cd82d0c1-4994-47f1-8db4-82b89b0cbb25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:45:27 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-1fda7483-b3f8-48eb-81cc-11b3983d5ec5 tempest-TestMinimumBasicScenario-279502674 None] Created volume successfully. Sep 04 22:45:28 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-791ce42c-dc3d-41c0-9ef5-f918e74962a2 tempest-GroupsTest-70886851 None] Group tempest-GroupsTest-Group-243172016: creating Sep 04 22:45:28 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-791ce42c-dc3d-41c0-9ef5-f918e74962a2 tempest-GroupsTest-70886851 None] Group tempest-GroupsTest-Group-243172016: created successfully Sep 04 22:45:28 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-791ce42c-dc3d-41c0-9ef5-f918e74962a2 tempest-GroupsTest-70886851 None] Create group completed successfully. Sep 04 22:45:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-db348be8-314e-4cb4-aaee-bb88143f0312 req-c13ded1f-a33c-44cf-bad1-b2d971e9f65c tempest-TestMinimumBasicScenario-279502674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:45:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-db348be8-314e-4cb4-aaee-bb88143f0312 req-c13ded1f-a33c-44cf-bad1-b2d971e9f65c tempest-TestMinimumBasicScenario-279502674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:45:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-db348be8-314e-4cb4-aaee-bb88143f0312 req-c13ded1f-a33c-44cf-bad1-b2d971e9f65c tempest-TestMinimumBasicScenario-279502674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:45:29 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-db348be8-314e-4cb4-aaee-bb88143f0312 req-c13ded1f-a33c-44cf-bad1-b2d971e9f65c tempest-TestMinimumBasicScenario-279502674 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4', 'name': 'volume-6dc54a97-3000-471d-844d-65755d28185e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c01282ce-15ae-4ebd-bd81-46e97d50ca8a', 'enforce_multipath': True} {{(pid=87576) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 22:45:29 devstack cinder-volume[87576]: INFO cinder.volume.manager [req-db348be8-314e-4cb4-aaee-bb88143f0312 req-c13ded1f-a33c-44cf-bad1-b2d971e9f65c tempest-TestMinimumBasicScenario-279502674 None] attachment_update completed successfully. Sep 04 22:45:30 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e948bf9-d5f6-4955-aa69-7bd50b9856de tempest-GroupsTest-70886851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:45:30 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-8e948bf9-d5f6-4955-aa69-7bd50b9856de tempest-GroupsTest-70886851 None] Flow 'volume_create_manager' (4689944c-cfd8-4920-8c5b-995ac24a70a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:45:30 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-8e948bf9-d5f6-4955-aa69-7bd50b9856de tempest-GroupsTest-70886851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (293a9281-a72f-4dee-bd63-9d17ebc1457c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:45:30 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-8e948bf9-d5f6-4955-aa69-7bd50b9856de tempest-GroupsTest-70886851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (293a9281-a72f-4dee-bd63-9d17ebc1457c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:45:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-808848710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=505ea4e5-e9a3-4ba1-a924-1706a50d0230,host='devstack@QuobyteHD#QuobyteHD',id=fb4a6471-0b6f-4d69-850a-34f462c663d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ae0c90c23204c0984988169d465fa7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:45:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:45:30Z,use_quota=True,user_id='dc976e9bed164e7092bba4811306f41b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03a1550f-cd46-4989-b032-b80714da45af),volume_type_id=03a1550f-cd46-4989-b032-b80714da45af)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:45:30 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-8e948bf9-d5f6-4955-aa69-7bd50b9856de tempest-GroupsTest-70886851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82bd51fd-0644-4e1f-aeb7-afa119b23f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:45:30 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-8e948bf9-d5f6-4955-aa69-7bd50b9856de tempest-GroupsTest-70886851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82bd51fd-0644-4e1f-aeb7-afa119b23f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:45:30 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-8e948bf9-d5f6-4955-aa69-7bd50b9856de tempest-GroupsTest-70886851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef591235-839a-41f0-bc94-9083b6dd9de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:45:30 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-8e948bf9-d5f6-4955-aa69-7bd50b9856de tempest-GroupsTest-70886851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef591235-839a-41f0-bc94-9083b6dd9de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb4a6471-0b6f-4d69-850a-34f462c663d5', 'volume_name': 'volume-fb4a6471-0b6f-4d69-850a-34f462c663d5', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:45:30 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-8e948bf9-d5f6-4955-aa69-7bd50b9856de tempest-GroupsTest-70886851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dce72bc4-8564-4dc6-9f1c-c4242a012846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:45:30 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-8e948bf9-d5f6-4955-aa69-7bd50b9856de tempest-GroupsTest-70886851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dce72bc4-8564-4dc6-9f1c-c4242a012846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:45:30 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-8e948bf9-d5f6-4955-aa69-7bd50b9856de tempest-GroupsTest-70886851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49d667f8-5260-435a-9e3e-f988c51db799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:45:30 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-8e948bf9-d5f6-4955-aa69-7bd50b9856de tempest-GroupsTest-70886851 None] Volume fb4a6471-0b6f-4d69-850a-34f462c663d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb4a6471-0b6f-4d69-850a-34f462c663d5', 'volume_size': 1} Sep 04 22:45:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-8e948bf9-d5f6-4955-aa69-7bd50b9856de tempest-GroupsTest-70886851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:45:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-8e948bf9-d5f6-4955-aa69-7bd50b9856de tempest-GroupsTest-70886851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:45:30 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-8e948bf9-d5f6-4955-aa69-7bd50b9856de tempest-GroupsTest-70886851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=505ea4e5-e9a3-4ba1-a924-1706a50d0230,created_at=2026-09-04T20:45:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-808848710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=505ea4e5-e9a3-4ba1-a924-1706a50d0230,host='devstack@QuobyteHD#QuobyteHD',id=fb4a6471-0b6f-4d69-850a-34f462c663d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ae0c90c23204c0984988169d465fa7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:45:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:45:30Z,use_quota=True,user_id='dc976e9bed164e7092bba4811306f41b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03a1550f-cd46-4989-b032-b80714da45af),volume_type_id=03a1550f-cd46-4989-b032-b80714da45af)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:45:30 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-8e948bf9-d5f6-4955-aa69-7bd50b9856de tempest-GroupsTest-70886851 None] Creating volume fb4a6471-0b6f-4d69-850a-34f462c663d5 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:45:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-8e948bf9-d5f6-4955-aa69-7bd50b9856de tempest-GroupsTest-70886851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:45:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-8e948bf9-d5f6-4955-aa69-7bd50b9856de tempest-GroupsTest-70886851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:45:30 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-8e948bf9-d5f6-4955-aa69-7bd50b9856de tempest-GroupsTest-70886851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:45:30 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-8e948bf9-d5f6-4955-aa69-7bd50b9856de tempest-GroupsTest-70886851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:45:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-8e948bf9-d5f6-4955-aa69-7bd50b9856de tempest-GroupsTest-70886851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:45:30 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-8e948bf9-d5f6-4955-aa69-7bd50b9856de tempest-GroupsTest-70886851 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:45:30 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-8e948bf9-d5f6-4955-aa69-7bd50b9856de tempest-GroupsTest-70886851 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:45:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-8e948bf9-d5f6-4955-aa69-7bd50b9856de tempest-GroupsTest-70886851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fb4a6471-0b6f-4d69-850a-34f462c663d5 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:45:30 devstack sudo[96417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fb4a6471-0b6f-4d69-850a-34f462c663d5 1073741824 Sep 04 22:45:30 devstack sudo[96417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:45:30 devstack sudo[96417]: pam_unix(sudo:session): session closed for user root Sep 04 22:45:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-8e948bf9-d5f6-4955-aa69-7bd50b9856de tempest-GroupsTest-70886851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fb4a6471-0b6f-4d69-850a-34f462c663d5 1073741824" returned: 0 in 0.636s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:45:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-8e948bf9-d5f6-4955-aa69-7bd50b9856de tempest-GroupsTest-70886851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fb4a6471-0b6f-4d69-850a-34f462c663d5 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:45:30 devstack sudo[96437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fb4a6471-0b6f-4d69-850a-34f462c663d5 Sep 04 22:45:30 devstack sudo[96437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:45:31 devstack sudo[96437]: pam_unix(sudo:session): session closed for user root Sep 04 22:45:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-8e948bf9-d5f6-4955-aa69-7bd50b9856de tempest-GroupsTest-70886851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fb4a6471-0b6f-4d69-850a-34f462c663d5" returned: 0 in 0.426s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:45:31 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-8e948bf9-d5f6-4955-aa69-7bd50b9856de tempest-GroupsTest-70886851 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:45:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-8e948bf9-d5f6-4955-aa69-7bd50b9856de tempest-GroupsTest-70886851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:45:31 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-8e948bf9-d5f6-4955-aa69-7bd50b9856de tempest-GroupsTest-70886851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49d667f8-5260-435a-9e3e-f988c51db799) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb4a6471-0b6f-4d69-850a-34f462c663d5', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:45:31 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-8e948bf9-d5f6-4955-aa69-7bd50b9856de tempest-GroupsTest-70886851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf9672cf-12d4-479e-bc67-e655ec72d801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:45:31 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-8e948bf9-d5f6-4955-aa69-7bd50b9856de tempest-GroupsTest-70886851 None] Volume volume-fb4a6471-0b6f-4d69-850a-34f462c663d5 (fb4a6471-0b6f-4d69-850a-34f462c663d5): created successfully Sep 04 22:45:31 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-8e948bf9-d5f6-4955-aa69-7bd50b9856de tempest-GroupsTest-70886851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf9672cf-12d4-479e-bc67-e655ec72d801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:45:31 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-8e948bf9-d5f6-4955-aa69-7bd50b9856de tempest-GroupsTest-70886851 None] Flow 'volume_create_manager' (4689944c-cfd8-4920-8c5b-995ac24a70a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:45:31 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-8e948bf9-d5f6-4955-aa69-7bd50b9856de tempest-GroupsTest-70886851 None] Created volume successfully. Sep 04 22:45:33 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-d81163af-9826-4913-9917-4ad66f22e5c3 tempest-GroupsTest-70886851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:45:33 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d81163af-9826-4913-9917-4ad66f22e5c3 tempest-GroupsTest-70886851 None] Flow 'volume_create_manager' (0a651ece-1834-4d4b-89f0-ad928ad875ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:45:33 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d81163af-9826-4913-9917-4ad66f22e5c3 tempest-GroupsTest-70886851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adb7849b-c2dc-49c8-b132-45a09408aafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:45:33 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d81163af-9826-4913-9917-4ad66f22e5c3 tempest-GroupsTest-70886851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adb7849b-c2dc-49c8-b132-45a09408aafe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:45:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-595678668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=505ea4e5-e9a3-4ba1-a924-1706a50d0230,host='devstack@QuobyteHD#QuobyteHD',id=76199100-1286-45ef-b06d-9c64138abed1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ae0c90c23204c0984988169d465fa7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:45:33Z,use_quota=True,user_id='dc976e9bed164e7092bba4811306f41b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03a1550f-cd46-4989-b032-b80714da45af),volume_type_id=03a1550f-cd46-4989-b032-b80714da45af)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:45:33 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d81163af-9826-4913-9917-4ad66f22e5c3 tempest-GroupsTest-70886851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a18e2dd-53c6-4c6e-9bfa-885e344890c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:45:33 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d81163af-9826-4913-9917-4ad66f22e5c3 tempest-GroupsTest-70886851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a18e2dd-53c6-4c6e-9bfa-885e344890c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:45:33 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d81163af-9826-4913-9917-4ad66f22e5c3 tempest-GroupsTest-70886851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbae40d3-47dd-4a7d-8bcc-1aa2f588c48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:45:33 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d81163af-9826-4913-9917-4ad66f22e5c3 tempest-GroupsTest-70886851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbae40d3-47dd-4a7d-8bcc-1aa2f588c48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76199100-1286-45ef-b06d-9c64138abed1', 'volume_name': 'volume-76199100-1286-45ef-b06d-9c64138abed1', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:45:33 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d81163af-9826-4913-9917-4ad66f22e5c3 tempest-GroupsTest-70886851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdf39b39-3d7e-4818-84e8-248bc7e08ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:45:33 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d81163af-9826-4913-9917-4ad66f22e5c3 tempest-GroupsTest-70886851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdf39b39-3d7e-4818-84e8-248bc7e08ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:45:33 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d81163af-9826-4913-9917-4ad66f22e5c3 tempest-GroupsTest-70886851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9148c097-6570-40ad-87a1-7ab2a2713c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:45:33 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-d81163af-9826-4913-9917-4ad66f22e5c3 tempest-GroupsTest-70886851 None] Volume 76199100-1286-45ef-b06d-9c64138abed1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76199100-1286-45ef-b06d-9c64138abed1', 'volume_size': 1} Sep 04 22:45:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-d81163af-9826-4913-9917-4ad66f22e5c3 tempest-GroupsTest-70886851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:45:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-d81163af-9826-4913-9917-4ad66f22e5c3 tempest-GroupsTest-70886851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:45:33 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-d81163af-9826-4913-9917-4ad66f22e5c3 tempest-GroupsTest-70886851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=505ea4e5-e9a3-4ba1-a924-1706a50d0230,created_at=2026-09-04T20:45:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-595678668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=505ea4e5-e9a3-4ba1-a924-1706a50d0230,host='devstack@QuobyteHD#QuobyteHD',id=76199100-1286-45ef-b06d-9c64138abed1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ae0c90c23204c0984988169d465fa7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:45:33Z,use_quota=True,user_id='dc976e9bed164e7092bba4811306f41b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03a1550f-cd46-4989-b032-b80714da45af),volume_type_id=03a1550f-cd46-4989-b032-b80714da45af)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:45:33 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-d81163af-9826-4913-9917-4ad66f22e5c3 tempest-GroupsTest-70886851 None] Creating volume 76199100-1286-45ef-b06d-9c64138abed1 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:45:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-d81163af-9826-4913-9917-4ad66f22e5c3 tempest-GroupsTest-70886851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:45:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-d81163af-9826-4913-9917-4ad66f22e5c3 tempest-GroupsTest-70886851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:45:33 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-d81163af-9826-4913-9917-4ad66f22e5c3 tempest-GroupsTest-70886851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:45:33 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-d81163af-9826-4913-9917-4ad66f22e5c3 tempest-GroupsTest-70886851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:45:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-d81163af-9826-4913-9917-4ad66f22e5c3 tempest-GroupsTest-70886851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:45:33 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-d81163af-9826-4913-9917-4ad66f22e5c3 tempest-GroupsTest-70886851 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:45:33 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-d81163af-9826-4913-9917-4ad66f22e5c3 tempest-GroupsTest-70886851 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:45:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d81163af-9826-4913-9917-4ad66f22e5c3 tempest-GroupsTest-70886851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-76199100-1286-45ef-b06d-9c64138abed1 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:45:33 devstack sudo[96441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-76199100-1286-45ef-b06d-9c64138abed1 1073741824 Sep 04 22:45:33 devstack sudo[96441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:45:33 devstack sudo[96441]: pam_unix(sudo:session): session closed for user root Sep 04 22:45:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d81163af-9826-4913-9917-4ad66f22e5c3 tempest-GroupsTest-70886851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-76199100-1286-45ef-b06d-9c64138abed1 1073741824" returned: 0 in 0.479s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:45:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d81163af-9826-4913-9917-4ad66f22e5c3 tempest-GroupsTest-70886851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-76199100-1286-45ef-b06d-9c64138abed1 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:45:33 devstack sudo[96447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-76199100-1286-45ef-b06d-9c64138abed1 Sep 04 22:45:33 devstack sudo[96447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:45:34 devstack sudo[96447]: pam_unix(sudo:session): session closed for user root Sep 04 22:45:34 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d81163af-9826-4913-9917-4ad66f22e5c3 tempest-GroupsTest-70886851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-76199100-1286-45ef-b06d-9c64138abed1" returned: 0 in 0.279s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:45:34 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-d81163af-9826-4913-9917-4ad66f22e5c3 tempest-GroupsTest-70886851 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:45:34 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-d81163af-9826-4913-9917-4ad66f22e5c3 tempest-GroupsTest-70886851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:45:34 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d81163af-9826-4913-9917-4ad66f22e5c3 tempest-GroupsTest-70886851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9148c097-6570-40ad-87a1-7ab2a2713c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76199100-1286-45ef-b06d-9c64138abed1', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:45:34 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d81163af-9826-4913-9917-4ad66f22e5c3 tempest-GroupsTest-70886851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1846d149-4432-49c3-b261-76191fc28b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:45:34 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-d81163af-9826-4913-9917-4ad66f22e5c3 tempest-GroupsTest-70886851 None] Volume volume-76199100-1286-45ef-b06d-9c64138abed1 (76199100-1286-45ef-b06d-9c64138abed1): created successfully Sep 04 22:45:34 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d81163af-9826-4913-9917-4ad66f22e5c3 tempest-GroupsTest-70886851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1846d149-4432-49c3-b261-76191fc28b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:45:34 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d81163af-9826-4913-9917-4ad66f22e5c3 tempest-GroupsTest-70886851 None] Flow 'volume_create_manager' (0a651ece-1834-4d4b-89f0-ad928ad875ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:45:34 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-d81163af-9826-4913-9917-4ad66f22e5c3 tempest-GroupsTest-70886851 None] Created volume successfully. Sep 04 22:45:34 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-f6b22c04-9e11-4bc8-ac6a-7c1aaa1b5826 tempest-GroupsTest-70886851 None] Update group completed successfully. Sep 04 22:45:36 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-7110c6d0-6a88-4112-b276-5c69c61cb1ee tempest-GroupsTest-70886851 None] Update group completed successfully. Sep 04 22:45:37 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-cd47b615-9f23-42f7-b7da-b169e4770776 tempest-GroupsTest-70886851 None] Acquiring lock "cinder-quobyte-76199100-1286-45ef-b06d-9c64138abed1" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:45:37 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-cd47b615-9f23-42f7-b7da-b169e4770776 tempest-GroupsTest-70886851 None] Lock "cinder-quobyte-76199100-1286-45ef-b06d-9c64138abed1" acquired by "delete_volume" :: waited 0.030s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:45:37 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7eaf865-2b0e-4989-9491-46a46839f38a]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:45:37 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-cd47b615-9f23-42f7-b7da-b169e4770776 tempest-GroupsTest-70886851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-76199100-1286-45ef-b06d-9c64138abed1 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:45:37 devstack sudo[96466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-76199100-1286-45ef-b06d-9c64138abed1 Sep 04 22:45:37 devstack sudo[96466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:45:38 devstack sudo[96466]: pam_unix(sudo:session): session closed for user root Sep 04 22:45:38 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-cd47b615-9f23-42f7-b7da-b169e4770776 tempest-GroupsTest-70886851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-76199100-1286-45ef-b06d-9c64138abed1" returned: 0 in 0.499s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:45:38 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-cd47b615-9f23-42f7-b7da-b169e4770776 tempest-GroupsTest-70886851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-76199100-1286-45ef-b06d-9c64138abed1 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:45:38 devstack sudo[96472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-76199100-1286-45ef-b06d-9c64138abed1 Sep 04 22:45:38 devstack sudo[96472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:45:38 devstack sudo[96472]: pam_unix(sudo:session): session closed for user root Sep 04 22:45:38 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-cd47b615-9f23-42f7-b7da-b169e4770776 tempest-GroupsTest-70886851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-76199100-1286-45ef-b06d-9c64138abed1" returned: 0 in 0.269s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:45:38 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-cd47b615-9f23-42f7-b7da-b169e4770776 tempest-GroupsTest-70886851 None] Lock "cinder-quobyte-76199100-1286-45ef-b06d-9c64138abed1" released by "delete_volume" :: held 0.838s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:45:38 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-cd47b615-9f23-42f7-b7da-b169e4770776 tempest-GroupsTest-70886851 None] Acquiring lock "cinder-quobyte-fb4a6471-0b6f-4d69-850a-34f462c663d5" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:45:38 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-cd47b615-9f23-42f7-b7da-b169e4770776 tempest-GroupsTest-70886851 None] Lock "cinder-quobyte-fb4a6471-0b6f-4d69-850a-34f462c663d5" acquired by "delete_volume" :: waited 0.016s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:45:38 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e1cc08-c57b-41fd-b3fb-900c598a2658]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:45:38 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-cd47b615-9f23-42f7-b7da-b169e4770776 tempest-GroupsTest-70886851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fb4a6471-0b6f-4d69-850a-34f462c663d5 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:45:38 devstack sudo[96475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fb4a6471-0b6f-4d69-850a-34f462c663d5 Sep 04 22:45:38 devstack sudo[96475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:45:39 devstack sudo[96475]: pam_unix(sudo:session): session closed for user root Sep 04 22:45:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-cd47b615-9f23-42f7-b7da-b169e4770776 tempest-GroupsTest-70886851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fb4a6471-0b6f-4d69-850a-34f462c663d5" returned: 0 in 0.387s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:45:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-cd47b615-9f23-42f7-b7da-b169e4770776 tempest-GroupsTest-70886851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fb4a6471-0b6f-4d69-850a-34f462c663d5 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:45:39 devstack sudo[96480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fb4a6471-0b6f-4d69-850a-34f462c663d5 Sep 04 22:45:39 devstack sudo[96480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:45:39 devstack sudo[96480]: pam_unix(sudo:session): session closed for user root Sep 04 22:45:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-cd47b615-9f23-42f7-b7da-b169e4770776 tempest-GroupsTest-70886851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fb4a6471-0b6f-4d69-850a-34f462c663d5" returned: 0 in 0.260s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:45:39 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-cd47b615-9f23-42f7-b7da-b169e4770776 tempest-GroupsTest-70886851 None] Lock "cinder-quobyte-fb4a6471-0b6f-4d69-850a-34f462c663d5" released by "delete_volume" :: held 0.691s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:45:39 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-cd47b615-9f23-42f7-b7da-b169e4770776 tempest-GroupsTest-70886851 None] Created reservations ['621208a3-00ec-47bb-bb56-bad08bd24276'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:45:39 devstack cinder-volume[87576]: WARNING cinder.quota [None req-cd47b615-9f23-42f7-b7da-b169e4770776 tempest-GroupsTest-70886851 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1737585173 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1737585173, it is now deprecated. Please use the default quota class for default quota. Sep 04 22:45:39 devstack cinder-volume[87576]: WARNING cinder.quota [None req-cd47b615-9f23-42f7-b7da-b169e4770776 tempest-GroupsTest-70886851 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1737585173 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1737585173, it is now deprecated. Please use the default quota class for default quota. Sep 04 22:45:39 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-cd47b615-9f23-42f7-b7da-b169e4770776 tempest-GroupsTest-70886851 None] Created reservations ['f4ced7a2-687e-4259-9d78-9531ed6ffb2e', 'd652e9ae-dda7-4847-bd88-d669dc3967ae', 'a226858d-9671-4a87-a4da-ae71ae5eaa56', '3fe8fc6a-be97-41ec-988d-054ab49d5a7d'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:45:39 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-cd47b615-9f23-42f7-b7da-b169e4770776 tempest-GroupsTest-70886851 None] Created reservations ['1735795a-3859-4f13-afc0-a52acd2f32ff', 'de6be194-1c06-423a-af2d-fb0e31aefcf4', '37d054a9-d350-4398-8a91-a12035313025', 'a3754bb1-f5c0-4872-9f5c-78158782e355'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:45:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-cd47b615-9f23-42f7-b7da-b169e4770776 tempest-GroupsTest-70886851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:45:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-cd47b615-9f23-42f7-b7da-b169e4770776 tempest-GroupsTest-70886851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:45:39 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-cd47b615-9f23-42f7-b7da-b169e4770776 tempest-GroupsTest-70886851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:45:39 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-cd47b615-9f23-42f7-b7da-b169e4770776 tempest-GroupsTest-70886851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:45:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-cd47b615-9f23-42f7-b7da-b169e4770776 tempest-GroupsTest-70886851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:45:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-cd47b615-9f23-42f7-b7da-b169e4770776 tempest-GroupsTest-70886851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:45:39 devstack sudo[96483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:45:39 devstack sudo[96483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:45:39 devstack sudo[96483]: pam_unix(sudo:session): session closed for user root Sep 04 22:45:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-cd47b615-9f23-42f7-b7da-b169e4770776 tempest-GroupsTest-70886851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.258s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:45:39 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-cd47b615-9f23-42f7-b7da-b169e4770776 tempest-GroupsTest-70886851 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:45:39 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-cd47b615-9f23-42f7-b7da-b169e4770776 tempest-GroupsTest-70886851 None] Delete group completed successfully. Sep 04 22:45:41 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-df8a2d54-4fee-49dd-b764-e3e798ad9254 tempest-TestServerVolumeAttachScenarioOldVersion-1538697505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:45:41 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-df8a2d54-4fee-49dd-b764-e3e798ad9254 tempest-TestServerVolumeAttachScenarioOldVersion-1538697505 None] Flow 'volume_create_manager' (c73351c1-0f06-4fc4-a99f-5aef924aefe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:45:41 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-df8a2d54-4fee-49dd-b764-e3e798ad9254 tempest-TestServerVolumeAttachScenarioOldVersion-1538697505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fb95bf9-52f6-4732-a5a7-09408663efae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:45:42 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-df8a2d54-4fee-49dd-b764-e3e798ad9254 tempest-TestServerVolumeAttachScenarioOldVersion-1538697505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fb95bf9-52f6-4732-a5a7-09408663efae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:45:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2108409615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4670275f-b80f-4f48-91f7-a40a037f955c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85d40eff742e401a87b455f92e1897e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:45:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:45:42Z,use_quota=True,user_id='a9fd7147d3f145fbbf98216395ea0c1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:45:42 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-df8a2d54-4fee-49dd-b764-e3e798ad9254 tempest-TestServerVolumeAttachScenarioOldVersion-1538697505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a58d98d8-8814-47f7-901b-16360bcf0d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:45:42 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-df8a2d54-4fee-49dd-b764-e3e798ad9254 tempest-TestServerVolumeAttachScenarioOldVersion-1538697505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a58d98d8-8814-47f7-901b-16360bcf0d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:45:42 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-df8a2d54-4fee-49dd-b764-e3e798ad9254 tempest-TestServerVolumeAttachScenarioOldVersion-1538697505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7ae52f6-2b4d-4ca0-be4e-df51589e9069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:45:42 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-df8a2d54-4fee-49dd-b764-e3e798ad9254 tempest-TestServerVolumeAttachScenarioOldVersion-1538697505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7ae52f6-2b4d-4ca0-be4e-df51589e9069) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4670275f-b80f-4f48-91f7-a40a037f955c', 'volume_name': 'volume-4670275f-b80f-4f48-91f7-a40a037f955c', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:45:42 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-df8a2d54-4fee-49dd-b764-e3e798ad9254 tempest-TestServerVolumeAttachScenarioOldVersion-1538697505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9bc004d-de17-4fe3-abde-bfaf06404a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:45:42 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-df8a2d54-4fee-49dd-b764-e3e798ad9254 tempest-TestServerVolumeAttachScenarioOldVersion-1538697505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9bc004d-de17-4fe3-abde-bfaf06404a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:45:42 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-df8a2d54-4fee-49dd-b764-e3e798ad9254 tempest-TestServerVolumeAttachScenarioOldVersion-1538697505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (598b0200-facb-4861-b6d3-261a399608f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:45:42 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-df8a2d54-4fee-49dd-b764-e3e798ad9254 tempest-TestServerVolumeAttachScenarioOldVersion-1538697505 None] Volume 4670275f-b80f-4f48-91f7-a40a037f955c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4670275f-b80f-4f48-91f7-a40a037f955c', 'volume_size': 1} Sep 04 22:45:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-df8a2d54-4fee-49dd-b764-e3e798ad9254 tempest-TestServerVolumeAttachScenarioOldVersion-1538697505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:45:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-df8a2d54-4fee-49dd-b764-e3e798ad9254 tempest-TestServerVolumeAttachScenarioOldVersion-1538697505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:45:42 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-df8a2d54-4fee-49dd-b764-e3e798ad9254 tempest-TestServerVolumeAttachScenarioOldVersion-1538697505 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:45:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2108409615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4670275f-b80f-4f48-91f7-a40a037f955c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85d40eff742e401a87b455f92e1897e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:45:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:45:42Z,use_quota=True,user_id='a9fd7147d3f145fbbf98216395ea0c1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:45:42 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-df8a2d54-4fee-49dd-b764-e3e798ad9254 tempest-TestServerVolumeAttachScenarioOldVersion-1538697505 None] Creating volume 4670275f-b80f-4f48-91f7-a40a037f955c {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:45:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-df8a2d54-4fee-49dd-b764-e3e798ad9254 tempest-TestServerVolumeAttachScenarioOldVersion-1538697505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:45:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-df8a2d54-4fee-49dd-b764-e3e798ad9254 tempest-TestServerVolumeAttachScenarioOldVersion-1538697505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:45:42 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-df8a2d54-4fee-49dd-b764-e3e798ad9254 tempest-TestServerVolumeAttachScenarioOldVersion-1538697505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:45:42 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-df8a2d54-4fee-49dd-b764-e3e798ad9254 tempest-TestServerVolumeAttachScenarioOldVersion-1538697505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:45:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-df8a2d54-4fee-49dd-b764-e3e798ad9254 tempest-TestServerVolumeAttachScenarioOldVersion-1538697505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:45:42 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-df8a2d54-4fee-49dd-b764-e3e798ad9254 tempest-TestServerVolumeAttachScenarioOldVersion-1538697505 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:45:42 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-df8a2d54-4fee-49dd-b764-e3e798ad9254 tempest-TestServerVolumeAttachScenarioOldVersion-1538697505 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:45:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-df8a2d54-4fee-49dd-b764-e3e798ad9254 tempest-TestServerVolumeAttachScenarioOldVersion-1538697505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4670275f-b80f-4f48-91f7-a40a037f955c 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:45:42 devstack sudo[96488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4670275f-b80f-4f48-91f7-a40a037f955c 1073741824 Sep 04 22:45:42 devstack sudo[96488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:45:42 devstack sudo[96488]: pam_unix(sudo:session): session closed for user root Sep 04 22:45:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-df8a2d54-4fee-49dd-b764-e3e798ad9254 tempest-TestServerVolumeAttachScenarioOldVersion-1538697505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4670275f-b80f-4f48-91f7-a40a037f955c 1073741824" returned: 0 in 0.496s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:45:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-df8a2d54-4fee-49dd-b764-e3e798ad9254 tempest-TestServerVolumeAttachScenarioOldVersion-1538697505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4670275f-b80f-4f48-91f7-a40a037f955c {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:45:42 devstack sudo[96495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4670275f-b80f-4f48-91f7-a40a037f955c Sep 04 22:45:42 devstack sudo[96495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:45:42 devstack sudo[96495]: pam_unix(sudo:session): session closed for user root Sep 04 22:45:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-df8a2d54-4fee-49dd-b764-e3e798ad9254 tempest-TestServerVolumeAttachScenarioOldVersion-1538697505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4670275f-b80f-4f48-91f7-a40a037f955c" returned: 0 in 0.277s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:45:42 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-df8a2d54-4fee-49dd-b764-e3e798ad9254 tempest-TestServerVolumeAttachScenarioOldVersion-1538697505 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:45:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-df8a2d54-4fee-49dd-b764-e3e798ad9254 tempest-TestServerVolumeAttachScenarioOldVersion-1538697505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:45:42 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-df8a2d54-4fee-49dd-b764-e3e798ad9254 tempest-TestServerVolumeAttachScenarioOldVersion-1538697505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (598b0200-facb-4861-b6d3-261a399608f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4670275f-b80f-4f48-91f7-a40a037f955c', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:45:42 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-df8a2d54-4fee-49dd-b764-e3e798ad9254 tempest-TestServerVolumeAttachScenarioOldVersion-1538697505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (980060e2-665c-4b7c-ba2d-c10d298f7d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:45:42 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-df8a2d54-4fee-49dd-b764-e3e798ad9254 tempest-TestServerVolumeAttachScenarioOldVersion-1538697505 None] Volume volume-4670275f-b80f-4f48-91f7-a40a037f955c (4670275f-b80f-4f48-91f7-a40a037f955c): created successfully Sep 04 22:45:42 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-df8a2d54-4fee-49dd-b764-e3e798ad9254 tempest-TestServerVolumeAttachScenarioOldVersion-1538697505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (980060e2-665c-4b7c-ba2d-c10d298f7d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:45:42 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-df8a2d54-4fee-49dd-b764-e3e798ad9254 tempest-TestServerVolumeAttachScenarioOldVersion-1538697505 None] Flow 'volume_create_manager' (c73351c1-0f06-4fc4-a99f-5aef924aefe4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:45:42 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-df8a2d54-4fee-49dd-b764-e3e798ad9254 tempest-TestServerVolumeAttachScenarioOldVersion-1538697505 None] Created volume successfully. Sep 04 22:45:44 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-6b998053-df57-4dc4-8dce-36228dc2112a req-d1b44160-3577-49a6-a536-9c36c5a176ea tempest-TestServerVolumeAttachScenarioOldVersion-1538697505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:45:44 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-6b998053-df57-4dc4-8dce-36228dc2112a req-d1b44160-3577-49a6-a536-9c36c5a176ea tempest-TestServerVolumeAttachScenarioOldVersion-1538697505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:45:44 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-6b998053-df57-4dc4-8dce-36228dc2112a req-d1b44160-3577-49a6-a536-9c36c5a176ea tempest-TestServerVolumeAttachScenarioOldVersion-1538697505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:45:44 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-6b998053-df57-4dc4-8dce-36228dc2112a req-d1b44160-3577-49a6-a536-9c36c5a176ea tempest-TestServerVolumeAttachScenarioOldVersion-1538697505 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4', 'name': 'volume-4670275f-b80f-4f48-91f7-a40a037f955c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f7e293ab-9bcd-46a8-9dcf-b4295ea24068', 'enforce_multipath': True} {{(pid=87576) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 22:45:44 devstack cinder-volume[87576]: INFO cinder.volume.manager [req-6b998053-df57-4dc4-8dce-36228dc2112a req-d1b44160-3577-49a6-a536-9c36c5a176ea tempest-TestServerVolumeAttachScenarioOldVersion-1538697505 None] attachment_update completed successfully. Sep 04 22:45:45 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-991b4db3-0544-4d8a-88bf-e54dc1ffa8d3 tempest-GroupsV314Test-1215654611 None] Group tempest-GroupsV314Test-Group-1008961355: creating Sep 04 22:45:45 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-991b4db3-0544-4d8a-88bf-e54dc1ffa8d3 tempest-GroupsV314Test-1215654611 None] Group tempest-GroupsV314Test-Group-1008961355: created successfully Sep 04 22:45:45 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-991b4db3-0544-4d8a-88bf-e54dc1ffa8d3 tempest-GroupsV314Test-1215654611 None] Create group completed successfully. Sep 04 22:45:47 devstack cinder-volume[87576]: INFO cinder.volume.manager [req-3f86f96e-ce79-4d53-9109-dd7edfc67345 req-dac391ab-45c7-462b-abe3-0f31b6a52f35 tempest-AttachVolumeTestJSON-1147748540 None] Terminate volume connection completed successfully. Sep 04 22:45:47 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-3f86f96e-ce79-4d53-9109-dd7edfc67345 req-dac391ab-45c7-462b-abe3-0f31b6a52f35 tempest-AttachVolumeTestJSON-1147748540 None] Deleting attachment b6df8ed8-6a09-47fa-b120-c6b85c555b2d. {{(pid=87576) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 22:45:47 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-55d453d5-6245-4473-b960-fe839b3348b4 tempest-GroupsV314Test-1215654611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:45:47 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-55d453d5-6245-4473-b960-fe839b3348b4 tempest-GroupsV314Test-1215654611 None] Flow 'volume_create_manager' (1a26f4c3-1283-48dc-a061-f2b6c0bc2956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:45:47 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-55d453d5-6245-4473-b960-fe839b3348b4 tempest-GroupsV314Test-1215654611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09cf215f-a26a-4e49-92d0-dfe781109d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:45:47 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-55d453d5-6245-4473-b960-fe839b3348b4 tempest-GroupsV314Test-1215654611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09cf215f-a26a-4e49-92d0-dfe781109d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:45:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1207835923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dc21c335-2d65-4681-8b7a-2255f933922d,host='devstack@QuobyteHD#QuobyteHD',id=01825017-2407-4b36-a2bb-21072131d3da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53192e2418454aa49371228701ec5eec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:45:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:45:48Z,use_quota=True,user_id='b22bd9d7311543b18782d3214d97eceb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe28fec0-5162-40d7-abfa-d3c5fc29600e),volume_type_id=fe28fec0-5162-40d7-abfa-d3c5fc29600e)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:45:47 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-55d453d5-6245-4473-b960-fe839b3348b4 tempest-GroupsV314Test-1215654611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50c93b50-e9c3-45dd-9daf-2923df85f950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:45:47 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-55d453d5-6245-4473-b960-fe839b3348b4 tempest-GroupsV314Test-1215654611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50c93b50-e9c3-45dd-9daf-2923df85f950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:45:47 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-55d453d5-6245-4473-b960-fe839b3348b4 tempest-GroupsV314Test-1215654611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dcdf6ef-b2bc-4edb-a38e-e9fd689ae8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:45:47 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-55d453d5-6245-4473-b960-fe839b3348b4 tempest-GroupsV314Test-1215654611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dcdf6ef-b2bc-4edb-a38e-e9fd689ae8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01825017-2407-4b36-a2bb-21072131d3da', 'volume_name': 'volume-01825017-2407-4b36-a2bb-21072131d3da', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:45:47 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-55d453d5-6245-4473-b960-fe839b3348b4 tempest-GroupsV314Test-1215654611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8ffda55-f708-4777-9dce-c12c31a61e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:45:47 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-55d453d5-6245-4473-b960-fe839b3348b4 tempest-GroupsV314Test-1215654611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8ffda55-f708-4777-9dce-c12c31a61e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:45:47 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-55d453d5-6245-4473-b960-fe839b3348b4 tempest-GroupsV314Test-1215654611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e5e10c6-c48e-4ec7-ab55-6441c6037611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:45:47 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-55d453d5-6245-4473-b960-fe839b3348b4 tempest-GroupsV314Test-1215654611 None] Volume 01825017-2407-4b36-a2bb-21072131d3da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01825017-2407-4b36-a2bb-21072131d3da', 'volume_size': 1} Sep 04 22:45:47 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-55d453d5-6245-4473-b960-fe839b3348b4 tempest-GroupsV314Test-1215654611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:45:47 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-55d453d5-6245-4473-b960-fe839b3348b4 tempest-GroupsV314Test-1215654611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:45:47 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-55d453d5-6245-4473-b960-fe839b3348b4 tempest-GroupsV314Test-1215654611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=dc21c335-2d65-4681-8b7a-2255f933922d,created_at=2026-09-04T20:45:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1207835923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dc21c335-2d65-4681-8b7a-2255f933922d,host='devstack@QuobyteHD#QuobyteHD',id=01825017-2407-4b36-a2bb-21072131d3da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53192e2418454aa49371228701ec5eec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:45:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:45:48Z,use_quota=True,user_id='b22bd9d7311543b18782d3214d97eceb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe28fec0-5162-40d7-abfa-d3c5fc29600e),volume_type_id=fe28fec0-5162-40d7-abfa-d3c5fc29600e)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:45:47 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-55d453d5-6245-4473-b960-fe839b3348b4 tempest-GroupsV314Test-1215654611 None] Creating volume 01825017-2407-4b36-a2bb-21072131d3da {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:45:47 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-55d453d5-6245-4473-b960-fe839b3348b4 tempest-GroupsV314Test-1215654611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:45:47 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-55d453d5-6245-4473-b960-fe839b3348b4 tempest-GroupsV314Test-1215654611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:45:47 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-55d453d5-6245-4473-b960-fe839b3348b4 tempest-GroupsV314Test-1215654611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:45:47 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-55d453d5-6245-4473-b960-fe839b3348b4 tempest-GroupsV314Test-1215654611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:45:47 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-55d453d5-6245-4473-b960-fe839b3348b4 tempest-GroupsV314Test-1215654611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:45:47 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-55d453d5-6245-4473-b960-fe839b3348b4 tempest-GroupsV314Test-1215654611 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:45:47 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-55d453d5-6245-4473-b960-fe839b3348b4 tempest-GroupsV314Test-1215654611 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:45:47 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-55d453d5-6245-4473-b960-fe839b3348b4 tempest-GroupsV314Test-1215654611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-01825017-2407-4b36-a2bb-21072131d3da 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:45:47 devstack cinder-volume[87576]: INFO cinder.volume.manager [req-8a9d8676-c9a8-445b-91e9-440f1d1576fe req-9f7140be-a0a2-4f43-8596-1da2d4918472 tempest-TestServerVolumeAttachScenarioOldVersion-1538697505 None] Terminate volume connection completed successfully. Sep 04 22:45:47 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-8a9d8676-c9a8-445b-91e9-440f1d1576fe req-9f7140be-a0a2-4f43-8596-1da2d4918472 tempest-TestServerVolumeAttachScenarioOldVersion-1538697505 None] Deleting attachment f7e293ab-9bcd-46a8-9dcf-b4295ea24068. {{(pid=87576) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 22:45:47 devstack sudo[96533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-01825017-2407-4b36-a2bb-21072131d3da 1073741824 Sep 04 22:45:47 devstack sudo[96533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:45:48 devstack sudo[96533]: pam_unix(sudo:session): session closed for user root Sep 04 22:45:48 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-55d453d5-6245-4473-b960-fe839b3348b4 tempest-GroupsV314Test-1215654611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-01825017-2407-4b36-a2bb-21072131d3da 1073741824" returned: 0 in 0.552s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:45:48 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-55d453d5-6245-4473-b960-fe839b3348b4 tempest-GroupsV314Test-1215654611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-01825017-2407-4b36-a2bb-21072131d3da {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:45:48 devstack sudo[96540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-01825017-2407-4b36-a2bb-21072131d3da Sep 04 22:45:48 devstack sudo[96540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:45:48 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-58001f42-9494-4d81-ac6d-6db2ab643839 tempest-TestServerVolumeAttachScenarioOldVersion-1538697505 None] Acquiring lock "cinder-4670275f-b80f-4f48-91f7-a40a037f955c-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:45:48 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-58001f42-9494-4d81-ac6d-6db2ab643839 tempest-TestServerVolumeAttachScenarioOldVersion-1538697505 None] Lock "cinder-4670275f-b80f-4f48-91f7-a40a037f955c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:45:48 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-58001f42-9494-4d81-ac6d-6db2ab643839 tempest-TestServerVolumeAttachScenarioOldVersion-1538697505 None] Acquiring lock "cinder-quobyte-4670275f-b80f-4f48-91f7-a40a037f955c" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:45:48 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-58001f42-9494-4d81-ac6d-6db2ab643839 tempest-TestServerVolumeAttachScenarioOldVersion-1538697505 None] Lock "cinder-quobyte-4670275f-b80f-4f48-91f7-a40a037f955c" acquired by "delete_volume" :: waited 0.018s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:45:48 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[a032a835-eb5c-4469-80af-e92d09351f93]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:45:48 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-58001f42-9494-4d81-ac6d-6db2ab643839 tempest-TestServerVolumeAttachScenarioOldVersion-1538697505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4670275f-b80f-4f48-91f7-a40a037f955c {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:45:48 devstack sudo[96540]: pam_unix(sudo:session): session closed for user root Sep 04 22:45:48 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-55d453d5-6245-4473-b960-fe839b3348b4 tempest-GroupsV314Test-1215654611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-01825017-2407-4b36-a2bb-21072131d3da" returned: 0 in 0.321s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:45:48 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-55d453d5-6245-4473-b960-fe839b3348b4 tempest-GroupsV314Test-1215654611 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:45:48 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-55d453d5-6245-4473-b960-fe839b3348b4 tempest-GroupsV314Test-1215654611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:45:48 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-55d453d5-6245-4473-b960-fe839b3348b4 tempest-GroupsV314Test-1215654611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e5e10c6-c48e-4ec7-ab55-6441c6037611) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01825017-2407-4b36-a2bb-21072131d3da', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:45:48 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-55d453d5-6245-4473-b960-fe839b3348b4 tempest-GroupsV314Test-1215654611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6be80ab-1164-40ca-a92a-b9fb5f708b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:45:48 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-55d453d5-6245-4473-b960-fe839b3348b4 tempest-GroupsV314Test-1215654611 None] Volume volume-01825017-2407-4b36-a2bb-21072131d3da (01825017-2407-4b36-a2bb-21072131d3da): created successfully Sep 04 22:45:48 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-55d453d5-6245-4473-b960-fe839b3348b4 tempest-GroupsV314Test-1215654611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6be80ab-1164-40ca-a92a-b9fb5f708b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:45:48 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-55d453d5-6245-4473-b960-fe839b3348b4 tempest-GroupsV314Test-1215654611 None] Flow 'volume_create_manager' (1a26f4c3-1283-48dc-a061-f2b6c0bc2956) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:45:48 devstack sudo[96546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4670275f-b80f-4f48-91f7-a40a037f955c Sep 04 22:45:48 devstack sudo[96546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:45:48 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-55d453d5-6245-4473-b960-fe839b3348b4 tempest-GroupsV314Test-1215654611 None] Created volume successfully. Sep 04 22:45:48 devstack sudo[96546]: pam_unix(sudo:session): session closed for user root Sep 04 22:45:48 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-58001f42-9494-4d81-ac6d-6db2ab643839 tempest-TestServerVolumeAttachScenarioOldVersion-1538697505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4670275f-b80f-4f48-91f7-a40a037f955c" returned: 0 in 0.407s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:45:48 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-58001f42-9494-4d81-ac6d-6db2ab643839 tempest-TestServerVolumeAttachScenarioOldVersion-1538697505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4670275f-b80f-4f48-91f7-a40a037f955c {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:45:49 devstack sudo[96552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4670275f-b80f-4f48-91f7-a40a037f955c Sep 04 22:45:49 devstack sudo[96552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:45:49 devstack sudo[96552]: pam_unix(sudo:session): session closed for user root Sep 04 22:45:49 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-58001f42-9494-4d81-ac6d-6db2ab643839 tempest-TestServerVolumeAttachScenarioOldVersion-1538697505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4670275f-b80f-4f48-91f7-a40a037f955c" returned: 0 in 0.246s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:45:49 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-58001f42-9494-4d81-ac6d-6db2ab643839 tempest-TestServerVolumeAttachScenarioOldVersion-1538697505 None] Lock "cinder-quobyte-4670275f-b80f-4f48-91f7-a40a037f955c" released by "delete_volume" :: held 0.712s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:45:49 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-58001f42-9494-4d81-ac6d-6db2ab643839 tempest-TestServerVolumeAttachScenarioOldVersion-1538697505 None] Created reservations ['04db5b1e-d37d-4d3c-927c-b82735240d2e', '149808b1-2ff9-43d7-9270-7922b2acac28', '67f67a34-3d7e-41d9-877d-aa25f9415c20', '67393d30-ec36-4f95-b3f4-e4fba0fbd455'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:45:49 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-58001f42-9494-4d81-ac6d-6db2ab643839 tempest-TestServerVolumeAttachScenarioOldVersion-1538697505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:45:49 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-58001f42-9494-4d81-ac6d-6db2ab643839 tempest-TestServerVolumeAttachScenarioOldVersion-1538697505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:45:49 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-58001f42-9494-4d81-ac6d-6db2ab643839 tempest-TestServerVolumeAttachScenarioOldVersion-1538697505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:45:49 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-58001f42-9494-4d81-ac6d-6db2ab643839 tempest-TestServerVolumeAttachScenarioOldVersion-1538697505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:45:49 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-58001f42-9494-4d81-ac6d-6db2ab643839 tempest-TestServerVolumeAttachScenarioOldVersion-1538697505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:45:49 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-58001f42-9494-4d81-ac6d-6db2ab643839 tempest-TestServerVolumeAttachScenarioOldVersion-1538697505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:45:49 devstack sudo[96555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:45:49 devstack sudo[96555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:45:49 devstack sudo[96555]: pam_unix(sudo:session): session closed for user root Sep 04 22:45:49 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-58001f42-9494-4d81-ac6d-6db2ab643839 tempest-TestServerVolumeAttachScenarioOldVersion-1538697505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.281s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:45:49 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-58001f42-9494-4d81-ac6d-6db2ab643839 tempest-TestServerVolumeAttachScenarioOldVersion-1538697505 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:45:49 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-58001f42-9494-4d81-ac6d-6db2ab643839 tempest-TestServerVolumeAttachScenarioOldVersion-1538697505 None] Deleted volume successfully. Sep 04 22:45:49 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-58001f42-9494-4d81-ac6d-6db2ab643839 tempest-TestServerVolumeAttachScenarioOldVersion-1538697505 None] Lock "cinder-4670275f-b80f-4f48-91f7-a40a037f955c-delete_volume" released by "delete_volume" :: held 1.206s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:45:50 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-21ea8e8b-6780-4931-99d4-4d8d8c84c863 tempest-GroupsV314Test-1215654611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:45:50 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-21ea8e8b-6780-4931-99d4-4d8d8c84c863 tempest-GroupsV314Test-1215654611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:45:50 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-21ea8e8b-6780-4931-99d4-4d8d8c84c863 tempest-GroupsV314Test-1215654611 None] Cloning volume 01825017-2407-4b36-a2bb-21072131d3da to volume 8c1c33d2-a1d7-4561-8935-594de1ab600f Sep 04 22:45:51 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-21ea8e8b-6780-4931-99d4-4d8d8c84c863 tempest-GroupsV314Test-1215654611 None] Creating offline snapshot ac55a326-ff4d-4a5f-9f4c-53ec127a2e0a of volume 01825017-2407-4b36-a2bb-21072131d3da {{(pid=87576) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 22:45:51 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ecd4ffb-e3e4-4741-a137-e0ca8e847e05]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:45:51 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-21ea8e8b-6780-4931-99d4-4d8d8c84c863 tempest-GroupsV314Test-1215654611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-01825017-2407-4b36-a2bb-21072131d3da {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:45:51 devstack sudo[96605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-01825017-2407-4b36-a2bb-21072131d3da Sep 04 22:45:51 devstack sudo[96605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:45:52 devstack sudo[96605]: pam_unix(sudo:session): session closed for user root Sep 04 22:45:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-21ea8e8b-6780-4931-99d4-4d8d8c84c863 tempest-GroupsV314Test-1215654611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-01825017-2407-4b36-a2bb-21072131d3da" returned: 0 in 0.940s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:45:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-21ea8e8b-6780-4931-99d4-4d8d8c84c863 tempest-GroupsV314Test-1215654611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-01825017-2407-4b36-a2bb-21072131d3da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-01825017-2407-4b36-a2bb-21072131d3da.ac55a326-ff4d-4a5f-9f4c-53ec127a2e0a 1G {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:45:52 devstack sudo[96628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-01825017-2407-4b36-a2bb-21072131d3da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-01825017-2407-4b36-a2bb-21072131d3da.ac55a326-ff4d-4a5f-9f4c-53ec127a2e0a 1G Sep 04 22:45:52 devstack sudo[96628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:45:52 devstack sudo[96628]: pam_unix(sudo:session): session closed for user root Sep 04 22:45:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-21ea8e8b-6780-4931-99d4-4d8d8c84c863 tempest-GroupsV314Test-1215654611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-01825017-2407-4b36-a2bb-21072131d3da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-01825017-2407-4b36-a2bb-21072131d3da.ac55a326-ff4d-4a5f-9f4c-53ec127a2e0a 1G" returned: 0 in 0.853s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:45:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-21ea8e8b-6780-4931-99d4-4d8d8c84c863 tempest-GroupsV314Test-1215654611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01825017-2407-4b36-a2bb-21072131d3da -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-01825017-2407-4b36-a2bb-21072131d3da.ac55a326-ff4d-4a5f-9f4c-53ec127a2e0a {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:45:52 devstack sudo[96649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01825017-2407-4b36-a2bb-21072131d3da -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-01825017-2407-4b36-a2bb-21072131d3da.ac55a326-ff4d-4a5f-9f4c-53ec127a2e0a Sep 04 22:45:52 devstack sudo[96649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:45:53 devstack sudo[96649]: pam_unix(sudo:session): session closed for user root Sep 04 22:45:53 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-21ea8e8b-6780-4931-99d4-4d8d8c84c863 tempest-GroupsV314Test-1215654611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01825017-2407-4b36-a2bb-21072131d3da -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-01825017-2407-4b36-a2bb-21072131d3da.ac55a326-ff4d-4a5f-9f4c-53ec127a2e0a" returned: 0 in 1.078s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:45:53 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-21ea8e8b-6780-4931-99d4-4d8d8c84c863 tempest-GroupsV314Test-1215654611 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-01825017-2407-4b36-a2bb-21072131d3da.ac55a326-ff4d-4a5f-9f4c-53ec127a2e0a is being set with open permissions: ugo+rw: NotImplementedError Sep 04 22:45:53 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-21ea8e8b-6780-4931-99d4-4d8d8c84c863 tempest-GroupsV314Test-1215654611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-01825017-2407-4b36-a2bb-21072131d3da.ac55a326-ff4d-4a5f-9f4c-53ec127a2e0a {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:45:54 devstack sudo[96709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-01825017-2407-4b36-a2bb-21072131d3da.ac55a326-ff4d-4a5f-9f4c-53ec127a2e0a Sep 04 22:45:54 devstack sudo[96709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:45:54 devstack sudo[96709]: pam_unix(sudo:session): session closed for user root Sep 04 22:45:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-21ea8e8b-6780-4931-99d4-4d8d8c84c863 tempest-GroupsV314Test-1215654611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-01825017-2407-4b36-a2bb-21072131d3da.ac55a326-ff4d-4a5f-9f4c-53ec127a2e0a" returned: 0 in 0.862s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:45:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-21ea8e8b-6780-4931-99d4-4d8d8c84c863 tempest-GroupsV314Test-1215654611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-01825017-2407-4b36-a2bb-21072131d3da.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:45:55 devstack sudo[96728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-01825017-2407-4b36-a2bb-21072131d3da.info Sep 04 22:45:55 devstack sudo[96728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:45:55 devstack sudo[96728]: pam_unix(sudo:session): session closed for user root Sep 04 22:45:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-21ea8e8b-6780-4931-99d4-4d8d8c84c863 tempest-GroupsV314Test-1215654611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-01825017-2407-4b36-a2bb-21072131d3da.info" returned: 0 in 0.543s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:45:55 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-21ea8e8b-6780-4931-99d4-4d8d8c84c863 tempest-GroupsV314Test-1215654611 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-01825017-2407-4b36-a2bb-21072131d3da.info is being set with open permissions: ugo+rw: NotImplementedError Sep 04 22:45:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-21ea8e8b-6780-4931-99d4-4d8d8c84c863 tempest-GroupsV314Test-1215654611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-01825017-2407-4b36-a2bb-21072131d3da.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:45:55 devstack sudo[96743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-01825017-2407-4b36-a2bb-21072131d3da.info Sep 04 22:45:55 devstack sudo[96743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:45:56 devstack sudo[96743]: pam_unix(sudo:session): session closed for user root Sep 04 22:45:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-21ea8e8b-6780-4931-99d4-4d8d8c84c863 tempest-GroupsV314Test-1215654611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-01825017-2407-4b36-a2bb-21072131d3da.info" returned: 0 in 0.679s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:45:56 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-21ea8e8b-6780-4931-99d4-4d8d8c84c863 tempest-GroupsV314Test-1215654611 None] Acquiring lock "cinder-quobyte-8c1c33d2-a1d7-4561-8935-594de1ab600f" by "_copy_volume_from_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:45:56 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-21ea8e8b-6780-4931-99d4-4d8d8c84c863 tempest-GroupsV314Test-1215654611 None] Lock "cinder-quobyte-8c1c33d2-a1d7-4561-8935-594de1ab600f" acquired by "_copy_volume_from_snapshot" :: waited 0.068s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:45:56 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-21ea8e8b-6780-4931-99d4-4d8d8c84c863 tempest-GroupsV314Test-1215654611 None] snapshot: ac55a326-ff4d-4a5f-9f4c-53ec127a2e0a, volume: 8c1c33d2-a1d7-4561-8935-594de1ab600f, {{(pid=87576) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 04 22:45:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-21ea8e8b-6780-4931-99d4-4d8d8c84c863 tempest-GroupsV314Test-1215654611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:45:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-21ea8e8b-6780-4931-99d4-4d8d8c84c863 tempest-GroupsV314Test-1215654611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:45:56 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-21ea8e8b-6780-4931-99d4-4d8d8c84c863 tempest-GroupsV314Test-1215654611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:45:56 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-21ea8e8b-6780-4931-99d4-4d8d8c84c863 tempest-GroupsV314Test-1215654611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:45:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-21ea8e8b-6780-4931-99d4-4d8d8c84c863 tempest-GroupsV314Test-1215654611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:45:56 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e14ed3f-87f2-4572-8308-6d027979224e]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:45:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-21ea8e8b-6780-4931-99d4-4d8d8c84c863 tempest-GroupsV314Test-1215654611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-01825017-2407-4b36-a2bb-21072131d3da.ac55a326-ff4d-4a5f-9f4c-53ec127a2e0a {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:45:56 devstack sudo[96753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-01825017-2407-4b36-a2bb-21072131d3da.ac55a326-ff4d-4a5f-9f4c-53ec127a2e0a Sep 04 22:45:56 devstack sudo[96753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:45:57 devstack sudo[96753]: pam_unix(sudo:session): session closed for user root Sep 04 22:45:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-21ea8e8b-6780-4931-99d4-4d8d8c84c863 tempest-GroupsV314Test-1215654611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-01825017-2407-4b36-a2bb-21072131d3da.ac55a326-ff4d-4a5f-9f4c-53ec127a2e0a" returned: 0 in 0.709s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:45:57 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-21ea8e8b-6780-4931-99d4-4d8d8c84c863 tempest-GroupsV314Test-1215654611 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01825017-2407-4b36-a2bb-21072131d3da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 22:45:57 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ccf9fe-90d0-446c-8b0c-adc76cac090a]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:45:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-21ea8e8b-6780-4931-99d4-4d8d8c84c863 tempest-GroupsV314Test-1215654611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-01825017-2407-4b36-a2bb-21072131d3da {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:45:57 devstack sudo[96758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-01825017-2407-4b36-a2bb-21072131d3da Sep 04 22:45:57 devstack sudo[96758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:45:57 devstack sudo[96758]: pam_unix(sudo:session): session closed for user root Sep 04 22:45:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-21ea8e8b-6780-4931-99d4-4d8d8c84c863 tempest-GroupsV314Test-1215654611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-01825017-2407-4b36-a2bb-21072131d3da" returned: 0 in 0.662s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:45:57 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-21ea8e8b-6780-4931-99d4-4d8d8c84c863 tempest-GroupsV314Test-1215654611 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-01825017-2407-4b36-a2bb-21072131d3da {{(pid=87576) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 04 22:45:57 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-21ea8e8b-6780-4931-99d4-4d8d8c84c863 tempest-GroupsV314Test-1215654611 None] Creating direct copy from snapshot {{(pid=87576) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 04 22:45:57 devstack cinder-volume[87576]: DEBUG cinder.utils [None req-21ea8e8b-6780-4931-99d4-4d8d8c84c863 tempest-GroupsV314Test-1215654611 None] Path /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-8c1c33d2-a1d7-4561-8935-594de1ab600f not found in is_blk_device check {{(pid=87576) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 04 22:45:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-21ea8e8b-6780-4931-99d4-4d8d8c84c863 tempest-GroupsV314Test-1215654611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-01825017-2407-4b36-a2bb-21072131d3da /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-8c1c33d2-a1d7-4561-8935-594de1ab600f {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:45:57 devstack sudo[96764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-01825017-2407-4b36-a2bb-21072131d3da /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-8c1c33d2-a1d7-4561-8935-594de1ab600f Sep 04 22:45:57 devstack sudo[96764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:46:04 devstack cinder-volume[87576]: DEBUG dbcounter [-] [87576] Writing DB stats cinder:SELECT=74,cinder:UPDATE=65,cinder:INSERT=12,cinder:DELETE=4 {{(pid=87576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 22:46:04 devstack cinder-volume[87576]: DEBUG dbcounter [-] [87576] Writing DB stats cinder:SELECT=75,cinder:UPDATE=70,cinder:INSERT=15,cinder:DELETE=3 {{(pid=87576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 22:46:06 devstack sudo[96764]: pam_unix(sudo:session): session closed for user root Sep 04 22:46:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-21ea8e8b-6780-4931-99d4-4d8d8c84c863 tempest-GroupsV314Test-1215654611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-01825017-2407-4b36-a2bb-21072131d3da /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-8c1c33d2-a1d7-4561-8935-594de1ab600f" returned: 0 in 8.733s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:46:06 devstack cinder-volume[87576]: DEBUG cinder.image.image_utils [None req-21ea8e8b-6780-4931-99d4-4d8d8c84c863 tempest-GroupsV314Test-1215654611 None] Image conversion details: src /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-01825017-2407-4b36-a2bb-21072131d3da, size 1024.00 MB, duration 8.74 sec, destination /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-8c1c33d2-a1d7-4561-8935-594de1ab600f {{(pid=87576) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 22:46:06 devstack cinder-volume[87576]: INFO cinder.image.image_utils [None req-21ea8e8b-6780-4931-99d4-4d8d8c84c863 tempest-GroupsV314Test-1215654611 None] Converted 1024.00 MB image at 117.22 MB/s Sep 04 22:46:06 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-21ea8e8b-6780-4931-99d4-4d8d8c84c863 tempest-GroupsV314Test-1215654611 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-8c1c33d2-a1d7-4561-8935-594de1ab600f is being set with open permissions: ugo+rw: NotImplementedError Sep 04 22:46:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-21ea8e8b-6780-4931-99d4-4d8d8c84c863 tempest-GroupsV314Test-1215654611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-8c1c33d2-a1d7-4561-8935-594de1ab600f {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:46:06 devstack sudo[96780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-8c1c33d2-a1d7-4561-8935-594de1ab600f Sep 04 22:46:06 devstack sudo[96780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:46:06 devstack sudo[96780]: pam_unix(sudo:session): session closed for user root Sep 04 22:46:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-21ea8e8b-6780-4931-99d4-4d8d8c84c863 tempest-GroupsV314Test-1215654611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-8c1c33d2-a1d7-4561-8935-594de1ab600f" returned: 0 in 0.296s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:46:06 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-21ea8e8b-6780-4931-99d4-4d8d8c84c863 tempest-GroupsV314Test-1215654611 None] Lock "cinder-quobyte-8c1c33d2-a1d7-4561-8935-594de1ab600f" released by "_copy_volume_from_snapshot" :: held 10.560s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:46:06 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-21ea8e8b-6780-4931-99d4-4d8d8c84c863 tempest-GroupsV314Test-1215654611 None] Acquiring lock "cinder-quobyte-ac55a326-ff4d-4a5f-9f4c-53ec127a2e0a" by "_delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:46:06 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-21ea8e8b-6780-4931-99d4-4d8d8c84c863 tempest-GroupsV314Test-1215654611 None] Lock "cinder-quobyte-ac55a326-ff4d-4a5f-9f4c-53ec127a2e0a" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:46:06 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-21ea8e8b-6780-4931-99d4-4d8d8c84c863 tempest-GroupsV314Test-1215654611 None] Deleting offline snapshot ac55a326-ff4d-4a5f-9f4c-53ec127a2e0a of volume 01825017-2407-4b36-a2bb-21072131d3da {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 22:46:06 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-21ea8e8b-6780-4931-99d4-4d8d8c84c863 tempest-GroupsV314Test-1215654611 None] snapshot_file for this snap is: volume-01825017-2407-4b36-a2bb-21072131d3da.ac55a326-ff4d-4a5f-9f4c-53ec127a2e0a {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 22:46:06 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[143d1524-1900-494f-a332-ab906b406a54]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:46:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-21ea8e8b-6780-4931-99d4-4d8d8c84c863 tempest-GroupsV314Test-1215654611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-01825017-2407-4b36-a2bb-21072131d3da.ac55a326-ff4d-4a5f-9f4c-53ec127a2e0a {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:46:07 devstack sudo[96783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-01825017-2407-4b36-a2bb-21072131d3da.ac55a326-ff4d-4a5f-9f4c-53ec127a2e0a Sep 04 22:46:07 devstack sudo[96783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:46:07 devstack sudo[96783]: pam_unix(sudo:session): session closed for user root Sep 04 22:46:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-21ea8e8b-6780-4931-99d4-4d8d8c84c863 tempest-GroupsV314Test-1215654611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-01825017-2407-4b36-a2bb-21072131d3da.ac55a326-ff4d-4a5f-9f4c-53ec127a2e0a" returned: 0 in 0.438s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:46:07 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-21ea8e8b-6780-4931-99d4-4d8d8c84c863 tempest-GroupsV314Test-1215654611 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01825017-2407-4b36-a2bb-21072131d3da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 22:46:07 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6596b9-9151-4377-9bea-7d8d1e873656]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:46:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-21ea8e8b-6780-4931-99d4-4d8d8c84c863 tempest-GroupsV314Test-1215654611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-01825017-2407-4b36-a2bb-21072131d3da {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:46:07 devstack sudo[96792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-01825017-2407-4b36-a2bb-21072131d3da Sep 04 22:46:07 devstack sudo[96792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:46:08 devstack sudo[96792]: pam_unix(sudo:session): session closed for user root Sep 04 22:46:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-21ea8e8b-6780-4931-99d4-4d8d8c84c863 tempest-GroupsV314Test-1215654611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-01825017-2407-4b36-a2bb-21072131d3da" returned: 0 in 0.767s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:46:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-21ea8e8b-6780-4931-99d4-4d8d8c84c863 tempest-GroupsV314Test-1215654611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-01825017-2407-4b36-a2bb-21072131d3da.ac55a326-ff4d-4a5f-9f4c-53ec127a2e0a {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:46:08 devstack sudo[96797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-01825017-2407-4b36-a2bb-21072131d3da.ac55a326-ff4d-4a5f-9f4c-53ec127a2e0a Sep 04 22:46:08 devstack sudo[96797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:46:08 devstack sudo[96797]: pam_unix(sudo:session): session closed for user root Sep 04 22:46:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-21ea8e8b-6780-4931-99d4-4d8d8c84c863 tempest-GroupsV314Test-1215654611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-01825017-2407-4b36-a2bb-21072131d3da.ac55a326-ff4d-4a5f-9f4c-53ec127a2e0a" returned: 0 in 0.378s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:46:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-21ea8e8b-6780-4931-99d4-4d8d8c84c863 tempest-GroupsV314Test-1215654611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-01825017-2407-4b36-a2bb-21072131d3da.ac55a326-ff4d-4a5f-9f4c-53ec127a2e0a {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:46:08 devstack sudo[96804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-01825017-2407-4b36-a2bb-21072131d3da.ac55a326-ff4d-4a5f-9f4c-53ec127a2e0a Sep 04 22:46:08 devstack sudo[96804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:46:09 devstack sudo[96804]: pam_unix(sudo:session): session closed for user root Sep 04 22:46:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-21ea8e8b-6780-4931-99d4-4d8d8c84c863 tempest-GroupsV314Test-1215654611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-01825017-2407-4b36-a2bb-21072131d3da.ac55a326-ff4d-4a5f-9f4c-53ec127a2e0a" returned: 0 in 0.430s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:46:09 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-21ea8e8b-6780-4931-99d4-4d8d8c84c863 tempest-GroupsV314Test-1215654611 None] Lock "cinder-quobyte-ac55a326-ff4d-4a5f-9f4c-53ec127a2e0a" released by "_delete_snapshot" :: held 2.115s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:46:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-21ea8e8b-6780-4931-99d4-4d8d8c84c863 tempest-GroupsV314Test-1215654611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.082s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:46:09 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-21ea8e8b-6780-4931-99d4-4d8d8c84c863 tempest-GroupsV314Test-1215654611 None] Create group from source-group-dc21c335-2d65-4681-8b7a-2255f933922d completed successfully. Sep 04 22:46:10 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-7e8222c1-4eb6-4993-8049-32bff8e23312 tempest-GroupsV314Test-1215654611 None] Acquiring lock "cinder-quobyte-8c1c33d2-a1d7-4561-8935-594de1ab600f" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:46:10 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-7e8222c1-4eb6-4993-8049-32bff8e23312 tempest-GroupsV314Test-1215654611 None] Lock "cinder-quobyte-8c1c33d2-a1d7-4561-8935-594de1ab600f" acquired by "delete_volume" :: waited 0.020s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:46:10 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61ae10d-c69d-46b1-a618-9a11c41bc981]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:46:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-7e8222c1-4eb6-4993-8049-32bff8e23312 tempest-GroupsV314Test-1215654611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-8c1c33d2-a1d7-4561-8935-594de1ab600f {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:46:10 devstack sudo[96811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-8c1c33d2-a1d7-4561-8935-594de1ab600f Sep 04 22:46:10 devstack sudo[96811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:46:11 devstack sudo[96811]: pam_unix(sudo:session): session closed for user root Sep 04 22:46:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-7e8222c1-4eb6-4993-8049-32bff8e23312 tempest-GroupsV314Test-1215654611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-8c1c33d2-a1d7-4561-8935-594de1ab600f" returned: 0 in 0.397s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:46:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-7e8222c1-4eb6-4993-8049-32bff8e23312 tempest-GroupsV314Test-1215654611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-8c1c33d2-a1d7-4561-8935-594de1ab600f {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:46:11 devstack sudo[96816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-8c1c33d2-a1d7-4561-8935-594de1ab600f Sep 04 22:46:11 devstack sudo[96816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:46:11 devstack sudo[96816]: pam_unix(sudo:session): session closed for user root Sep 04 22:46:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-7e8222c1-4eb6-4993-8049-32bff8e23312 tempest-GroupsV314Test-1215654611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-8c1c33d2-a1d7-4561-8935-594de1ab600f" returned: 0 in 0.258s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:46:11 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-7e8222c1-4eb6-4993-8049-32bff8e23312 tempest-GroupsV314Test-1215654611 None] Lock "cinder-quobyte-8c1c33d2-a1d7-4561-8935-594de1ab600f" released by "delete_volume" :: held 0.710s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:46:11 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-7e8222c1-4eb6-4993-8049-32bff8e23312 tempest-GroupsV314Test-1215654611 None] Created reservations ['d364c934-0645-41f3-9df1-285a13c16ccc'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:46:11 devstack cinder-volume[87576]: WARNING cinder.quota [None req-7e8222c1-4eb6-4993-8049-32bff8e23312 tempest-GroupsV314Test-1215654611 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1290194319 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1290194319, it is now deprecated. Please use the default quota class for default quota. Sep 04 22:46:11 devstack cinder-volume[87576]: WARNING cinder.quota [None req-7e8222c1-4eb6-4993-8049-32bff8e23312 tempest-GroupsV314Test-1215654611 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1290194319 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1290194319, it is now deprecated. Please use the default quota class for default quota. Sep 04 22:46:11 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-7e8222c1-4eb6-4993-8049-32bff8e23312 tempest-GroupsV314Test-1215654611 None] Created reservations ['bdf9eab6-317f-4e25-9a59-fc99efd82d29', '075f5ae1-7ec1-44ff-97c9-df583f80e981', 'ee50fb80-4ebb-4720-a64e-7afe56037c57', '758641a1-1bd9-4e7a-8513-465b6219d288'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:46:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-7e8222c1-4eb6-4993-8049-32bff8e23312 tempest-GroupsV314Test-1215654611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:46:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-7e8222c1-4eb6-4993-8049-32bff8e23312 tempest-GroupsV314Test-1215654611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:46:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-7e8222c1-4eb6-4993-8049-32bff8e23312 tempest-GroupsV314Test-1215654611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:46:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-7e8222c1-4eb6-4993-8049-32bff8e23312 tempest-GroupsV314Test-1215654611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:46:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-7e8222c1-4eb6-4993-8049-32bff8e23312 tempest-GroupsV314Test-1215654611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:46:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-7e8222c1-4eb6-4993-8049-32bff8e23312 tempest-GroupsV314Test-1215654611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:46:11 devstack sudo[96820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:46:11 devstack sudo[96820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:46:11 devstack sudo[96820]: pam_unix(sudo:session): session closed for user root Sep 04 22:46:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-7e8222c1-4eb6-4993-8049-32bff8e23312 tempest-GroupsV314Test-1215654611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.297s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:46:11 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-7e8222c1-4eb6-4993-8049-32bff8e23312 tempest-GroupsV314Test-1215654611 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:46:11 devstack cinder-volume[87576]: DEBUG oslo_service.periodic_task [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87576) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 22:46:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:46:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:46:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:46:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:46:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:46:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:46:11 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-7e8222c1-4eb6-4993-8049-32bff8e23312 tempest-GroupsV314Test-1215654611 None] Delete group completed successfully. Sep 04 22:46:11 devstack sudo[96823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:46:11 devstack sudo[96823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:46:12 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-dd8a525d-aebd-4eaf-9d9c-180f1d9227db tempest-GroupsV314Test-1215654611 None] Acquiring lock "cinder-quobyte-01825017-2407-4b36-a2bb-21072131d3da" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:46:12 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-dd8a525d-aebd-4eaf-9d9c-180f1d9227db tempest-GroupsV314Test-1215654611 None] Lock "cinder-quobyte-01825017-2407-4b36-a2bb-21072131d3da" acquired by "delete_volume" :: waited 0.023s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:46:12 devstack sudo[96823]: pam_unix(sudo:session): session closed for user root Sep 04 22:46:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.297s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:46:12 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:46:12 devstack cinder-volume[87576]: DEBUG oslo_service.periodic_task [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Running periodic task VolumeManager._thread_info {{(pid=87576) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 22:46:12 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] thread count: 28 {{(pid=87576) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 22:46:12 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] thread info: [<_MainThread(MainThread, started 125730416963712)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87576) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 22:46:12 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0c8e61-09a6-4fe1-a50d-2dd7eaa744d8]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:46:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-dd8a525d-aebd-4eaf-9d9c-180f1d9227db tempest-GroupsV314Test-1215654611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-01825017-2407-4b36-a2bb-21072131d3da {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:46:12 devstack sudo[96826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-01825017-2407-4b36-a2bb-21072131d3da Sep 04 22:46:12 devstack sudo[96826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:46:12 devstack sudo[96826]: pam_unix(sudo:session): session closed for user root Sep 04 22:46:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-dd8a525d-aebd-4eaf-9d9c-180f1d9227db tempest-GroupsV314Test-1215654611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-01825017-2407-4b36-a2bb-21072131d3da" returned: 0 in 0.401s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:46:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-dd8a525d-aebd-4eaf-9d9c-180f1d9227db tempest-GroupsV314Test-1215654611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-01825017-2407-4b36-a2bb-21072131d3da {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:46:12 devstack sudo[96832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-01825017-2407-4b36-a2bb-21072131d3da Sep 04 22:46:12 devstack sudo[96832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:46:12 devstack sudo[96832]: pam_unix(sudo:session): session closed for user root Sep 04 22:46:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-dd8a525d-aebd-4eaf-9d9c-180f1d9227db tempest-GroupsV314Test-1215654611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-01825017-2407-4b36-a2bb-21072131d3da" returned: 0 in 0.253s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:46:12 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-dd8a525d-aebd-4eaf-9d9c-180f1d9227db tempest-GroupsV314Test-1215654611 None] Lock "cinder-quobyte-01825017-2407-4b36-a2bb-21072131d3da" released by "delete_volume" :: held 0.732s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:46:12 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-dd8a525d-aebd-4eaf-9d9c-180f1d9227db tempest-GroupsV314Test-1215654611 None] Created reservations ['4bb5923a-e5c4-46e3-b507-25f8a1b545ad'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:46:12 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-dd8a525d-aebd-4eaf-9d9c-180f1d9227db tempest-GroupsV314Test-1215654611 None] Created reservations ['c9454a30-ee28-4eba-a9ee-8b033651e95d', 'a18431cf-13b3-4c0a-aa61-3730d235867e', '85e98199-03d2-4ad2-b2b3-6ac276634b5a', '4d36b3d4-13d1-441d-82ae-351e11cd129e'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:46:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-dd8a525d-aebd-4eaf-9d9c-180f1d9227db tempest-GroupsV314Test-1215654611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:46:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-dd8a525d-aebd-4eaf-9d9c-180f1d9227db tempest-GroupsV314Test-1215654611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:46:13 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-dd8a525d-aebd-4eaf-9d9c-180f1d9227db tempest-GroupsV314Test-1215654611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:46:13 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-dd8a525d-aebd-4eaf-9d9c-180f1d9227db tempest-GroupsV314Test-1215654611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:46:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-dd8a525d-aebd-4eaf-9d9c-180f1d9227db tempest-GroupsV314Test-1215654611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:46:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-dd8a525d-aebd-4eaf-9d9c-180f1d9227db tempest-GroupsV314Test-1215654611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:46:13 devstack sudo[96836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:46:13 devstack sudo[96836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:46:13 devstack sudo[96836]: pam_unix(sudo:session): session closed for user root Sep 04 22:46:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-dd8a525d-aebd-4eaf-9d9c-180f1d9227db tempest-GroupsV314Test-1215654611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.255s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:46:13 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-dd8a525d-aebd-4eaf-9d9c-180f1d9227db tempest-GroupsV314Test-1215654611 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:46:13 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-dd8a525d-aebd-4eaf-9d9c-180f1d9227db tempest-GroupsV314Test-1215654611 None] Delete group completed successfully. Sep 04 22:46:20 devstack cinder-volume[87576]: INFO cinder.volume.manager [req-dbb131b2-9b8d-44f6-88b1-40bccd1a10b9 req-58b55b56-bea2-4ac4-9ae6-45623e86e192 tempest-TestMinimumBasicScenario-279502674 None] Terminate volume connection completed successfully. Sep 04 22:46:20 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-dbb131b2-9b8d-44f6-88b1-40bccd1a10b9 req-58b55b56-bea2-4ac4-9ae6-45623e86e192 tempest-TestMinimumBasicScenario-279502674 None] Deleting attachment c01282ce-15ae-4ebd-bd81-46e97d50ca8a. {{(pid=87576) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 22:46:21 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-a3ed000e-ddb7-4a24-98e7-489c8b1995e8 tempest-TestMinimumBasicScenario-279502674 None] Acquiring lock "cinder-6dc54a97-3000-471d-844d-65755d28185e-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:46:21 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-a3ed000e-ddb7-4a24-98e7-489c8b1995e8 tempest-TestMinimumBasicScenario-279502674 None] Lock "cinder-6dc54a97-3000-471d-844d-65755d28185e-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:46:21 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-a3ed000e-ddb7-4a24-98e7-489c8b1995e8 tempest-TestMinimumBasicScenario-279502674 None] Acquiring lock "cinder-quobyte-6dc54a97-3000-471d-844d-65755d28185e" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:46:21 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-a3ed000e-ddb7-4a24-98e7-489c8b1995e8 tempest-TestMinimumBasicScenario-279502674 None] Lock "cinder-quobyte-6dc54a97-3000-471d-844d-65755d28185e" acquired by "delete_volume" :: waited 0.046s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:46:21 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca5ad11-e900-4189-8bbd-e0ad4c554f23]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:46:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a3ed000e-ddb7-4a24-98e7-489c8b1995e8 tempest-TestMinimumBasicScenario-279502674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6dc54a97-3000-471d-844d-65755d28185e {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:46:22 devstack sudo[96873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6dc54a97-3000-471d-844d-65755d28185e Sep 04 22:46:22 devstack sudo[96873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:46:22 devstack sudo[96873]: pam_unix(sudo:session): session closed for user root Sep 04 22:46:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a3ed000e-ddb7-4a24-98e7-489c8b1995e8 tempest-TestMinimumBasicScenario-279502674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6dc54a97-3000-471d-844d-65755d28185e" returned: 0 in 0.691s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:46:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a3ed000e-ddb7-4a24-98e7-489c8b1995e8 tempest-TestMinimumBasicScenario-279502674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6dc54a97-3000-471d-844d-65755d28185e {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:46:22 devstack sudo[96881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6dc54a97-3000-471d-844d-65755d28185e Sep 04 22:46:22 devstack sudo[96881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:46:23 devstack sudo[96881]: pam_unix(sudo:session): session closed for user root Sep 04 22:46:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a3ed000e-ddb7-4a24-98e7-489c8b1995e8 tempest-TestMinimumBasicScenario-279502674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6dc54a97-3000-471d-844d-65755d28185e" returned: 0 in 0.437s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:46:23 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-a3ed000e-ddb7-4a24-98e7-489c8b1995e8 tempest-TestMinimumBasicScenario-279502674 None] Lock "cinder-quobyte-6dc54a97-3000-471d-844d-65755d28185e" released by "delete_volume" :: held 1.225s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:46:23 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-a3ed000e-ddb7-4a24-98e7-489c8b1995e8 tempest-TestMinimumBasicScenario-279502674 None] Created reservations ['0c5334d3-dd40-426f-8bd8-e4f260411c0a', '728aaf00-f5d7-4377-8fc1-db7e08d666c1', '7234fee5-3c3e-4518-9d69-be0aa6f1231b', '9ca707c6-e22d-4e64-88e3-8a31449f7b74'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:46:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-a3ed000e-ddb7-4a24-98e7-489c8b1995e8 tempest-TestMinimumBasicScenario-279502674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:46:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-a3ed000e-ddb7-4a24-98e7-489c8b1995e8 tempest-TestMinimumBasicScenario-279502674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:46:23 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-a3ed000e-ddb7-4a24-98e7-489c8b1995e8 tempest-TestMinimumBasicScenario-279502674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:46:23 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-a3ed000e-ddb7-4a24-98e7-489c8b1995e8 tempest-TestMinimumBasicScenario-279502674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:46:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-a3ed000e-ddb7-4a24-98e7-489c8b1995e8 tempest-TestMinimumBasicScenario-279502674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:46:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a3ed000e-ddb7-4a24-98e7-489c8b1995e8 tempest-TestMinimumBasicScenario-279502674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:46:23 devstack sudo[96884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:46:23 devstack sudo[96884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:46:23 devstack sudo[96884]: pam_unix(sudo:session): session closed for user root Sep 04 22:46:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a3ed000e-ddb7-4a24-98e7-489c8b1995e8 tempest-TestMinimumBasicScenario-279502674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.392s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:46:23 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-a3ed000e-ddb7-4a24-98e7-489c8b1995e8 tempest-TestMinimumBasicScenario-279502674 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:46:23 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-a3ed000e-ddb7-4a24-98e7-489c8b1995e8 tempest-TestMinimumBasicScenario-279502674 None] Deleted volume successfully. Sep 04 22:46:23 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-a3ed000e-ddb7-4a24-98e7-489c8b1995e8 tempest-TestMinimumBasicScenario-279502674 None] Lock "cinder-6dc54a97-3000-471d-844d-65755d28185e-delete_volume" released by "delete_volume" :: held 2.027s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:46:33 devstack cinder-volume[87576]: DEBUG dbcounter [-] [87576] Writing DB stats cinder:UPDATE=35,cinder:SELECT=21,cinder:INSERT=7 {{(pid=87576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 22:46:33 devstack cinder-volume[87576]: DEBUG dbcounter [-] [87576] Writing DB stats cinder:UPDATE=30,cinder:SELECT=27,cinder:INSERT=7,cinder:DELETE=1 {{(pid=87576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 22:46:35 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-72af86a5-47cf-4863-8e4b-ab0ecdf0e57c tempest-VolumeRetypeWithoutMigrationTest-188262734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:46:35 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-72af86a5-47cf-4863-8e4b-ab0ecdf0e57c tempest-VolumeRetypeWithoutMigrationTest-188262734 None] Flow 'volume_create_manager' (273b4f48-9f10-475c-a0a8-9f64bf8f29b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:46:35 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-72af86a5-47cf-4863-8e4b-ab0ecdf0e57c tempest-VolumeRetypeWithoutMigrationTest-188262734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea3ad794-6da9-42b7-a0da-76684bb882f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:46:35 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-72af86a5-47cf-4863-8e4b-ab0ecdf0e57c tempest-VolumeRetypeWithoutMigrationTest-188262734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea3ad794-6da9-42b7-a0da-76684bb882f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:46:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-726394783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee333e16-2fc1-4895-bcc4-7146dd9ad2ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c28d322269d24efab950e610be222667',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:46:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:46:36Z,use_quota=True,user_id='cd55f82afe5c4b71ab459a2938ccf1bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cffc13f-24f1-4817-8141-fc75602c9c9a),volume_type_id=3cffc13f-24f1-4817-8141-fc75602c9c9a)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:46:35 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-72af86a5-47cf-4863-8e4b-ab0ecdf0e57c tempest-VolumeRetypeWithoutMigrationTest-188262734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edac9eb1-7027-49de-9dee-b9a6e63df5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:46:35 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-72af86a5-47cf-4863-8e4b-ab0ecdf0e57c tempest-VolumeRetypeWithoutMigrationTest-188262734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edac9eb1-7027-49de-9dee-b9a6e63df5ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:46:35 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-72af86a5-47cf-4863-8e4b-ab0ecdf0e57c tempest-VolumeRetypeWithoutMigrationTest-188262734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1dee795-b55e-4bb8-aced-ffdd7e231140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:46:35 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-72af86a5-47cf-4863-8e4b-ab0ecdf0e57c tempest-VolumeRetypeWithoutMigrationTest-188262734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1dee795-b55e-4bb8-aced-ffdd7e231140) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee333e16-2fc1-4895-bcc4-7146dd9ad2ef', 'volume_name': 'volume-ee333e16-2fc1-4895-bcc4-7146dd9ad2ef', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:46:35 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-72af86a5-47cf-4863-8e4b-ab0ecdf0e57c tempest-VolumeRetypeWithoutMigrationTest-188262734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5006e738-501a-4bcc-b442-33101b665d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:46:35 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-72af86a5-47cf-4863-8e4b-ab0ecdf0e57c tempest-VolumeRetypeWithoutMigrationTest-188262734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5006e738-501a-4bcc-b442-33101b665d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:46:35 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-72af86a5-47cf-4863-8e4b-ab0ecdf0e57c tempest-VolumeRetypeWithoutMigrationTest-188262734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29c14815-766f-44f0-8033-f16e997e65bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:46:35 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-72af86a5-47cf-4863-8e4b-ab0ecdf0e57c tempest-VolumeRetypeWithoutMigrationTest-188262734 None] Volume ee333e16-2fc1-4895-bcc4-7146dd9ad2ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee333e16-2fc1-4895-bcc4-7146dd9ad2ef', 'volume_size': 1} Sep 04 22:46:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-72af86a5-47cf-4863-8e4b-ab0ecdf0e57c tempest-VolumeRetypeWithoutMigrationTest-188262734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:46:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-72af86a5-47cf-4863-8e4b-ab0ecdf0e57c tempest-VolumeRetypeWithoutMigrationTest-188262734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:46:35 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-72af86a5-47cf-4863-8e4b-ab0ecdf0e57c tempest-VolumeRetypeWithoutMigrationTest-188262734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:46:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-726394783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee333e16-2fc1-4895-bcc4-7146dd9ad2ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c28d322269d24efab950e610be222667',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:46:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:46:36Z,use_quota=True,user_id='cd55f82afe5c4b71ab459a2938ccf1bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cffc13f-24f1-4817-8141-fc75602c9c9a),volume_type_id=3cffc13f-24f1-4817-8141-fc75602c9c9a)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:46:35 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-72af86a5-47cf-4863-8e4b-ab0ecdf0e57c tempest-VolumeRetypeWithoutMigrationTest-188262734 None] Creating volume ee333e16-2fc1-4895-bcc4-7146dd9ad2ef {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:46:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-72af86a5-47cf-4863-8e4b-ab0ecdf0e57c tempest-VolumeRetypeWithoutMigrationTest-188262734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:46:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-72af86a5-47cf-4863-8e4b-ab0ecdf0e57c tempest-VolumeRetypeWithoutMigrationTest-188262734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:46:35 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-72af86a5-47cf-4863-8e4b-ab0ecdf0e57c tempest-VolumeRetypeWithoutMigrationTest-188262734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:46:35 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-72af86a5-47cf-4863-8e4b-ab0ecdf0e57c tempest-VolumeRetypeWithoutMigrationTest-188262734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:46:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-72af86a5-47cf-4863-8e4b-ab0ecdf0e57c tempest-VolumeRetypeWithoutMigrationTest-188262734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:46:35 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-72af86a5-47cf-4863-8e4b-ab0ecdf0e57c tempest-VolumeRetypeWithoutMigrationTest-188262734 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:46:35 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-72af86a5-47cf-4863-8e4b-ab0ecdf0e57c tempest-VolumeRetypeWithoutMigrationTest-188262734 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:46:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-72af86a5-47cf-4863-8e4b-ab0ecdf0e57c tempest-VolumeRetypeWithoutMigrationTest-188262734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-ee333e16-2fc1-4895-bcc4-7146dd9ad2ef 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:46:35 devstack sudo[96951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-ee333e16-2fc1-4895-bcc4-7146dd9ad2ef 1073741824 Sep 04 22:46:35 devstack sudo[96951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:46:36 devstack sudo[96951]: pam_unix(sudo:session): session closed for user root Sep 04 22:46:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-72af86a5-47cf-4863-8e4b-ab0ecdf0e57c tempest-VolumeRetypeWithoutMigrationTest-188262734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-ee333e16-2fc1-4895-bcc4-7146dd9ad2ef 1073741824" returned: 0 in 0.510s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:46:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-72af86a5-47cf-4863-8e4b-ab0ecdf0e57c tempest-VolumeRetypeWithoutMigrationTest-188262734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-ee333e16-2fc1-4895-bcc4-7146dd9ad2ef {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:46:36 devstack sudo[96957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-ee333e16-2fc1-4895-bcc4-7146dd9ad2ef Sep 04 22:46:36 devstack sudo[96957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:46:36 devstack sudo[96957]: pam_unix(sudo:session): session closed for user root Sep 04 22:46:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-72af86a5-47cf-4863-8e4b-ab0ecdf0e57c tempest-VolumeRetypeWithoutMigrationTest-188262734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-ee333e16-2fc1-4895-bcc4-7146dd9ad2ef" returned: 0 in 0.285s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:46:36 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-72af86a5-47cf-4863-8e4b-ab0ecdf0e57c tempest-VolumeRetypeWithoutMigrationTest-188262734 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:46:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-72af86a5-47cf-4863-8e4b-ab0ecdf0e57c tempest-VolumeRetypeWithoutMigrationTest-188262734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:46:36 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-72af86a5-47cf-4863-8e4b-ab0ecdf0e57c tempest-VolumeRetypeWithoutMigrationTest-188262734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29c14815-766f-44f0-8033-f16e997e65bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee333e16-2fc1-4895-bcc4-7146dd9ad2ef', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:46:36 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-72af86a5-47cf-4863-8e4b-ab0ecdf0e57c tempest-VolumeRetypeWithoutMigrationTest-188262734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b488221-f092-4a6b-8cbc-9a787556d037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:46:36 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-72af86a5-47cf-4863-8e4b-ab0ecdf0e57c tempest-VolumeRetypeWithoutMigrationTest-188262734 None] Volume volume-ee333e16-2fc1-4895-bcc4-7146dd9ad2ef (ee333e16-2fc1-4895-bcc4-7146dd9ad2ef): created successfully Sep 04 22:46:36 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-72af86a5-47cf-4863-8e4b-ab0ecdf0e57c tempest-VolumeRetypeWithoutMigrationTest-188262734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b488221-f092-4a6b-8cbc-9a787556d037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:46:36 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-72af86a5-47cf-4863-8e4b-ab0ecdf0e57c tempest-VolumeRetypeWithoutMigrationTest-188262734 None] Flow 'volume_create_manager' (273b4f48-9f10-475c-a0a8-9f64bf8f29b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:46:36 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-72af86a5-47cf-4863-8e4b-ab0ecdf0e57c tempest-VolumeRetypeWithoutMigrationTest-188262734 None] Created volume successfully. Sep 04 22:46:38 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-eb77bbcb-eb29-4a3a-b07b-45032c3d77f6 tempest-VolumeRetypeWithoutMigrationTest-188262734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:46:38 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-eb77bbcb-eb29-4a3a-b07b-45032c3d77f6 tempest-VolumeRetypeWithoutMigrationTest-188262734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:46:38 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-eb77bbcb-eb29-4a3a-b07b-45032c3d77f6 tempest-VolumeRetypeWithoutMigrationTest-188262734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:46:38 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-eb77bbcb-eb29-4a3a-b07b-45032c3d77f6 tempest-VolumeRetypeWithoutMigrationTest-188262734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:46:38 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-eb77bbcb-eb29-4a3a-b07b-45032c3d77f6 tempest-VolumeRetypeWithoutMigrationTest-188262734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:46:38 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-eb77bbcb-eb29-4a3a-b07b-45032c3d77f6 tempest-VolumeRetypeWithoutMigrationTest-188262734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:46:38 devstack sudo[96960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:46:38 devstack sudo[96960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:46:38 devstack sudo[96960]: pam_unix(sudo:session): session closed for user root Sep 04 22:46:38 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-eb77bbcb-eb29-4a3a-b07b-45032c3d77f6 tempest-VolumeRetypeWithoutMigrationTest-188262734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.287s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:46:38 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-eb77bbcb-eb29-4a3a-b07b-45032c3d77f6 tempest-VolumeRetypeWithoutMigrationTest-188262734 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:46:38 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-eb77bbcb-eb29-4a3a-b07b-45032c3d77f6 tempest-VolumeRetypeWithoutMigrationTest-188262734 None] Retype volume completed successfully. Sep 04 22:46:39 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-576f7b47-1f26-400c-865f-7ce8623de227 tempest-VolumeRetypeWithoutMigrationTest-188262734 None] Acquiring lock "cinder-ee333e16-2fc1-4895-bcc4-7146dd9ad2ef-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:46:39 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-576f7b47-1f26-400c-865f-7ce8623de227 tempest-VolumeRetypeWithoutMigrationTest-188262734 None] Lock "cinder-ee333e16-2fc1-4895-bcc4-7146dd9ad2ef-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:46:39 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-576f7b47-1f26-400c-865f-7ce8623de227 tempest-VolumeRetypeWithoutMigrationTest-188262734 None] Acquiring lock "cinder-quobyte-ee333e16-2fc1-4895-bcc4-7146dd9ad2ef" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:46:39 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-576f7b47-1f26-400c-865f-7ce8623de227 tempest-VolumeRetypeWithoutMigrationTest-188262734 None] Lock "cinder-quobyte-ee333e16-2fc1-4895-bcc4-7146dd9ad2ef" acquired by "delete_volume" :: waited 0.023s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:46:39 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a3c5a1-4d92-4db1-9e81-167bcb6a4161]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:46:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-576f7b47-1f26-400c-865f-7ce8623de227 tempest-VolumeRetypeWithoutMigrationTest-188262734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-ee333e16-2fc1-4895-bcc4-7146dd9ad2ef {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:46:39 devstack sudo[96963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-ee333e16-2fc1-4895-bcc4-7146dd9ad2ef Sep 04 22:46:39 devstack sudo[96963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:46:40 devstack sudo[96963]: pam_unix(sudo:session): session closed for user root Sep 04 22:46:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-576f7b47-1f26-400c-865f-7ce8623de227 tempest-VolumeRetypeWithoutMigrationTest-188262734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-ee333e16-2fc1-4895-bcc4-7146dd9ad2ef" returned: 0 in 0.537s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:46:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-576f7b47-1f26-400c-865f-7ce8623de227 tempest-VolumeRetypeWithoutMigrationTest-188262734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-ee333e16-2fc1-4895-bcc4-7146dd9ad2ef {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:46:40 devstack sudo[96968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-ee333e16-2fc1-4895-bcc4-7146dd9ad2ef Sep 04 22:46:40 devstack sudo[96968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:46:40 devstack sudo[96968]: pam_unix(sudo:session): session closed for user root Sep 04 22:46:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-576f7b47-1f26-400c-865f-7ce8623de227 tempest-VolumeRetypeWithoutMigrationTest-188262734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-ee333e16-2fc1-4895-bcc4-7146dd9ad2ef" returned: 0 in 0.368s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:46:40 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-576f7b47-1f26-400c-865f-7ce8623de227 tempest-VolumeRetypeWithoutMigrationTest-188262734 None] Lock "cinder-quobyte-ee333e16-2fc1-4895-bcc4-7146dd9ad2ef" released by "delete_volume" :: held 0.997s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:46:40 devstack cinder-volume[87576]: WARNING cinder.quota [None req-576f7b47-1f26-400c-865f-7ce8623de227 tempest-VolumeRetypeWithoutMigrationTest-188262734 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 04 22:46:40 devstack cinder-volume[87576]: WARNING cinder.quota [None req-576f7b47-1f26-400c-865f-7ce8623de227 tempest-VolumeRetypeWithoutMigrationTest-188262734 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 04 22:46:40 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-576f7b47-1f26-400c-865f-7ce8623de227 tempest-VolumeRetypeWithoutMigrationTest-188262734 None] Created reservations ['ae5452c3-1147-4f88-9305-6a3104309c31', '138f68d9-1ba4-4285-8b2a-331a1280326c', '3932829f-00d4-40ac-b1b1-26b97ed3e22b', 'e9315b6b-157d-45c4-ba2b-4eda2a151108'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:46:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-576f7b47-1f26-400c-865f-7ce8623de227 tempest-VolumeRetypeWithoutMigrationTest-188262734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:46:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-576f7b47-1f26-400c-865f-7ce8623de227 tempest-VolumeRetypeWithoutMigrationTest-188262734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:46:41 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-576f7b47-1f26-400c-865f-7ce8623de227 tempest-VolumeRetypeWithoutMigrationTest-188262734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:46:41 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-576f7b47-1f26-400c-865f-7ce8623de227 tempest-VolumeRetypeWithoutMigrationTest-188262734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:46:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-576f7b47-1f26-400c-865f-7ce8623de227 tempest-VolumeRetypeWithoutMigrationTest-188262734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:46:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-576f7b47-1f26-400c-865f-7ce8623de227 tempest-VolumeRetypeWithoutMigrationTest-188262734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:46:41 devstack sudo[96975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:46:41 devstack sudo[96975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:46:41 devstack sudo[96975]: pam_unix(sudo:session): session closed for user root Sep 04 22:46:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-576f7b47-1f26-400c-865f-7ce8623de227 tempest-VolumeRetypeWithoutMigrationTest-188262734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.410s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:46:41 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-576f7b47-1f26-400c-865f-7ce8623de227 tempest-VolumeRetypeWithoutMigrationTest-188262734 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:46:41 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-576f7b47-1f26-400c-865f-7ce8623de227 tempest-VolumeRetypeWithoutMigrationTest-188262734 None] Deleted volume successfully. Sep 04 22:46:41 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-576f7b47-1f26-400c-865f-7ce8623de227 tempest-VolumeRetypeWithoutMigrationTest-188262734 None] Lock "cinder-ee333e16-2fc1-4895-bcc4-7146dd9ad2ef-delete_volume" released by "delete_volume" :: held 1.842s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:46:50 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-065e4d47-65d1-401e-8c31-536f435e0066 tempest-TestShelveInstance-1943220238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:46:50 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-065e4d47-65d1-401e-8c31-536f435e0066 tempest-TestShelveInstance-1943220238 None] Flow 'volume_create_manager' (122cd392-16f0-4409-955d-bfe3804b664d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:46:50 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-065e4d47-65d1-401e-8c31-536f435e0066 tempest-TestShelveInstance-1943220238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a2babd5-d5e5-4de6-8019-31c0f10f02a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:46:50 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-065e4d47-65d1-401e-8c31-536f435e0066 tempest-TestShelveInstance-1943220238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a2babd5-d5e5-4de6-8019-31c0f10f02a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:46:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-286957923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=031d7a31-f8fa-4263-b59c-7878b17ae9ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fd95791415849fa9be33b41bdaa1158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:46:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:46:50Z,use_quota=True,user_id='e1044a8f67004b2fb6268aa20819b951',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:46:50 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-065e4d47-65d1-401e-8c31-536f435e0066 tempest-TestShelveInstance-1943220238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ea89d56-6201-40e1-9b03-36f451d5b29a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:46:50 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-065e4d47-65d1-401e-8c31-536f435e0066 tempest-TestShelveInstance-1943220238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ea89d56-6201-40e1-9b03-36f451d5b29a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:46:50 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-065e4d47-65d1-401e-8c31-536f435e0066 tempest-TestShelveInstance-1943220238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70292350-8e0c-443b-8033-1ffb249ccf26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:46:50 devstack cinder-volume[87576]: DEBUG cinder.image.glance [None req-065e4d47-65d1-401e-8c31-536f435e0066 tempest-TestShelveInstance-1943220238 None] Creating Keystone auth plugin from conf {{(pid=87576) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 04 22:46:51 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-065e4d47-65d1-401e-8c31-536f435e0066 tempest-TestShelveInstance-1943220238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70292350-8e0c-443b-8033-1ffb249ccf26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '031d7a31-f8fa-4263-b59c-7878b17ae9ca', 'volume_name': 'volume-031d7a31-f8fa-4263-b59c-7878b17ae9ca', 'volume_size': 1, 'image_id': '4f8d7a81-6282-4f52-a601-d840d8973365', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4f8d7a81-6282-4f52-a601-d840d8973365', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5d1fd1f571ef419184ac7eda6748fdd3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4f8d7a81-6282-4f52-a601-d840d8973365', 'created_at': datetime.datetime(2026, 9, 4, 20, 33, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 20, 33, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f8d7a81-6282-4f52-a601-d840d8973365/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:46:51 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-065e4d47-65d1-401e-8c31-536f435e0066 tempest-TestShelveInstance-1943220238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9e181d9-77f7-43d5-9f0c-08f786a122d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:46:51 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-065e4d47-65d1-401e-8c31-536f435e0066 tempest-TestShelveInstance-1943220238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9e181d9-77f7-43d5-9f0c-08f786a122d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:46:51 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-065e4d47-65d1-401e-8c31-536f435e0066 tempest-TestShelveInstance-1943220238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07a195b3-6a20-4c99-bff8-6cb88605cbd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:46:51 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-065e4d47-65d1-401e-8c31-536f435e0066 tempest-TestShelveInstance-1943220238 None] Volume 031d7a31-f8fa-4263-b59c-7878b17ae9ca: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-031d7a31-f8fa-4263-b59c-7878b17ae9ca', 'volume_size': 1, 'image_id': '4f8d7a81-6282-4f52-a601-d840d8973365', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4f8d7a81-6282-4f52-a601-d840d8973365', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5d1fd1f571ef419184ac7eda6748fdd3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4f8d7a81-6282-4f52-a601-d840d8973365', 'created_at': datetime.datetime(2026, 9, 4, 20, 33, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 20, 33, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f8d7a81-6282-4f52-a601-d840d8973365/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 04 22:46:51 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-065e4d47-65d1-401e-8c31-536f435e0066 tempest-TestShelveInstance-1943220238 None] Trying to clone 031d7a31-f8fa-4263-b59c-7878b17ae9ca from image 4f8d7a81-6282-4f52-a601-d840d8973365 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4f8d7a81-6282-4f52-a601-d840d8973365', 'metadata': {}}]). {{(pid=87576) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 04 22:46:52 devstack cinder-volume[87576]: DEBUG cinder.image.image_utils [None req-065e4d47-65d1-401e-8c31-536f435e0066 tempest-TestShelveInstance-1943220238 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4f8d7a81-6282-4f52-a601-d840d8973365_se933tvhdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87576) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 04 22:46:52 devstack cinder-volume[87576]: INFO cinder.image.image_utils [None req-065e4d47-65d1-401e-8c31-536f435e0066 tempest-TestShelveInstance-1943220238 None] Image download 20.69 MB at 20.69 MB/s Sep 04 22:46:52 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bfe44db-4f4e-44b4-a1a3-66099176fbfb]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:46:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-065e4d47-65d1-401e-8c31-536f435e0066 tempest-TestShelveInstance-1943220238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f8d7a81-6282-4f52-a601-d840d8973365_se933tvhdevstack@QuobyteHD {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:46:52 devstack sudo[97078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f8d7a81-6282-4f52-a601-d840d8973365_se933tvhdevstack@QuobyteHD Sep 04 22:46:52 devstack sudo[97078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:46:52 devstack sudo[97078]: pam_unix(sudo:session): session closed for user root Sep 04 22:46:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-065e4d47-65d1-401e-8c31-536f435e0066 tempest-TestShelveInstance-1943220238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f8d7a81-6282-4f52-a601-d840d8973365_se933tvhdevstack@QuobyteHD" returned: 0 in 0.625s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:46:52 devstack cinder-volume[87576]: DEBUG cinder.image.image_utils [None req-065e4d47-65d1-401e-8c31-536f435e0066 tempest-TestShelveInstance-1943220238 None] Temporary image 4f8d7a81-6282-4f52-a601-d840d8973365 is fetched for user e1044a8f67004b2fb6268aa20819b951. {{(pid=87576) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 04 22:46:53 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc071416-0a49-4244-b05f-ed53e7e3722c]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:46:53 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-065e4d47-65d1-401e-8c31-536f435e0066 tempest-TestShelveInstance-1943220238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f8d7a81-6282-4f52-a601-d840d8973365_se933tvhdevstack@QuobyteHD {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:46:53 devstack sudo[97085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f8d7a81-6282-4f52-a601-d840d8973365_se933tvhdevstack@QuobyteHD Sep 04 22:46:53 devstack sudo[97085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:46:53 devstack sudo[97085]: pam_unix(sudo:session): session closed for user root Sep 04 22:46:53 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-065e4d47-65d1-401e-8c31-536f435e0066 tempest-TestShelveInstance-1943220238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f8d7a81-6282-4f52-a601-d840d8973365_se933tvhdevstack@QuobyteHD" returned: 0 in 0.680s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:46:53 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-065e4d47-65d1-401e-8c31-536f435e0066 tempest-TestShelveInstance-1943220238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:46:53 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-065e4d47-65d1-401e-8c31-536f435e0066 tempest-TestShelveInstance-1943220238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:46:53 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-065e4d47-65d1-401e-8c31-536f435e0066 tempest-TestShelveInstance-1943220238 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:46:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-286957923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=031d7a31-f8fa-4263-b59c-7878b17ae9ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fd95791415849fa9be33b41bdaa1158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:46:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:46:50Z,use_quota=True,user_id='e1044a8f67004b2fb6268aa20819b951',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:46:53 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-065e4d47-65d1-401e-8c31-536f435e0066 tempest-TestShelveInstance-1943220238 None] Creating volume 031d7a31-f8fa-4263-b59c-7878b17ae9ca {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:46:53 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-065e4d47-65d1-401e-8c31-536f435e0066 tempest-TestShelveInstance-1943220238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:46:53 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-065e4d47-65d1-401e-8c31-536f435e0066 tempest-TestShelveInstance-1943220238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:46:53 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-065e4d47-65d1-401e-8c31-536f435e0066 tempest-TestShelveInstance-1943220238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:46:53 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-065e4d47-65d1-401e-8c31-536f435e0066 tempest-TestShelveInstance-1943220238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:46:53 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-065e4d47-65d1-401e-8c31-536f435e0066 tempest-TestShelveInstance-1943220238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:46:53 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-065e4d47-65d1-401e-8c31-536f435e0066 tempest-TestShelveInstance-1943220238 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:46:53 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-065e4d47-65d1-401e-8c31-536f435e0066 tempest-TestShelveInstance-1943220238 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:46:53 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-065e4d47-65d1-401e-8c31-536f435e0066 tempest-TestShelveInstance-1943220238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-031d7a31-f8fa-4263-b59c-7878b17ae9ca 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:46:53 devstack sudo[97092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-031d7a31-f8fa-4263-b59c-7878b17ae9ca 1073741824 Sep 04 22:46:53 devstack sudo[97092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:46:54 devstack sudo[97092]: pam_unix(sudo:session): session closed for user root Sep 04 22:46:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-065e4d47-65d1-401e-8c31-536f435e0066 tempest-TestShelveInstance-1943220238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-031d7a31-f8fa-4263-b59c-7878b17ae9ca 1073741824" returned: 0 in 0.702s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:46:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-065e4d47-65d1-401e-8c31-536f435e0066 tempest-TestShelveInstance-1943220238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-031d7a31-f8fa-4263-b59c-7878b17ae9ca {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:46:54 devstack sudo[97110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-031d7a31-f8fa-4263-b59c-7878b17ae9ca Sep 04 22:46:54 devstack sudo[97110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:46:55 devstack sudo[97110]: pam_unix(sudo:session): session closed for user root Sep 04 22:46:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-065e4d47-65d1-401e-8c31-536f435e0066 tempest-TestShelveInstance-1943220238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-031d7a31-f8fa-4263-b59c-7878b17ae9ca" returned: 0 in 0.593s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:46:55 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-065e4d47-65d1-401e-8c31-536f435e0066 tempest-TestShelveInstance-1943220238 None] <== create_volume: return (1386ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:46:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-065e4d47-65d1-401e-8c31-536f435e0066 tempest-TestShelveInstance-1943220238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.394s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:46:55 devstack cinder-volume[87576]: DEBUG cinder.volume.volume_utils [None req-065e4d47-65d1-401e-8c31-536f435e0066 tempest-TestShelveInstance-1943220238 None] Attempting download of 4f8d7a81-6282-4f52-a601-d840d8973365 ((None, [{'url': 'file:///opt/stack/data/glance/images/4f8d7a81-6282-4f52-a601-d840d8973365', 'metadata': {}}])) to volume 031d7a31-f8fa-4263-b59c-7878b17ae9ca. {{(pid=87576) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 04 22:46:55 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[b62921b8-30a6-4d91-99f6-364d12311270]: (4, 'raw') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:46:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-065e4d47-65d1-401e-8c31-536f435e0066 tempest-TestShelveInstance-1943220238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4f8d7a81-6282-4f52-a601-d840d8973365_fd_fwho1 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:46:55 devstack sudo[97114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4f8d7a81-6282-4f52-a601-d840d8973365_fd_fwho1 Sep 04 22:46:55 devstack sudo[97114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:46:55 devstack sudo[97114]: pam_unix(sudo:session): session closed for user root Sep 04 22:46:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-065e4d47-65d1-401e-8c31-536f435e0066 tempest-TestShelveInstance-1943220238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4f8d7a81-6282-4f52-a601-d840d8973365_fd_fwho1" returned: 0 in 0.483s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:46:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-065e4d47-65d1-401e-8c31-536f435e0066 tempest-TestShelveInstance-1943220238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4f8d7a81-6282-4f52-a601-d840d8973365_fd_fwho1 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:46:55 devstack sudo[97118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4f8d7a81-6282-4f52-a601-d840d8973365_fd_fwho1 Sep 04 22:46:55 devstack sudo[97118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:46:56 devstack sudo[97118]: pam_unix(sudo:session): session closed for user root Sep 04 22:46:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-065e4d47-65d1-401e-8c31-536f435e0066 tempest-TestShelveInstance-1943220238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4f8d7a81-6282-4f52-a601-d840d8973365_fd_fwho1" returned: 1 in 0.495s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:46:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-065e4d47-65d1-401e-8c31-536f435e0066 tempest-TestShelveInstance-1943220238 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4f8d7a81-6282-4f52-a601-d840d8973365_fd_fwho1' failed. Not Retrying. {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 22:46:56 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[3feeb15f-1694-440a-a03e-c72b24895458]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:46:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-065e4d47-65d1-401e-8c31-536f435e0066 tempest-TestShelveInstance-1943220238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f8d7a81-6282-4f52-a601-d840d8973365_se933tvhdevstack@QuobyteHD {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:46:56 devstack sudo[97122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f8d7a81-6282-4f52-a601-d840d8973365_se933tvhdevstack@QuobyteHD Sep 04 22:46:56 devstack sudo[97122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:46:56 devstack sudo[97122]: pam_unix(sudo:session): session closed for user root Sep 04 22:46:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-065e4d47-65d1-401e-8c31-536f435e0066 tempest-TestShelveInstance-1943220238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f8d7a81-6282-4f52-a601-d840d8973365_se933tvhdevstack@QuobyteHD" returned: 0 in 0.556s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:46:56 devstack cinder-volume[87576]: DEBUG cinder.image.image_utils [None req-065e4d47-65d1-401e-8c31-536f435e0066 tempest-TestShelveInstance-1943220238 None] 4f8d7a81-6282-4f52-a601-d840d8973365 was qcow2, converting to qcow2 {{(pid=87576) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 04 22:46:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-065e4d47-65d1-401e-8c31-536f435e0066 tempest-TestShelveInstance-1943220238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4f8d7a81-6282-4f52-a601-d840d8973365_se933tvhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-031d7a31-f8fa-4263-b59c-7878b17ae9ca {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:46:56 devstack sudo[97127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4f8d7a81-6282-4f52-a601-d840d8973365_se933tvhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-031d7a31-f8fa-4263-b59c-7878b17ae9ca Sep 04 22:46:56 devstack sudo[97127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:46:59 devstack sudo[97127]: pam_unix(sudo:session): session closed for user root Sep 04 22:46:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-065e4d47-65d1-401e-8c31-536f435e0066 tempest-TestShelveInstance-1943220238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4f8d7a81-6282-4f52-a601-d840d8973365_se933tvhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-031d7a31-f8fa-4263-b59c-7878b17ae9ca" returned: 0 in 2.593s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:46:59 devstack cinder-volume[87576]: DEBUG cinder.image.image_utils [None req-065e4d47-65d1-401e-8c31-536f435e0066 tempest-TestShelveInstance-1943220238 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4f8d7a81-6282-4f52-a601-d840d8973365_se933tvhdevstack@QuobyteHD, size 112.00 MB, duration 2.60 sec, destination /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-031d7a31-f8fa-4263-b59c-7878b17ae9ca {{(pid=87576) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 22:46:59 devstack cinder-volume[87576]: INFO cinder.image.image_utils [None req-065e4d47-65d1-401e-8c31-536f435e0066 tempest-TestShelveInstance-1943220238 None] Converted 112.00 MB image at 43.15 MB/s Sep 04 22:46:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-065e4d47-65d1-401e-8c31-536f435e0066 tempest-TestShelveInstance-1943220238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-031d7a31-f8fa-4263-b59c-7878b17ae9ca 1G {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:46:59 devstack sudo[97135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-031d7a31-f8fa-4263-b59c-7878b17ae9ca 1G Sep 04 22:46:59 devstack sudo[97135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:47:00 devstack sudo[97135]: pam_unix(sudo:session): session closed for user root Sep 04 22:47:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-065e4d47-65d1-401e-8c31-536f435e0066 tempest-TestShelveInstance-1943220238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-031d7a31-f8fa-4263-b59c-7878b17ae9ca 1G" returned: 0 in 0.608s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:47:00 devstack cinder-volume[87576]: DEBUG cinder.volume.volume_utils [None req-065e4d47-65d1-401e-8c31-536f435e0066 tempest-TestShelveInstance-1943220238 None] Downloaded image 4f8d7a81-6282-4f52-a601-d840d8973365 ((None, [{'url': 'file:///opt/stack/data/glance/images/4f8d7a81-6282-4f52-a601-d840d8973365', 'metadata': {}}])) to volume 031d7a31-f8fa-4263-b59c-7878b17ae9ca successfully. {{(pid=87576) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 04 22:47:00 devstack cinder-volume[87576]: DEBUG cinder.image.image_utils [None req-065e4d47-65d1-401e-8c31-536f435e0066 tempest-TestShelveInstance-1943220238 None] Temporary image 4f8d7a81-6282-4f52-a601-d840d8973365 for user e1044a8f67004b2fb6268aa20819b951 is deleted. {{(pid=87576) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 04 22:47:00 devstack cinder-volume[87576]: DEBUG cinder.volume.volume_utils [None req-065e4d47-65d1-401e-8c31-536f435e0066 tempest-TestShelveInstance-1943220238 None] Marking volume 031d7a31-f8fa-4263-b59c-7878b17ae9ca as bootable. {{(pid=87576) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 04 22:47:00 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-065e4d47-65d1-401e-8c31-536f435e0066 tempest-TestShelveInstance-1943220238 None] Copying metadata from image 4f8d7a81-6282-4f52-a601-d840d8973365 to 031d7a31-f8fa-4263-b59c-7878b17ae9ca. {{(pid=87576) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 04 22:47:00 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-065e4d47-65d1-401e-8c31-536f435e0066 tempest-TestShelveInstance-1943220238 None] Creating volume glance metadata for volume 031d7a31-f8fa-4263-b59c-7878b17ae9ca backed by image 4f8d7a81-6282-4f52-a601-d840d8973365 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4f8d7a81-6282-4f52-a601-d840d8973365', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87576) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 04 22:47:00 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-065e4d47-65d1-401e-8c31-536f435e0066 tempest-TestShelveInstance-1943220238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07a195b3-6a20-4c99-bff8-6cb88605cbd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-031d7a31-f8fa-4263-b59c-7878b17ae9ca', 'volume_size': 1, 'image_id': '4f8d7a81-6282-4f52-a601-d840d8973365', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4f8d7a81-6282-4f52-a601-d840d8973365', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5d1fd1f571ef419184ac7eda6748fdd3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4f8d7a81-6282-4f52-a601-d840d8973365', 'created_at': datetime.datetime(2026, 9, 4, 20, 33, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 20, 33, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f8d7a81-6282-4f52-a601-d840d8973365/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:47:00 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-065e4d47-65d1-401e-8c31-536f435e0066 tempest-TestShelveInstance-1943220238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c815b063-9933-4346-a68d-bd63c0b51451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:47:00 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-065e4d47-65d1-401e-8c31-536f435e0066 tempest-TestShelveInstance-1943220238 None] Volume volume-031d7a31-f8fa-4263-b59c-7878b17ae9ca (031d7a31-f8fa-4263-b59c-7878b17ae9ca): created successfully Sep 04 22:47:00 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-065e4d47-65d1-401e-8c31-536f435e0066 tempest-TestShelveInstance-1943220238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c815b063-9933-4346-a68d-bd63c0b51451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:47:00 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-065e4d47-65d1-401e-8c31-536f435e0066 tempest-TestShelveInstance-1943220238 None] Flow 'volume_create_manager' (122cd392-16f0-4409-955d-bfe3804b664d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:47:00 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-065e4d47-65d1-401e-8c31-536f435e0066 tempest-TestShelveInstance-1943220238 None] Created volume successfully. Sep 04 22:47:02 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-816e323e-4b50-4e78-b677-2709e09fc73b tempest-VolumesListAdminTestJSON-2100194842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:47:02 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-816e323e-4b50-4e78-b677-2709e09fc73b tempest-VolumesListAdminTestJSON-2100194842 None] Flow 'volume_create_manager' (000cfa7a-f03c-4c42-b1d0-016dc057b509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:47:02 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-816e323e-4b50-4e78-b677-2709e09fc73b tempest-VolumesListAdminTestJSON-2100194842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab36b355-51a0-4707-bc81-ce45324e8ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:47:02 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-816e323e-4b50-4e78-b677-2709e09fc73b tempest-VolumesListAdminTestJSON-2100194842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab36b355-51a0-4707-bc81-ce45324e8ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:47:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-832475259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3575d76b-b090-488f-8297-a60bd1c1c684,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62607c06378c48a39882d2fd4043dd91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:47:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:47:03Z,use_quota=True,user_id='12c1a0f66c294cc481e55388f75d4c2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:47:02 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-816e323e-4b50-4e78-b677-2709e09fc73b tempest-VolumesListAdminTestJSON-2100194842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9d91520-a083-4409-a688-4d7ab5c905fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:47:02 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-816e323e-4b50-4e78-b677-2709e09fc73b tempest-VolumesListAdminTestJSON-2100194842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9d91520-a083-4409-a688-4d7ab5c905fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:47:02 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-816e323e-4b50-4e78-b677-2709e09fc73b tempest-VolumesListAdminTestJSON-2100194842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54d8b987-fa0a-4cec-9eba-eb607cc5c552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:47:02 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-816e323e-4b50-4e78-b677-2709e09fc73b tempest-VolumesListAdminTestJSON-2100194842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54d8b987-fa0a-4cec-9eba-eb607cc5c552) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3575d76b-b090-488f-8297-a60bd1c1c684', 'volume_name': 'volume-3575d76b-b090-488f-8297-a60bd1c1c684', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:47:02 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-816e323e-4b50-4e78-b677-2709e09fc73b tempest-VolumesListAdminTestJSON-2100194842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0a6f31f-3a5e-426a-8701-2641f0035ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:47:02 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-816e323e-4b50-4e78-b677-2709e09fc73b tempest-VolumesListAdminTestJSON-2100194842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0a6f31f-3a5e-426a-8701-2641f0035ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:47:02 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-816e323e-4b50-4e78-b677-2709e09fc73b tempest-VolumesListAdminTestJSON-2100194842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01fa8288-6287-4619-beb1-3b6a7bc544a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:47:02 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-816e323e-4b50-4e78-b677-2709e09fc73b tempest-VolumesListAdminTestJSON-2100194842 None] Volume 3575d76b-b090-488f-8297-a60bd1c1c684: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3575d76b-b090-488f-8297-a60bd1c1c684', 'volume_size': 1} Sep 04 22:47:02 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-816e323e-4b50-4e78-b677-2709e09fc73b tempest-VolumesListAdminTestJSON-2100194842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:47:02 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-816e323e-4b50-4e78-b677-2709e09fc73b tempest-VolumesListAdminTestJSON-2100194842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:47:02 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-816e323e-4b50-4e78-b677-2709e09fc73b tempest-VolumesListAdminTestJSON-2100194842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:47:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-832475259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3575d76b-b090-488f-8297-a60bd1c1c684,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62607c06378c48a39882d2fd4043dd91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:47:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:47:03Z,use_quota=True,user_id='12c1a0f66c294cc481e55388f75d4c2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:47:02 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-816e323e-4b50-4e78-b677-2709e09fc73b tempest-VolumesListAdminTestJSON-2100194842 None] Creating volume 3575d76b-b090-488f-8297-a60bd1c1c684 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:47:02 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-816e323e-4b50-4e78-b677-2709e09fc73b tempest-VolumesListAdminTestJSON-2100194842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:47:02 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-816e323e-4b50-4e78-b677-2709e09fc73b tempest-VolumesListAdminTestJSON-2100194842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:47:02 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-816e323e-4b50-4e78-b677-2709e09fc73b tempest-VolumesListAdminTestJSON-2100194842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:47:02 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-816e323e-4b50-4e78-b677-2709e09fc73b tempest-VolumesListAdminTestJSON-2100194842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:47:02 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-816e323e-4b50-4e78-b677-2709e09fc73b tempest-VolumesListAdminTestJSON-2100194842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:47:02 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-816e323e-4b50-4e78-b677-2709e09fc73b tempest-VolumesListAdminTestJSON-2100194842 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:47:02 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-816e323e-4b50-4e78-b677-2709e09fc73b tempest-VolumesListAdminTestJSON-2100194842 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:47:02 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-816e323e-4b50-4e78-b677-2709e09fc73b tempest-VolumesListAdminTestJSON-2100194842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-3575d76b-b090-488f-8297-a60bd1c1c684 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:47:03 devstack sudo[97144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-3575d76b-b090-488f-8297-a60bd1c1c684 1073741824 Sep 04 22:47:03 devstack sudo[97144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:47:03 devstack sudo[97144]: pam_unix(sudo:session): session closed for user root Sep 04 22:47:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-816e323e-4b50-4e78-b677-2709e09fc73b tempest-VolumesListAdminTestJSON-2100194842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-3575d76b-b090-488f-8297-a60bd1c1c684 1073741824" returned: 0 in 0.926s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:47:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-816e323e-4b50-4e78-b677-2709e09fc73b tempest-VolumesListAdminTestJSON-2100194842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-3575d76b-b090-488f-8297-a60bd1c1c684 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:47:04 devstack sudo[97166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-3575d76b-b090-488f-8297-a60bd1c1c684 Sep 04 22:47:04 devstack sudo[97166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:47:04 devstack sudo[97166]: pam_unix(sudo:session): session closed for user root Sep 04 22:47:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-816e323e-4b50-4e78-b677-2709e09fc73b tempest-VolumesListAdminTestJSON-2100194842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-3575d76b-b090-488f-8297-a60bd1c1c684" returned: 0 in 0.328s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:47:04 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-816e323e-4b50-4e78-b677-2709e09fc73b tempest-VolumesListAdminTestJSON-2100194842 None] <== create_volume: return (1350ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:47:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-816e323e-4b50-4e78-b677-2709e09fc73b tempest-VolumesListAdminTestJSON-2100194842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.354s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:47:04 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-816e323e-4b50-4e78-b677-2709e09fc73b tempest-VolumesListAdminTestJSON-2100194842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01fa8288-6287-4619-beb1-3b6a7bc544a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3575d76b-b090-488f-8297-a60bd1c1c684', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:47:04 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-816e323e-4b50-4e78-b677-2709e09fc73b tempest-VolumesListAdminTestJSON-2100194842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ca7bf05-6e1d-4dfa-af6c-d40eb4c669c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:47:04 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-816e323e-4b50-4e78-b677-2709e09fc73b tempest-VolumesListAdminTestJSON-2100194842 None] Volume volume-3575d76b-b090-488f-8297-a60bd1c1c684 (3575d76b-b090-488f-8297-a60bd1c1c684): created successfully Sep 04 22:47:04 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-816e323e-4b50-4e78-b677-2709e09fc73b tempest-VolumesListAdminTestJSON-2100194842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ca7bf05-6e1d-4dfa-af6c-d40eb4c669c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:47:04 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-816e323e-4b50-4e78-b677-2709e09fc73b tempest-VolumesListAdminTestJSON-2100194842 None] Flow 'volume_create_manager' (000cfa7a-f03c-4c42-b1d0-016dc057b509) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:47:04 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-816e323e-4b50-4e78-b677-2709e09fc73b tempest-VolumesListAdminTestJSON-2100194842 None] Created volume successfully. Sep 04 22:47:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-01709a60-2c3b-4579-8d00-5cc4630a121f req-88d12c0c-27ae-4bb7-af50-6d7ff8e65a14 tempest-TestShelveInstance-1943220238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:47:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-01709a60-2c3b-4579-8d00-5cc4630a121f req-88d12c0c-27ae-4bb7-af50-6d7ff8e65a14 tempest-TestShelveInstance-1943220238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:47:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-01709a60-2c3b-4579-8d00-5cc4630a121f req-88d12c0c-27ae-4bb7-af50-6d7ff8e65a14 tempest-TestShelveInstance-1943220238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:47:05 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-01709a60-2c3b-4579-8d00-5cc4630a121f req-88d12c0c-27ae-4bb7-af50-6d7ff8e65a14 tempest-TestShelveInstance-1943220238 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4', 'name': 'volume-031d7a31-f8fa-4263-b59c-7878b17ae9ca', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7bebe5ac-ab34-4ec4-8a00-1cdccce0f2bc', 'enforce_multipath': True} {{(pid=87576) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 22:47:05 devstack cinder-volume[87576]: INFO cinder.volume.manager [req-01709a60-2c3b-4579-8d00-5cc4630a121f req-88d12c0c-27ae-4bb7-af50-6d7ff8e65a14 tempest-TestShelveInstance-1943220238 None] attachment_update completed successfully. Sep 04 22:47:05 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-f460d553-9373-4c9d-8015-977dbac4ddc3 tempest-VolumesListAdminTestJSON-2100194842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:47:05 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-f460d553-9373-4c9d-8015-977dbac4ddc3 tempest-VolumesListAdminTestJSON-2100194842 None] Flow 'volume_create_manager' (8b1c1ef5-2a8d-47df-9919-1836274cf616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:47:05 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-f460d553-9373-4c9d-8015-977dbac4ddc3 tempest-VolumesListAdminTestJSON-2100194842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e673492a-bd14-49b2-bb71-1d02d3e90392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:47:05 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-f460d553-9373-4c9d-8015-977dbac4ddc3 tempest-VolumesListAdminTestJSON-2100194842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e673492a-bd14-49b2-bb71-1d02d3e90392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:47:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-743680380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=324a0161-1e67-4e86-a017-d8c1509aa8e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62607c06378c48a39882d2fd4043dd91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:47:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:47:06Z,use_quota=True,user_id='12c1a0f66c294cc481e55388f75d4c2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:47:05 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-f460d553-9373-4c9d-8015-977dbac4ddc3 tempest-VolumesListAdminTestJSON-2100194842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08d01f09-930b-4af1-b6e5-276a2ee3020b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:47:05 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-f460d553-9373-4c9d-8015-977dbac4ddc3 tempest-VolumesListAdminTestJSON-2100194842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08d01f09-930b-4af1-b6e5-276a2ee3020b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:47:05 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-f460d553-9373-4c9d-8015-977dbac4ddc3 tempest-VolumesListAdminTestJSON-2100194842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (077ffb66-a985-4fac-8af6-b488d83a77ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:47:05 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-f460d553-9373-4c9d-8015-977dbac4ddc3 tempest-VolumesListAdminTestJSON-2100194842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (077ffb66-a985-4fac-8af6-b488d83a77ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '324a0161-1e67-4e86-a017-d8c1509aa8e0', 'volume_name': 'volume-324a0161-1e67-4e86-a017-d8c1509aa8e0', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:47:05 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-f460d553-9373-4c9d-8015-977dbac4ddc3 tempest-VolumesListAdminTestJSON-2100194842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1014130f-9384-4193-81fa-01f4a5565f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:47:05 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-f460d553-9373-4c9d-8015-977dbac4ddc3 tempest-VolumesListAdminTestJSON-2100194842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1014130f-9384-4193-81fa-01f4a5565f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:47:05 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-f460d553-9373-4c9d-8015-977dbac4ddc3 tempest-VolumesListAdminTestJSON-2100194842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57c78e4f-66d3-4bd2-a70b-dec0379d385c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:47:05 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-f460d553-9373-4c9d-8015-977dbac4ddc3 tempest-VolumesListAdminTestJSON-2100194842 None] Volume 324a0161-1e67-4e86-a017-d8c1509aa8e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-324a0161-1e67-4e86-a017-d8c1509aa8e0', 'volume_size': 1} Sep 04 22:47:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f460d553-9373-4c9d-8015-977dbac4ddc3 tempest-VolumesListAdminTestJSON-2100194842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:47:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f460d553-9373-4c9d-8015-977dbac4ddc3 tempest-VolumesListAdminTestJSON-2100194842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:47:05 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-f460d553-9373-4c9d-8015-977dbac4ddc3 tempest-VolumesListAdminTestJSON-2100194842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:47:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-743680380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=324a0161-1e67-4e86-a017-d8c1509aa8e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62607c06378c48a39882d2fd4043dd91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:47:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:47:06Z,use_quota=True,user_id='12c1a0f66c294cc481e55388f75d4c2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:47:05 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-f460d553-9373-4c9d-8015-977dbac4ddc3 tempest-VolumesListAdminTestJSON-2100194842 None] Creating volume 324a0161-1e67-4e86-a017-d8c1509aa8e0 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:47:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f460d553-9373-4c9d-8015-977dbac4ddc3 tempest-VolumesListAdminTestJSON-2100194842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:47:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f460d553-9373-4c9d-8015-977dbac4ddc3 tempest-VolumesListAdminTestJSON-2100194842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:47:05 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-f460d553-9373-4c9d-8015-977dbac4ddc3 tempest-VolumesListAdminTestJSON-2100194842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:47:05 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-f460d553-9373-4c9d-8015-977dbac4ddc3 tempest-VolumesListAdminTestJSON-2100194842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:47:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f460d553-9373-4c9d-8015-977dbac4ddc3 tempest-VolumesListAdminTestJSON-2100194842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:47:05 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-f460d553-9373-4c9d-8015-977dbac4ddc3 tempest-VolumesListAdminTestJSON-2100194842 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:47:05 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-f460d553-9373-4c9d-8015-977dbac4ddc3 tempest-VolumesListAdminTestJSON-2100194842 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:47:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f460d553-9373-4c9d-8015-977dbac4ddc3 tempest-VolumesListAdminTestJSON-2100194842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-324a0161-1e67-4e86-a017-d8c1509aa8e0 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:47:05 devstack sudo[97177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-324a0161-1e67-4e86-a017-d8c1509aa8e0 1073741824 Sep 04 22:47:05 devstack sudo[97177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:47:06 devstack sudo[97177]: pam_unix(sudo:session): session closed for user root Sep 04 22:47:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f460d553-9373-4c9d-8015-977dbac4ddc3 tempest-VolumesListAdminTestJSON-2100194842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-324a0161-1e67-4e86-a017-d8c1509aa8e0 1073741824" returned: 0 in 0.550s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:47:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f460d553-9373-4c9d-8015-977dbac4ddc3 tempest-VolumesListAdminTestJSON-2100194842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-324a0161-1e67-4e86-a017-d8c1509aa8e0 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:47:06 devstack sudo[97183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-324a0161-1e67-4e86-a017-d8c1509aa8e0 Sep 04 22:47:06 devstack sudo[97183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:47:06 devstack sudo[97183]: pam_unix(sudo:session): session closed for user root Sep 04 22:47:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f460d553-9373-4c9d-8015-977dbac4ddc3 tempest-VolumesListAdminTestJSON-2100194842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-324a0161-1e67-4e86-a017-d8c1509aa8e0" returned: 0 in 0.301s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:47:06 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-f460d553-9373-4c9d-8015-977dbac4ddc3 tempest-VolumesListAdminTestJSON-2100194842 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:47:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f460d553-9373-4c9d-8015-977dbac4ddc3 tempest-VolumesListAdminTestJSON-2100194842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:47:06 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-f460d553-9373-4c9d-8015-977dbac4ddc3 tempest-VolumesListAdminTestJSON-2100194842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57c78e4f-66d3-4bd2-a70b-dec0379d385c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-324a0161-1e67-4e86-a017-d8c1509aa8e0', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:47:06 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-f460d553-9373-4c9d-8015-977dbac4ddc3 tempest-VolumesListAdminTestJSON-2100194842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0682dcaf-d1f8-4fe5-b707-57a90625f58f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:47:06 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-f460d553-9373-4c9d-8015-977dbac4ddc3 tempest-VolumesListAdminTestJSON-2100194842 None] Volume volume-324a0161-1e67-4e86-a017-d8c1509aa8e0 (324a0161-1e67-4e86-a017-d8c1509aa8e0): created successfully Sep 04 22:47:06 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-f460d553-9373-4c9d-8015-977dbac4ddc3 tempest-VolumesListAdminTestJSON-2100194842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0682dcaf-d1f8-4fe5-b707-57a90625f58f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:47:06 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-f460d553-9373-4c9d-8015-977dbac4ddc3 tempest-VolumesListAdminTestJSON-2100194842 None] Flow 'volume_create_manager' (8b1c1ef5-2a8d-47df-9919-1836274cf616) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:47:06 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-f460d553-9373-4c9d-8015-977dbac4ddc3 tempest-VolumesListAdminTestJSON-2100194842 None] Created volume successfully. Sep 04 22:47:08 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-62f83caf-1386-4476-b84b-3963f482988b tempest-VolumesListAdminTestJSON-2100194842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:47:08 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-62f83caf-1386-4476-b84b-3963f482988b tempest-VolumesListAdminTestJSON-2100194842 None] Flow 'volume_create_manager' (af0d14b0-8bb9-425f-841d-462468ede3c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:47:08 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-62f83caf-1386-4476-b84b-3963f482988b tempest-VolumesListAdminTestJSON-2100194842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a664549f-53fa-49de-9627-ade91eedcfb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:47:08 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-62f83caf-1386-4476-b84b-3963f482988b tempest-VolumesListAdminTestJSON-2100194842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a664549f-53fa-49de-9627-ade91eedcfb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:47:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-786874453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06215582-40e1-4ab5-ac10-b798806f8b22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62607c06378c48a39882d2fd4043dd91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:47:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:47:08Z,use_quota=True,user_id='12c1a0f66c294cc481e55388f75d4c2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:47:08 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-62f83caf-1386-4476-b84b-3963f482988b tempest-VolumesListAdminTestJSON-2100194842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4089c733-467b-49e1-9644-3e500b8a90ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:47:08 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-62f83caf-1386-4476-b84b-3963f482988b tempest-VolumesListAdminTestJSON-2100194842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4089c733-467b-49e1-9644-3e500b8a90ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:47:08 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-62f83caf-1386-4476-b84b-3963f482988b tempest-VolumesListAdminTestJSON-2100194842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00242950-3321-4a9c-a7cd-6242b62cc3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:47:08 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-62f83caf-1386-4476-b84b-3963f482988b tempest-VolumesListAdminTestJSON-2100194842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00242950-3321-4a9c-a7cd-6242b62cc3ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06215582-40e1-4ab5-ac10-b798806f8b22', 'volume_name': 'volume-06215582-40e1-4ab5-ac10-b798806f8b22', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:47:08 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-62f83caf-1386-4476-b84b-3963f482988b tempest-VolumesListAdminTestJSON-2100194842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12f34829-085a-4d7c-bb8c-25b324bc125d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:47:08 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-62f83caf-1386-4476-b84b-3963f482988b tempest-VolumesListAdminTestJSON-2100194842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12f34829-085a-4d7c-bb8c-25b324bc125d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:47:08 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-62f83caf-1386-4476-b84b-3963f482988b tempest-VolumesListAdminTestJSON-2100194842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa291ad9-3841-4add-8f37-ae3ebb288a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:47:08 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-62f83caf-1386-4476-b84b-3963f482988b tempest-VolumesListAdminTestJSON-2100194842 None] Volume 06215582-40e1-4ab5-ac10-b798806f8b22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06215582-40e1-4ab5-ac10-b798806f8b22', 'volume_size': 1} Sep 04 22:47:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-62f83caf-1386-4476-b84b-3963f482988b tempest-VolumesListAdminTestJSON-2100194842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:47:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-62f83caf-1386-4476-b84b-3963f482988b tempest-VolumesListAdminTestJSON-2100194842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:47:08 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-62f83caf-1386-4476-b84b-3963f482988b tempest-VolumesListAdminTestJSON-2100194842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:47:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-786874453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06215582-40e1-4ab5-ac10-b798806f8b22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62607c06378c48a39882d2fd4043dd91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:47:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:47:08Z,use_quota=True,user_id='12c1a0f66c294cc481e55388f75d4c2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:47:08 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-62f83caf-1386-4476-b84b-3963f482988b tempest-VolumesListAdminTestJSON-2100194842 None] Creating volume 06215582-40e1-4ab5-ac10-b798806f8b22 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:47:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-62f83caf-1386-4476-b84b-3963f482988b tempest-VolumesListAdminTestJSON-2100194842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:47:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-62f83caf-1386-4476-b84b-3963f482988b tempest-VolumesListAdminTestJSON-2100194842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:47:08 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-62f83caf-1386-4476-b84b-3963f482988b tempest-VolumesListAdminTestJSON-2100194842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:47:08 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-62f83caf-1386-4476-b84b-3963f482988b tempest-VolumesListAdminTestJSON-2100194842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:47:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-62f83caf-1386-4476-b84b-3963f482988b tempest-VolumesListAdminTestJSON-2100194842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:47:08 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-62f83caf-1386-4476-b84b-3963f482988b tempest-VolumesListAdminTestJSON-2100194842 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:47:08 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-62f83caf-1386-4476-b84b-3963f482988b tempest-VolumesListAdminTestJSON-2100194842 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:47:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-62f83caf-1386-4476-b84b-3963f482988b tempest-VolumesListAdminTestJSON-2100194842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-06215582-40e1-4ab5-ac10-b798806f8b22 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:47:08 devstack sudo[97186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-06215582-40e1-4ab5-ac10-b798806f8b22 1073741824 Sep 04 22:47:08 devstack sudo[97186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:47:09 devstack sudo[97186]: pam_unix(sudo:session): session closed for user root Sep 04 22:47:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-62f83caf-1386-4476-b84b-3963f482988b tempest-VolumesListAdminTestJSON-2100194842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-06215582-40e1-4ab5-ac10-b798806f8b22 1073741824" returned: 0 in 0.508s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:47:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-62f83caf-1386-4476-b84b-3963f482988b tempest-VolumesListAdminTestJSON-2100194842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-06215582-40e1-4ab5-ac10-b798806f8b22 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:47:09 devstack sudo[97192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-06215582-40e1-4ab5-ac10-b798806f8b22 Sep 04 22:47:09 devstack sudo[97192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:47:09 devstack sudo[97192]: pam_unix(sudo:session): session closed for user root Sep 04 22:47:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-62f83caf-1386-4476-b84b-3963f482988b tempest-VolumesListAdminTestJSON-2100194842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-06215582-40e1-4ab5-ac10-b798806f8b22" returned: 0 in 0.281s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:47:09 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-62f83caf-1386-4476-b84b-3963f482988b tempest-VolumesListAdminTestJSON-2100194842 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:47:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-62f83caf-1386-4476-b84b-3963f482988b tempest-VolumesListAdminTestJSON-2100194842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:47:09 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-62f83caf-1386-4476-b84b-3963f482988b tempest-VolumesListAdminTestJSON-2100194842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa291ad9-3841-4add-8f37-ae3ebb288a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06215582-40e1-4ab5-ac10-b798806f8b22', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:47:09 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-62f83caf-1386-4476-b84b-3963f482988b tempest-VolumesListAdminTestJSON-2100194842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (292a3f40-6c01-4003-91a6-b68253897816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:47:09 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-62f83caf-1386-4476-b84b-3963f482988b tempest-VolumesListAdminTestJSON-2100194842 None] Volume volume-06215582-40e1-4ab5-ac10-b798806f8b22 (06215582-40e1-4ab5-ac10-b798806f8b22): created successfully Sep 04 22:47:09 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-62f83caf-1386-4476-b84b-3963f482988b tempest-VolumesListAdminTestJSON-2100194842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (292a3f40-6c01-4003-91a6-b68253897816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:47:09 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-62f83caf-1386-4476-b84b-3963f482988b tempest-VolumesListAdminTestJSON-2100194842 None] Flow 'volume_create_manager' (af0d14b0-8bb9-425f-841d-462468ede3c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:47:09 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-62f83caf-1386-4476-b84b-3963f482988b tempest-VolumesListAdminTestJSON-2100194842 None] Created volume successfully. Sep 04 22:47:11 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0419ed2-f36e-4e64-afd5-0fb94a94fcc1 tempest-VolumesListAdminTestJSON-263317595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:47:11 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-c0419ed2-f36e-4e64-afd5-0fb94a94fcc1 tempest-VolumesListAdminTestJSON-263317595 None] Flow 'volume_create_manager' (3f68ce37-d6f9-44ae-b41a-e27716d18dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:47:11 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-c0419ed2-f36e-4e64-afd5-0fb94a94fcc1 tempest-VolumesListAdminTestJSON-263317595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5033e108-3147-4f91-8293-1989d3152d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:47:11 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-c0419ed2-f36e-4e64-afd5-0fb94a94fcc1 tempest-VolumesListAdminTestJSON-263317595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5033e108-3147-4f91-8293-1989d3152d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:47:10Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=362ccb98-80d5-4a14-a107-ffce44671a2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e58ef6b1e7a945aeaaa63eda36ffb402',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:47:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:47:11Z,use_quota=True,user_id='8bea477cfc4e4a87bc8d59a1dd286704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:47:11 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-c0419ed2-f36e-4e64-afd5-0fb94a94fcc1 tempest-VolumesListAdminTestJSON-263317595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (838e1ddb-e09e-446f-84aa-fccd08239745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:47:11 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-c0419ed2-f36e-4e64-afd5-0fb94a94fcc1 tempest-VolumesListAdminTestJSON-263317595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (838e1ddb-e09e-446f-84aa-fccd08239745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:47:11 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-c0419ed2-f36e-4e64-afd5-0fb94a94fcc1 tempest-VolumesListAdminTestJSON-263317595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eaead4a-eecd-4355-80bd-0f51a0859df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:47:11 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-c0419ed2-f36e-4e64-afd5-0fb94a94fcc1 tempest-VolumesListAdminTestJSON-263317595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eaead4a-eecd-4355-80bd-0f51a0859df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '362ccb98-80d5-4a14-a107-ffce44671a2a', 'volume_name': 'volume-362ccb98-80d5-4a14-a107-ffce44671a2a', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:47:11 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-c0419ed2-f36e-4e64-afd5-0fb94a94fcc1 tempest-VolumesListAdminTestJSON-263317595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (871ebfb4-69af-4596-afa7-bff17d011179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:47:11 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-c0419ed2-f36e-4e64-afd5-0fb94a94fcc1 tempest-VolumesListAdminTestJSON-263317595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (871ebfb4-69af-4596-afa7-bff17d011179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:47:11 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-c0419ed2-f36e-4e64-afd5-0fb94a94fcc1 tempest-VolumesListAdminTestJSON-263317595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e20c309-3e6b-4b20-bfa5-e507005c1b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:47:11 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-c0419ed2-f36e-4e64-afd5-0fb94a94fcc1 tempest-VolumesListAdminTestJSON-263317595 None] Volume 362ccb98-80d5-4a14-a107-ffce44671a2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-362ccb98-80d5-4a14-a107-ffce44671a2a', 'volume_size': 1} Sep 04 22:47:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-c0419ed2-f36e-4e64-afd5-0fb94a94fcc1 tempest-VolumesListAdminTestJSON-263317595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:47:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-c0419ed2-f36e-4e64-afd5-0fb94a94fcc1 tempest-VolumesListAdminTestJSON-263317595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:47:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-c0419ed2-f36e-4e64-afd5-0fb94a94fcc1 tempest-VolumesListAdminTestJSON-263317595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:47:10Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=362ccb98-80d5-4a14-a107-ffce44671a2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e58ef6b1e7a945aeaaa63eda36ffb402',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:47:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:47:11Z,use_quota=True,user_id='8bea477cfc4e4a87bc8d59a1dd286704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:47:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-c0419ed2-f36e-4e64-afd5-0fb94a94fcc1 tempest-VolumesListAdminTestJSON-263317595 None] Creating volume 362ccb98-80d5-4a14-a107-ffce44671a2a {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:47:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-c0419ed2-f36e-4e64-afd5-0fb94a94fcc1 tempest-VolumesListAdminTestJSON-263317595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:47:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-c0419ed2-f36e-4e64-afd5-0fb94a94fcc1 tempest-VolumesListAdminTestJSON-263317595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:47:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-c0419ed2-f36e-4e64-afd5-0fb94a94fcc1 tempest-VolumesListAdminTestJSON-263317595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:47:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-c0419ed2-f36e-4e64-afd5-0fb94a94fcc1 tempest-VolumesListAdminTestJSON-263317595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:47:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-c0419ed2-f36e-4e64-afd5-0fb94a94fcc1 tempest-VolumesListAdminTestJSON-263317595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:47:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-c0419ed2-f36e-4e64-afd5-0fb94a94fcc1 tempest-VolumesListAdminTestJSON-263317595 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:47:11 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-c0419ed2-f36e-4e64-afd5-0fb94a94fcc1 tempest-VolumesListAdminTestJSON-263317595 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:47:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c0419ed2-f36e-4e64-afd5-0fb94a94fcc1 tempest-VolumesListAdminTestJSON-263317595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-362ccb98-80d5-4a14-a107-ffce44671a2a 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:47:11 devstack sudo[97612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-362ccb98-80d5-4a14-a107-ffce44671a2a 1073741824 Sep 04 22:47:11 devstack sudo[97612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:47:11 devstack cinder-volume[87576]: DEBUG oslo_service.periodic_task [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87576) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 22:47:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:47:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:47:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:47:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:47:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:47:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:47:12 devstack sudo[97640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:47:12 devstack sudo[97640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:47:12 devstack sudo[97612]: pam_unix(sudo:session): session closed for user root Sep 04 22:47:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c0419ed2-f36e-4e64-afd5-0fb94a94fcc1 tempest-VolumesListAdminTestJSON-263317595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-362ccb98-80d5-4a14-a107-ffce44671a2a 1073741824" returned: 0 in 1.130s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:47:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c0419ed2-f36e-4e64-afd5-0fb94a94fcc1 tempest-VolumesListAdminTestJSON-263317595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-362ccb98-80d5-4a14-a107-ffce44671a2a {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:47:12 devstack sudo[97648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-362ccb98-80d5-4a14-a107-ffce44671a2a Sep 04 22:47:12 devstack sudo[97648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:47:12 devstack sudo[97640]: pam_unix(sudo:session): session closed for user root Sep 04 22:47:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.723s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:47:12 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:47:12 devstack cinder-volume[87576]: DEBUG oslo_service.periodic_task [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Running periodic task VolumeManager._thread_info {{(pid=87576) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 22:47:12 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] thread count: 28 {{(pid=87576) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 22:47:12 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] thread info: [<_MainThread(MainThread, started 125730416963712)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87576) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 22:47:12 devstack sudo[97648]: pam_unix(sudo:session): session closed for user root Sep 04 22:47:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c0419ed2-f36e-4e64-afd5-0fb94a94fcc1 tempest-VolumesListAdminTestJSON-263317595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-362ccb98-80d5-4a14-a107-ffce44671a2a" returned: 0 in 0.406s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:47:12 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-c0419ed2-f36e-4e64-afd5-0fb94a94fcc1 tempest-VolumesListAdminTestJSON-263317595 None] <== create_volume: return (1650ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:47:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-c0419ed2-f36e-4e64-afd5-0fb94a94fcc1 tempest-VolumesListAdminTestJSON-263317595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.653s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:47:12 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-c0419ed2-f36e-4e64-afd5-0fb94a94fcc1 tempest-VolumesListAdminTestJSON-263317595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e20c309-3e6b-4b20-bfa5-e507005c1b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-362ccb98-80d5-4a14-a107-ffce44671a2a', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:47:12 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-c0419ed2-f36e-4e64-afd5-0fb94a94fcc1 tempest-VolumesListAdminTestJSON-263317595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c0f26e5-ba71-4edd-a372-1bab17f1b2e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:47:12 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-c0419ed2-f36e-4e64-afd5-0fb94a94fcc1 tempest-VolumesListAdminTestJSON-263317595 None] Volume volume-362ccb98-80d5-4a14-a107-ffce44671a2a (362ccb98-80d5-4a14-a107-ffce44671a2a): created successfully Sep 04 22:47:12 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-c0419ed2-f36e-4e64-afd5-0fb94a94fcc1 tempest-VolumesListAdminTestJSON-263317595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c0f26e5-ba71-4edd-a372-1bab17f1b2e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:47:12 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-c0419ed2-f36e-4e64-afd5-0fb94a94fcc1 tempest-VolumesListAdminTestJSON-263317595 None] Flow 'volume_create_manager' (3f68ce37-d6f9-44ae-b41a-e27716d18dca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:47:12 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-c0419ed2-f36e-4e64-afd5-0fb94a94fcc1 tempest-VolumesListAdminTestJSON-263317595 None] Created volume successfully. Sep 04 22:47:13 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-cbf50bc3-9907-41ca-827a-ea1c94c92df1 tempest-VolumesListAdminTestJSON-263317595 None] Acquiring lock "cinder-362ccb98-80d5-4a14-a107-ffce44671a2a-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:47:13 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-cbf50bc3-9907-41ca-827a-ea1c94c92df1 tempest-VolumesListAdminTestJSON-263317595 None] Lock "cinder-362ccb98-80d5-4a14-a107-ffce44671a2a-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:47:13 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-cbf50bc3-9907-41ca-827a-ea1c94c92df1 tempest-VolumesListAdminTestJSON-263317595 None] Acquiring lock "cinder-quobyte-362ccb98-80d5-4a14-a107-ffce44671a2a" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:47:13 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-cbf50bc3-9907-41ca-827a-ea1c94c92df1 tempest-VolumesListAdminTestJSON-263317595 None] Lock "cinder-quobyte-362ccb98-80d5-4a14-a107-ffce44671a2a" acquired by "delete_volume" :: waited 0.034s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:47:13 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa95c128-0a2a-414f-8336-88e5a43f612b]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:47:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-cbf50bc3-9907-41ca-827a-ea1c94c92df1 tempest-VolumesListAdminTestJSON-263317595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-362ccb98-80d5-4a14-a107-ffce44671a2a {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:47:13 devstack sudo[97659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-362ccb98-80d5-4a14-a107-ffce44671a2a Sep 04 22:47:13 devstack sudo[97659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:47:13 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-7b309a1f-a13b-4c0b-be47-2663a2bfd1d9 tempest-VolumesListAdminTestJSON-2100194842 None] Acquiring lock "cinder-06215582-40e1-4ab5-ac10-b798806f8b22-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:47:13 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-7b309a1f-a13b-4c0b-be47-2663a2bfd1d9 tempest-VolumesListAdminTestJSON-2100194842 None] Lock "cinder-06215582-40e1-4ab5-ac10-b798806f8b22-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:47:14 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-7b309a1f-a13b-4c0b-be47-2663a2bfd1d9 tempest-VolumesListAdminTestJSON-2100194842 None] Acquiring lock "cinder-quobyte-06215582-40e1-4ab5-ac10-b798806f8b22" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:47:14 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-7b309a1f-a13b-4c0b-be47-2663a2bfd1d9 tempest-VolumesListAdminTestJSON-2100194842 None] Lock "cinder-quobyte-06215582-40e1-4ab5-ac10-b798806f8b22" acquired by "delete_volume" :: waited 0.032s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:47:14 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec6691c-34df-425d-849b-d3d1c04c67ff]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:47:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-7b309a1f-a13b-4c0b-be47-2663a2bfd1d9 tempest-VolumesListAdminTestJSON-2100194842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-06215582-40e1-4ab5-ac10-b798806f8b22 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:47:14 devstack sudo[97659]: pam_unix(sudo:session): session closed for user root Sep 04 22:47:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-cbf50bc3-9907-41ca-827a-ea1c94c92df1 tempest-VolumesListAdminTestJSON-263317595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-362ccb98-80d5-4a14-a107-ffce44671a2a" returned: 0 in 0.913s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:47:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-cbf50bc3-9907-41ca-827a-ea1c94c92df1 tempest-VolumesListAdminTestJSON-263317595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-362ccb98-80d5-4a14-a107-ffce44671a2a {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:47:14 devstack sudo[97662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-06215582-40e1-4ab5-ac10-b798806f8b22 Sep 04 22:47:14 devstack sudo[97662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:47:14 devstack sudo[97665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-362ccb98-80d5-4a14-a107-ffce44671a2a Sep 04 22:47:14 devstack sudo[97665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:47:14 devstack sudo[97665]: pam_unix(sudo:session): session closed for user root Sep 04 22:47:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-cbf50bc3-9907-41ca-827a-ea1c94c92df1 tempest-VolumesListAdminTestJSON-263317595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-362ccb98-80d5-4a14-a107-ffce44671a2a" returned: 0 in 0.407s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:47:14 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-cbf50bc3-9907-41ca-827a-ea1c94c92df1 tempest-VolumesListAdminTestJSON-263317595 None] Lock "cinder-quobyte-362ccb98-80d5-4a14-a107-ffce44671a2a" released by "delete_volume" :: held 1.419s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:47:15 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-cbf50bc3-9907-41ca-827a-ea1c94c92df1 tempest-VolumesListAdminTestJSON-263317595 None] Created reservations ['6ad963f0-ab22-4484-9d48-e4089e4b0a4a', '25c594d8-21d6-4631-b21e-245c3bcde772', '237aa794-ba4f-43e6-801a-36aad76acf9b', 'e7689eed-6564-4cb1-b90e-d483320a5804'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:47:15 devstack sudo[97662]: pam_unix(sudo:session): session closed for user root Sep 04 22:47:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-7b309a1f-a13b-4c0b-be47-2663a2bfd1d9 tempest-VolumesListAdminTestJSON-2100194842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-06215582-40e1-4ab5-ac10-b798806f8b22" returned: 0 in 0.922s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:47:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-7b309a1f-a13b-4c0b-be47-2663a2bfd1d9 tempest-VolumesListAdminTestJSON-2100194842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-06215582-40e1-4ab5-ac10-b798806f8b22 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:47:15 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-0faac0ca-61ce-4451-9169-d5697f7441e6 tempest-AttachVolumeTestJSON-1147748540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:47:15 devstack sudo[97672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-06215582-40e1-4ab5-ac10-b798806f8b22 Sep 04 22:47:15 devstack sudo[97672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:47:15 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0faac0ca-61ce-4451-9169-d5697f7441e6 tempest-AttachVolumeTestJSON-1147748540 None] Flow 'volume_create_manager' (ad6d5358-342c-4cce-a3cb-4bc9a4b12b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:47:15 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0faac0ca-61ce-4451-9169-d5697f7441e6 tempest-AttachVolumeTestJSON-1147748540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9f78937-e655-46e1-a0f1-2f51bf441957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:47:15 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0faac0ca-61ce-4451-9169-d5697f7441e6 tempest-AttachVolumeTestJSON-1147748540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9f78937-e655-46e1-a0f1-2f51bf441957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:47:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-564525171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e4154d0-fd3d-40ff-8be4-d25f4c851054,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='493b0f7420a046b0bd5c132949c7b031',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:47:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:47:15Z,use_quota=True,user_id='834efb407c6844138d24708f548e3d7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:47:15 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0faac0ca-61ce-4451-9169-d5697f7441e6 tempest-AttachVolumeTestJSON-1147748540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dd7db5e-b917-419e-9209-96fade6c9e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:47:15 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0faac0ca-61ce-4451-9169-d5697f7441e6 tempest-AttachVolumeTestJSON-1147748540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dd7db5e-b917-419e-9209-96fade6c9e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:47:15 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0faac0ca-61ce-4451-9169-d5697f7441e6 tempest-AttachVolumeTestJSON-1147748540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5583b0ac-608d-4aa5-ba54-606a991a08bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:47:15 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0faac0ca-61ce-4451-9169-d5697f7441e6 tempest-AttachVolumeTestJSON-1147748540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5583b0ac-608d-4aa5-ba54-606a991a08bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e4154d0-fd3d-40ff-8be4-d25f4c851054', 'volume_name': 'volume-6e4154d0-fd3d-40ff-8be4-d25f4c851054', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:47:15 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0faac0ca-61ce-4451-9169-d5697f7441e6 tempest-AttachVolumeTestJSON-1147748540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd35c4ee-7796-4c73-b27a-7da5bbf6425c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:47:15 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0faac0ca-61ce-4451-9169-d5697f7441e6 tempest-AttachVolumeTestJSON-1147748540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd35c4ee-7796-4c73-b27a-7da5bbf6425c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:47:15 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0faac0ca-61ce-4451-9169-d5697f7441e6 tempest-AttachVolumeTestJSON-1147748540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99f96875-c626-4279-8d17-02fcff545502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:47:15 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-0faac0ca-61ce-4451-9169-d5697f7441e6 tempest-AttachVolumeTestJSON-1147748540 None] Volume 6e4154d0-fd3d-40ff-8be4-d25f4c851054: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e4154d0-fd3d-40ff-8be4-d25f4c851054', 'volume_size': 1} Sep 04 22:47:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-0faac0ca-61ce-4451-9169-d5697f7441e6 tempest-AttachVolumeTestJSON-1147748540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:47:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-0faac0ca-61ce-4451-9169-d5697f7441e6 tempest-AttachVolumeTestJSON-1147748540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:47:15 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-0faac0ca-61ce-4451-9169-d5697f7441e6 tempest-AttachVolumeTestJSON-1147748540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:47:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-564525171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e4154d0-fd3d-40ff-8be4-d25f4c851054,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='493b0f7420a046b0bd5c132949c7b031',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:47:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:47:15Z,use_quota=True,user_id='834efb407c6844138d24708f548e3d7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:47:15 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-0faac0ca-61ce-4451-9169-d5697f7441e6 tempest-AttachVolumeTestJSON-1147748540 None] Creating volume 6e4154d0-fd3d-40ff-8be4-d25f4c851054 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:47:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-0faac0ca-61ce-4451-9169-d5697f7441e6 tempest-AttachVolumeTestJSON-1147748540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:47:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-0faac0ca-61ce-4451-9169-d5697f7441e6 tempest-AttachVolumeTestJSON-1147748540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:47:15 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-0faac0ca-61ce-4451-9169-d5697f7441e6 tempest-AttachVolumeTestJSON-1147748540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:47:15 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-0faac0ca-61ce-4451-9169-d5697f7441e6 tempest-AttachVolumeTestJSON-1147748540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:47:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-0faac0ca-61ce-4451-9169-d5697f7441e6 tempest-AttachVolumeTestJSON-1147748540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:47:15 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-0faac0ca-61ce-4451-9169-d5697f7441e6 tempest-AttachVolumeTestJSON-1147748540 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:47:15 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-0faac0ca-61ce-4451-9169-d5697f7441e6 tempest-AttachVolumeTestJSON-1147748540 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:47:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0faac0ca-61ce-4451-9169-d5697f7441e6 tempest-AttachVolumeTestJSON-1147748540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e4154d0-fd3d-40ff-8be4-d25f4c851054 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:47:15 devstack sudo[97674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e4154d0-fd3d-40ff-8be4-d25f4c851054 1073741824 Sep 04 22:47:15 devstack sudo[97674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:47:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-cbf50bc3-9907-41ca-827a-ea1c94c92df1 tempest-VolumesListAdminTestJSON-263317595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:47:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-cbf50bc3-9907-41ca-827a-ea1c94c92df1 tempest-VolumesListAdminTestJSON-263317595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:47:15 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-cbf50bc3-9907-41ca-827a-ea1c94c92df1 tempest-VolumesListAdminTestJSON-263317595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:47:15 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-cbf50bc3-9907-41ca-827a-ea1c94c92df1 tempest-VolumesListAdminTestJSON-263317595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:47:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-cbf50bc3-9907-41ca-827a-ea1c94c92df1 tempest-VolumesListAdminTestJSON-263317595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:47:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-cbf50bc3-9907-41ca-827a-ea1c94c92df1 tempest-VolumesListAdminTestJSON-263317595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:47:15 devstack sudo[97677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:47:15 devstack sudo[97677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:47:15 devstack sudo[97672]: pam_unix(sudo:session): session closed for user root Sep 04 22:47:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-7b309a1f-a13b-4c0b-be47-2663a2bfd1d9 tempest-VolumesListAdminTestJSON-2100194842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-06215582-40e1-4ab5-ac10-b798806f8b22" returned: 0 in 0.471s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:47:15 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-7b309a1f-a13b-4c0b-be47-2663a2bfd1d9 tempest-VolumesListAdminTestJSON-2100194842 None] Lock "cinder-quobyte-06215582-40e1-4ab5-ac10-b798806f8b22" released by "delete_volume" :: held 1.561s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:47:16 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-7b309a1f-a13b-4c0b-be47-2663a2bfd1d9 tempest-VolumesListAdminTestJSON-2100194842 None] Created reservations ['8b9ae7df-bc31-47d7-9897-61aed55546a7', '44f1a1a5-1911-4f74-8d9e-0359193f42fd', '50e0f51d-d5e4-438d-b1f7-d957dab4232c', '1efe7ebc-ae41-4255-b5c7-9871d5fa309f'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:47:16 devstack sudo[97677]: pam_unix(sudo:session): session closed for user root Sep 04 22:47:16 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-cbf50bc3-9907-41ca-827a-ea1c94c92df1 tempest-VolumesListAdminTestJSON-263317595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.588s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:47:16 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-cbf50bc3-9907-41ca-827a-ea1c94c92df1 tempest-VolumesListAdminTestJSON-263317595 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:47:16 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-cbf50bc3-9907-41ca-827a-ea1c94c92df1 tempest-VolumesListAdminTestJSON-263317595 None] Deleted volume successfully. Sep 04 22:47:16 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-cbf50bc3-9907-41ca-827a-ea1c94c92df1 tempest-VolumesListAdminTestJSON-263317595 None] Lock "cinder-362ccb98-80d5-4a14-a107-ffce44671a2a-delete_volume" released by "delete_volume" :: held 2.839s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:47:16 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-7b309a1f-a13b-4c0b-be47-2663a2bfd1d9 tempest-VolumesListAdminTestJSON-2100194842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:47:16 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-7b309a1f-a13b-4c0b-be47-2663a2bfd1d9 tempest-VolumesListAdminTestJSON-2100194842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:47:16 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-7b309a1f-a13b-4c0b-be47-2663a2bfd1d9 tempest-VolumesListAdminTestJSON-2100194842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:47:16 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-7b309a1f-a13b-4c0b-be47-2663a2bfd1d9 tempest-VolumesListAdminTestJSON-2100194842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:47:16 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-7b309a1f-a13b-4c0b-be47-2663a2bfd1d9 tempest-VolumesListAdminTestJSON-2100194842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:47:16 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-7b309a1f-a13b-4c0b-be47-2663a2bfd1d9 tempest-VolumesListAdminTestJSON-2100194842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:47:16 devstack sudo[97684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:47:16 devstack sudo[97684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:47:16 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-aae1c535-de7d-4b3b-89b9-e8dceda82011 tempest-VolumesListAdminTestJSON-2100194842 None] Acquiring lock "cinder-324a0161-1e67-4e86-a017-d8c1509aa8e0-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:47:16 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-aae1c535-de7d-4b3b-89b9-e8dceda82011 tempest-VolumesListAdminTestJSON-2100194842 None] Lock "cinder-324a0161-1e67-4e86-a017-d8c1509aa8e0-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:47:16 devstack sudo[97674]: pam_unix(sudo:session): session closed for user root Sep 04 22:47:16 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0faac0ca-61ce-4451-9169-d5697f7441e6 tempest-AttachVolumeTestJSON-1147748540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e4154d0-fd3d-40ff-8be4-d25f4c851054 1073741824" returned: 0 in 1.201s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:47:16 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-aae1c535-de7d-4b3b-89b9-e8dceda82011 tempest-VolumesListAdminTestJSON-2100194842 None] Acquiring lock "cinder-quobyte-324a0161-1e67-4e86-a017-d8c1509aa8e0" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:47:16 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-aae1c535-de7d-4b3b-89b9-e8dceda82011 tempest-VolumesListAdminTestJSON-2100194842 None] Lock "cinder-quobyte-324a0161-1e67-4e86-a017-d8c1509aa8e0" acquired by "delete_volume" :: waited 0.038s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:47:16 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[a568f36a-7387-4897-8820-ea4b321bc96f]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:47:16 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-aae1c535-de7d-4b3b-89b9-e8dceda82011 tempest-VolumesListAdminTestJSON-2100194842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-324a0161-1e67-4e86-a017-d8c1509aa8e0 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:47:16 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0faac0ca-61ce-4451-9169-d5697f7441e6 tempest-AttachVolumeTestJSON-1147748540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e4154d0-fd3d-40ff-8be4-d25f4c851054 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:47:16 devstack sudo[97687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e4154d0-fd3d-40ff-8be4-d25f4c851054 Sep 04 22:47:16 devstack sudo[97687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:47:17 devstack sudo[97684]: pam_unix(sudo:session): session closed for user root Sep 04 22:47:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-7b309a1f-a13b-4c0b-be47-2663a2bfd1d9 tempest-VolumesListAdminTestJSON-2100194842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.635s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:47:17 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-7b309a1f-a13b-4c0b-be47-2663a2bfd1d9 tempest-VolumesListAdminTestJSON-2100194842 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:47:17 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-7b309a1f-a13b-4c0b-be47-2663a2bfd1d9 tempest-VolumesListAdminTestJSON-2100194842 None] Deleted volume successfully. Sep 04 22:47:17 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-7b309a1f-a13b-4c0b-be47-2663a2bfd1d9 tempest-VolumesListAdminTestJSON-2100194842 None] Lock "cinder-06215582-40e1-4ab5-ac10-b798806f8b22-delete_volume" released by "delete_volume" :: held 3.163s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:47:17 devstack sudo[97686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-324a0161-1e67-4e86-a017-d8c1509aa8e0 Sep 04 22:47:17 devstack sudo[97686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:47:17 devstack sudo[97687]: pam_unix(sudo:session): session closed for user root Sep 04 22:47:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0faac0ca-61ce-4451-9169-d5697f7441e6 tempest-AttachVolumeTestJSON-1147748540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e4154d0-fd3d-40ff-8be4-d25f4c851054" returned: 0 in 0.544s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:47:17 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-0faac0ca-61ce-4451-9169-d5697f7441e6 tempest-AttachVolumeTestJSON-1147748540 None] <== create_volume: return (1936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:47:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-0faac0ca-61ce-4451-9169-d5697f7441e6 tempest-AttachVolumeTestJSON-1147748540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.940s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:47:17 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0faac0ca-61ce-4451-9169-d5697f7441e6 tempest-AttachVolumeTestJSON-1147748540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99f96875-c626-4279-8d17-02fcff545502) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e4154d0-fd3d-40ff-8be4-d25f4c851054', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:47:17 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0faac0ca-61ce-4451-9169-d5697f7441e6 tempest-AttachVolumeTestJSON-1147748540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24b4237d-6843-45a9-bdaf-8abd8d619906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:47:17 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-0faac0ca-61ce-4451-9169-d5697f7441e6 tempest-AttachVolumeTestJSON-1147748540 None] Volume volume-6e4154d0-fd3d-40ff-8be4-d25f4c851054 (6e4154d0-fd3d-40ff-8be4-d25f4c851054): created successfully Sep 04 22:47:17 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0faac0ca-61ce-4451-9169-d5697f7441e6 tempest-AttachVolumeTestJSON-1147748540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24b4237d-6843-45a9-bdaf-8abd8d619906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:47:17 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0faac0ca-61ce-4451-9169-d5697f7441e6 tempest-AttachVolumeTestJSON-1147748540 None] Flow 'volume_create_manager' (ad6d5358-342c-4cce-a3cb-4bc9a4b12b6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:47:17 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-0faac0ca-61ce-4451-9169-d5697f7441e6 tempest-AttachVolumeTestJSON-1147748540 None] Created volume successfully. Sep 04 22:47:17 devstack sudo[97686]: pam_unix(sudo:session): session closed for user root Sep 04 22:47:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-aae1c535-de7d-4b3b-89b9-e8dceda82011 tempest-VolumesListAdminTestJSON-2100194842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-324a0161-1e67-4e86-a017-d8c1509aa8e0" returned: 0 in 0.780s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:47:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-aae1c535-de7d-4b3b-89b9-e8dceda82011 tempest-VolumesListAdminTestJSON-2100194842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-324a0161-1e67-4e86-a017-d8c1509aa8e0 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:47:17 devstack sudo[97695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-324a0161-1e67-4e86-a017-d8c1509aa8e0 Sep 04 22:47:17 devstack sudo[97695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:47:18 devstack sudo[97695]: pam_unix(sudo:session): session closed for user root Sep 04 22:47:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-aae1c535-de7d-4b3b-89b9-e8dceda82011 tempest-VolumesListAdminTestJSON-2100194842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-324a0161-1e67-4e86-a017-d8c1509aa8e0" returned: 0 in 0.456s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:47:18 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-aae1c535-de7d-4b3b-89b9-e8dceda82011 tempest-VolumesListAdminTestJSON-2100194842 None] Lock "cinder-quobyte-324a0161-1e67-4e86-a017-d8c1509aa8e0" released by "delete_volume" :: held 1.354s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:47:18 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-aae1c535-de7d-4b3b-89b9-e8dceda82011 tempest-VolumesListAdminTestJSON-2100194842 None] Created reservations ['4cab1a76-3032-4eae-a027-6dcf7d901a1e', '8730a3ba-38ea-42f2-ae99-acea208ddfba', 'b984d32a-3820-4652-a845-196e8a6fc407', 'b656b478-8ee4-46f9-8ccf-76d4ee526e86'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:47:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-aae1c535-de7d-4b3b-89b9-e8dceda82011 tempest-VolumesListAdminTestJSON-2100194842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:47:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-aae1c535-de7d-4b3b-89b9-e8dceda82011 tempest-VolumesListAdminTestJSON-2100194842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:47:18 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-aae1c535-de7d-4b3b-89b9-e8dceda82011 tempest-VolumesListAdminTestJSON-2100194842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:47:18 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-aae1c535-de7d-4b3b-89b9-e8dceda82011 tempest-VolumesListAdminTestJSON-2100194842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:47:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-aae1c535-de7d-4b3b-89b9-e8dceda82011 tempest-VolumesListAdminTestJSON-2100194842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:47:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-aae1c535-de7d-4b3b-89b9-e8dceda82011 tempest-VolumesListAdminTestJSON-2100194842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:47:18 devstack sudo[97698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:47:18 devstack sudo[97698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:47:18 devstack sudo[97698]: pam_unix(sudo:session): session closed for user root Sep 04 22:47:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-aae1c535-de7d-4b3b-89b9-e8dceda82011 tempest-VolumesListAdminTestJSON-2100194842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.554s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:47:18 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-aae1c535-de7d-4b3b-89b9-e8dceda82011 tempest-VolumesListAdminTestJSON-2100194842 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:47:18 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-aae1c535-de7d-4b3b-89b9-e8dceda82011 tempest-VolumesListAdminTestJSON-2100194842 None] Deleted volume successfully. Sep 04 22:47:19 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-aae1c535-de7d-4b3b-89b9-e8dceda82011 tempest-VolumesListAdminTestJSON-2100194842 None] Lock "cinder-324a0161-1e67-4e86-a017-d8c1509aa8e0-delete_volume" released by "delete_volume" :: held 2.466s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:47:19 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d647bc46-0949-45f6-adb3-f3972e5356f2 tempest-VolumesListAdminTestJSON-2100194842 None] Acquiring lock "cinder-3575d76b-b090-488f-8297-a60bd1c1c684-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:47:19 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d647bc46-0949-45f6-adb3-f3972e5356f2 tempest-VolumesListAdminTestJSON-2100194842 None] Lock "cinder-3575d76b-b090-488f-8297-a60bd1c1c684-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:47:19 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d647bc46-0949-45f6-adb3-f3972e5356f2 tempest-VolumesListAdminTestJSON-2100194842 None] Acquiring lock "cinder-quobyte-3575d76b-b090-488f-8297-a60bd1c1c684" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:47:19 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d647bc46-0949-45f6-adb3-f3972e5356f2 tempest-VolumesListAdminTestJSON-2100194842 None] Lock "cinder-quobyte-3575d76b-b090-488f-8297-a60bd1c1c684" acquired by "delete_volume" :: waited 0.042s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:47:19 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f55f71-834c-48fd-ae6b-499f2c216e5f]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:47:19 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d647bc46-0949-45f6-adb3-f3972e5356f2 tempest-VolumesListAdminTestJSON-2100194842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-3575d76b-b090-488f-8297-a60bd1c1c684 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:47:19 devstack sudo[97704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-3575d76b-b090-488f-8297-a60bd1c1c684 Sep 04 22:47:19 devstack sudo[97704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:47:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-7d088140-c197-427a-9719-a67463746951 req-767a9f8c-4539-47b3-a6ed-6350c92f7a87 tempest-AttachVolumeTestJSON-1147748540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:47:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-7d088140-c197-427a-9719-a67463746951 req-767a9f8c-4539-47b3-a6ed-6350c92f7a87 tempest-AttachVolumeTestJSON-1147748540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:47:20 devstack sudo[97704]: pam_unix(sudo:session): session closed for user root Sep 04 22:47:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d647bc46-0949-45f6-adb3-f3972e5356f2 tempest-VolumesListAdminTestJSON-2100194842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-3575d76b-b090-488f-8297-a60bd1c1c684" returned: 0 in 0.600s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:47:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d647bc46-0949-45f6-adb3-f3972e5356f2 tempest-VolumesListAdminTestJSON-2100194842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-3575d76b-b090-488f-8297-a60bd1c1c684 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:47:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-7d088140-c197-427a-9719-a67463746951 req-767a9f8c-4539-47b3-a6ed-6350c92f7a87 tempest-AttachVolumeTestJSON-1147748540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:47:20 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-7d088140-c197-427a-9719-a67463746951 req-767a9f8c-4539-47b3-a6ed-6350c92f7a87 tempest-AttachVolumeTestJSON-1147748540 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4', 'name': 'volume-6e4154d0-fd3d-40ff-8be4-d25f4c851054', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '520bf0ca-1e92-4d28-8b7c-abcbbcbeb89f', 'enforce_multipath': True} {{(pid=87576) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 22:47:20 devstack sudo[97717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-3575d76b-b090-488f-8297-a60bd1c1c684 Sep 04 22:47:20 devstack sudo[97717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:47:20 devstack cinder-volume[87576]: INFO cinder.volume.manager [req-7d088140-c197-427a-9719-a67463746951 req-767a9f8c-4539-47b3-a6ed-6350c92f7a87 tempest-AttachVolumeTestJSON-1147748540 None] attachment_update completed successfully. Sep 04 22:47:20 devstack sudo[97717]: pam_unix(sudo:session): session closed for user root Sep 04 22:47:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d647bc46-0949-45f6-adb3-f3972e5356f2 tempest-VolumesListAdminTestJSON-2100194842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-3575d76b-b090-488f-8297-a60bd1c1c684" returned: 0 in 0.650s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:47:20 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d647bc46-0949-45f6-adb3-f3972e5356f2 tempest-VolumesListAdminTestJSON-2100194842 None] Lock "cinder-quobyte-3575d76b-b090-488f-8297-a60bd1c1c684" released by "delete_volume" :: held 1.330s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:47:20 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-d647bc46-0949-45f6-adb3-f3972e5356f2 tempest-VolumesListAdminTestJSON-2100194842 None] Created reservations ['d3b5963c-5adb-4510-a8c3-85adc7c7348c', '5ad4fb5d-6efa-43a8-b25e-f46b33aa0121', '8f1f7954-9cb9-4f39-b2d9-b49ef1fd8144', '6533e142-7566-4bd8-94b8-315a253fa274'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:47:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-d647bc46-0949-45f6-adb3-f3972e5356f2 tempest-VolumesListAdminTestJSON-2100194842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:47:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-d647bc46-0949-45f6-adb3-f3972e5356f2 tempest-VolumesListAdminTestJSON-2100194842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:47:21 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-d647bc46-0949-45f6-adb3-f3972e5356f2 tempest-VolumesListAdminTestJSON-2100194842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:47:21 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-d647bc46-0949-45f6-adb3-f3972e5356f2 tempest-VolumesListAdminTestJSON-2100194842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:47:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-d647bc46-0949-45f6-adb3-f3972e5356f2 tempest-VolumesListAdminTestJSON-2100194842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:47:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d647bc46-0949-45f6-adb3-f3972e5356f2 tempest-VolumesListAdminTestJSON-2100194842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:47:21 devstack sudo[97723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:47:21 devstack sudo[97723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:47:21 devstack sudo[97723]: pam_unix(sudo:session): session closed for user root Sep 04 22:47:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d647bc46-0949-45f6-adb3-f3972e5356f2 tempest-VolumesListAdminTestJSON-2100194842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.490s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:47:21 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-d647bc46-0949-45f6-adb3-f3972e5356f2 tempest-VolumesListAdminTestJSON-2100194842 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:47:21 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-d647bc46-0949-45f6-adb3-f3972e5356f2 tempest-VolumesListAdminTestJSON-2100194842 None] Deleted volume successfully. Sep 04 22:47:21 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d647bc46-0949-45f6-adb3-f3972e5356f2 tempest-VolumesListAdminTestJSON-2100194842 None] Lock "cinder-3575d76b-b090-488f-8297-a60bd1c1c684-delete_volume" released by "delete_volume" :: held 2.364s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:47:23 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-84b1a6ea-094d-4acf-b129-7b70bb0dda0b tempest-AttachVolumeTestJSON-1147748540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:47:23 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-84b1a6ea-094d-4acf-b129-7b70bb0dda0b tempest-AttachVolumeTestJSON-1147748540 None] Flow 'volume_create_manager' (8c7c23bf-860e-4d18-831a-115aa59924ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:47:23 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-84b1a6ea-094d-4acf-b129-7b70bb0dda0b tempest-AttachVolumeTestJSON-1147748540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f8028ba-c22c-4cd5-91a2-699e38e5989e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:47:23 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-84b1a6ea-094d-4acf-b129-7b70bb0dda0b tempest-AttachVolumeTestJSON-1147748540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f8028ba-c22c-4cd5-91a2-699e38e5989e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:47:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-888302608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbacd3f7-20cb-44aa-9b37-8bc5967c3908,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='493b0f7420a046b0bd5c132949c7b031',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:47:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:47:23Z,use_quota=True,user_id='834efb407c6844138d24708f548e3d7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:47:23 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-84b1a6ea-094d-4acf-b129-7b70bb0dda0b tempest-AttachVolumeTestJSON-1147748540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c66b5428-acb2-4178-82ee-ae41cd9b794d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:47:23 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-84b1a6ea-094d-4acf-b129-7b70bb0dda0b tempest-AttachVolumeTestJSON-1147748540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c66b5428-acb2-4178-82ee-ae41cd9b794d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:47:23 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-84b1a6ea-094d-4acf-b129-7b70bb0dda0b tempest-AttachVolumeTestJSON-1147748540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8d87096-d859-4c3c-bfc8-33c5ea521380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:47:23 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-84b1a6ea-094d-4acf-b129-7b70bb0dda0b tempest-AttachVolumeTestJSON-1147748540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8d87096-d859-4c3c-bfc8-33c5ea521380) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbacd3f7-20cb-44aa-9b37-8bc5967c3908', 'volume_name': 'volume-fbacd3f7-20cb-44aa-9b37-8bc5967c3908', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:47:23 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-84b1a6ea-094d-4acf-b129-7b70bb0dda0b tempest-AttachVolumeTestJSON-1147748540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa97f258-f778-4a14-a647-1266fc47d640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:47:23 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-84b1a6ea-094d-4acf-b129-7b70bb0dda0b tempest-AttachVolumeTestJSON-1147748540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa97f258-f778-4a14-a647-1266fc47d640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:47:23 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-84b1a6ea-094d-4acf-b129-7b70bb0dda0b tempest-AttachVolumeTestJSON-1147748540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc71cfa7-15c3-4da7-8715-0974f771fcbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:47:23 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-84b1a6ea-094d-4acf-b129-7b70bb0dda0b tempest-AttachVolumeTestJSON-1147748540 None] Volume fbacd3f7-20cb-44aa-9b37-8bc5967c3908: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbacd3f7-20cb-44aa-9b37-8bc5967c3908', 'volume_size': 1} Sep 04 22:47:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-84b1a6ea-094d-4acf-b129-7b70bb0dda0b tempest-AttachVolumeTestJSON-1147748540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:47:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-84b1a6ea-094d-4acf-b129-7b70bb0dda0b tempest-AttachVolumeTestJSON-1147748540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:47:23 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-84b1a6ea-094d-4acf-b129-7b70bb0dda0b tempest-AttachVolumeTestJSON-1147748540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:47:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-888302608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbacd3f7-20cb-44aa-9b37-8bc5967c3908,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='493b0f7420a046b0bd5c132949c7b031',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:47:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:47:23Z,use_quota=True,user_id='834efb407c6844138d24708f548e3d7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:47:23 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-84b1a6ea-094d-4acf-b129-7b70bb0dda0b tempest-AttachVolumeTestJSON-1147748540 None] Creating volume fbacd3f7-20cb-44aa-9b37-8bc5967c3908 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:47:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-84b1a6ea-094d-4acf-b129-7b70bb0dda0b tempest-AttachVolumeTestJSON-1147748540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:47:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-84b1a6ea-094d-4acf-b129-7b70bb0dda0b tempest-AttachVolumeTestJSON-1147748540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:47:23 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-84b1a6ea-094d-4acf-b129-7b70bb0dda0b tempest-AttachVolumeTestJSON-1147748540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:47:23 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-84b1a6ea-094d-4acf-b129-7b70bb0dda0b tempest-AttachVolumeTestJSON-1147748540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:47:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-84b1a6ea-094d-4acf-b129-7b70bb0dda0b tempest-AttachVolumeTestJSON-1147748540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:47:23 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-84b1a6ea-094d-4acf-b129-7b70bb0dda0b tempest-AttachVolumeTestJSON-1147748540 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:47:23 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-84b1a6ea-094d-4acf-b129-7b70bb0dda0b tempest-AttachVolumeTestJSON-1147748540 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:47:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-84b1a6ea-094d-4acf-b129-7b70bb0dda0b tempest-AttachVolumeTestJSON-1147748540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fbacd3f7-20cb-44aa-9b37-8bc5967c3908 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:47:23 devstack sudo[97728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fbacd3f7-20cb-44aa-9b37-8bc5967c3908 1073741824 Sep 04 22:47:23 devstack sudo[97728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:47:24 devstack sudo[97728]: pam_unix(sudo:session): session closed for user root Sep 04 22:47:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-84b1a6ea-094d-4acf-b129-7b70bb0dda0b tempest-AttachVolumeTestJSON-1147748540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fbacd3f7-20cb-44aa-9b37-8bc5967c3908 1073741824" returned: 0 in 0.701s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:47:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-84b1a6ea-094d-4acf-b129-7b70bb0dda0b tempest-AttachVolumeTestJSON-1147748540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fbacd3f7-20cb-44aa-9b37-8bc5967c3908 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:47:24 devstack sudo[97734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fbacd3f7-20cb-44aa-9b37-8bc5967c3908 Sep 04 22:47:24 devstack sudo[97734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:47:24 devstack sudo[97734]: pam_unix(sudo:session): session closed for user root Sep 04 22:47:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-84b1a6ea-094d-4acf-b129-7b70bb0dda0b tempest-AttachVolumeTestJSON-1147748540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fbacd3f7-20cb-44aa-9b37-8bc5967c3908" returned: 0 in 0.357s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:47:24 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-84b1a6ea-094d-4acf-b129-7b70bb0dda0b tempest-AttachVolumeTestJSON-1147748540 None] <== create_volume: return (1130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:47:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-84b1a6ea-094d-4acf-b129-7b70bb0dda0b tempest-AttachVolumeTestJSON-1147748540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.134s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:47:24 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-84b1a6ea-094d-4acf-b129-7b70bb0dda0b tempest-AttachVolumeTestJSON-1147748540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc71cfa7-15c3-4da7-8715-0974f771fcbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbacd3f7-20cb-44aa-9b37-8bc5967c3908', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:47:24 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-84b1a6ea-094d-4acf-b129-7b70bb0dda0b tempest-AttachVolumeTestJSON-1147748540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cea9de03-b2c7-441c-9e8c-bd5d8277c19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:47:24 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-84b1a6ea-094d-4acf-b129-7b70bb0dda0b tempest-AttachVolumeTestJSON-1147748540 None] Volume volume-fbacd3f7-20cb-44aa-9b37-8bc5967c3908 (fbacd3f7-20cb-44aa-9b37-8bc5967c3908): created successfully Sep 04 22:47:24 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-84b1a6ea-094d-4acf-b129-7b70bb0dda0b tempest-AttachVolumeTestJSON-1147748540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cea9de03-b2c7-441c-9e8c-bd5d8277c19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:47:24 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-84b1a6ea-094d-4acf-b129-7b70bb0dda0b tempest-AttachVolumeTestJSON-1147748540 None] Flow 'volume_create_manager' (8c7c23bf-860e-4d18-831a-115aa59924ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:47:24 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-84b1a6ea-094d-4acf-b129-7b70bb0dda0b tempest-AttachVolumeTestJSON-1147748540 None] Created volume successfully. Sep 04 22:47:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-148d175e-90b2-4a0b-bd4d-bdda47a645a8 req-729d9aaf-d73b-4fdd-8a95-097ec1042d1d tempest-AttachVolumeTestJSON-1147748540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:47:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-148d175e-90b2-4a0b-bd4d-bdda47a645a8 req-729d9aaf-d73b-4fdd-8a95-097ec1042d1d tempest-AttachVolumeTestJSON-1147748540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:47:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-148d175e-90b2-4a0b-bd4d-bdda47a645a8 req-729d9aaf-d73b-4fdd-8a95-097ec1042d1d tempest-AttachVolumeTestJSON-1147748540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:47:26 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-148d175e-90b2-4a0b-bd4d-bdda47a645a8 req-729d9aaf-d73b-4fdd-8a95-097ec1042d1d tempest-AttachVolumeTestJSON-1147748540 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4', 'name': 'volume-fbacd3f7-20cb-44aa-9b37-8bc5967c3908', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0524f045-50e5-4a28-8c40-04340ed99bcb', 'enforce_multipath': True} {{(pid=87576) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 22:47:27 devstack cinder-volume[87576]: INFO cinder.volume.manager [req-148d175e-90b2-4a0b-bd4d-bdda47a645a8 req-729d9aaf-d73b-4fdd-8a95-097ec1042d1d tempest-AttachVolumeTestJSON-1147748540 None] attachment_update completed successfully. Sep 04 22:47:28 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-6db64e40-2ead-48c1-94ee-90b2e2eab324 tempest-TestServerVolumeAttachmentScenario-573049963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:47:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6db64e40-2ead-48c1-94ee-90b2e2eab324 tempest-TestServerVolumeAttachmentScenario-573049963 None] Flow 'volume_create_manager' (3f04260d-cc7a-41e0-8894-3487776426f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:47:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6db64e40-2ead-48c1-94ee-90b2e2eab324 tempest-TestServerVolumeAttachmentScenario-573049963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdb520b4-6344-40e0-b07b-f78cf7bcf57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:47:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6db64e40-2ead-48c1-94ee-90b2e2eab324 tempest-TestServerVolumeAttachmentScenario-573049963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdb520b4-6344-40e0-b07b-f78cf7bcf57f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:47:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1274702919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7a9b6df-c632-4576-90f6-3da9ae63fadf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f31d2afa4994055b1b761dfebc6efd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:47:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:47:28Z,use_quota=True,user_id='3c337f3011b94bfa9653c87a6347073d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:47:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6db64e40-2ead-48c1-94ee-90b2e2eab324 tempest-TestServerVolumeAttachmentScenario-573049963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5681142c-f678-44ab-ac58-def8979ce9e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:47:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6db64e40-2ead-48c1-94ee-90b2e2eab324 tempest-TestServerVolumeAttachmentScenario-573049963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5681142c-f678-44ab-ac58-def8979ce9e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:47:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6db64e40-2ead-48c1-94ee-90b2e2eab324 tempest-TestServerVolumeAttachmentScenario-573049963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7742bded-83fb-4670-9894-85c524bae07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:47:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6db64e40-2ead-48c1-94ee-90b2e2eab324 tempest-TestServerVolumeAttachmentScenario-573049963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7742bded-83fb-4670-9894-85c524bae07e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7a9b6df-c632-4576-90f6-3da9ae63fadf', 'volume_name': 'volume-c7a9b6df-c632-4576-90f6-3da9ae63fadf', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:47:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6db64e40-2ead-48c1-94ee-90b2e2eab324 tempest-TestServerVolumeAttachmentScenario-573049963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc46cf3d-8041-4a98-9596-1f4d136cfa50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:47:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6db64e40-2ead-48c1-94ee-90b2e2eab324 tempest-TestServerVolumeAttachmentScenario-573049963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc46cf3d-8041-4a98-9596-1f4d136cfa50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:47:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6db64e40-2ead-48c1-94ee-90b2e2eab324 tempest-TestServerVolumeAttachmentScenario-573049963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f537504-7031-4d85-9ba2-08f683ab0665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:47:28 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-6db64e40-2ead-48c1-94ee-90b2e2eab324 tempest-TestServerVolumeAttachmentScenario-573049963 None] Volume c7a9b6df-c632-4576-90f6-3da9ae63fadf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7a9b6df-c632-4576-90f6-3da9ae63fadf', 'volume_size': 1} Sep 04 22:47:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-6db64e40-2ead-48c1-94ee-90b2e2eab324 tempest-TestServerVolumeAttachmentScenario-573049963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:47:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-6db64e40-2ead-48c1-94ee-90b2e2eab324 tempest-TestServerVolumeAttachmentScenario-573049963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:47:28 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-6db64e40-2ead-48c1-94ee-90b2e2eab324 tempest-TestServerVolumeAttachmentScenario-573049963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:47:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1274702919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7a9b6df-c632-4576-90f6-3da9ae63fadf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f31d2afa4994055b1b761dfebc6efd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:47:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:47:28Z,use_quota=True,user_id='3c337f3011b94bfa9653c87a6347073d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:47:28 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-6db64e40-2ead-48c1-94ee-90b2e2eab324 tempest-TestServerVolumeAttachmentScenario-573049963 None] Creating volume c7a9b6df-c632-4576-90f6-3da9ae63fadf {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:47:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-6db64e40-2ead-48c1-94ee-90b2e2eab324 tempest-TestServerVolumeAttachmentScenario-573049963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:47:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-6db64e40-2ead-48c1-94ee-90b2e2eab324 tempest-TestServerVolumeAttachmentScenario-573049963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:47:28 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-6db64e40-2ead-48c1-94ee-90b2e2eab324 tempest-TestServerVolumeAttachmentScenario-573049963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:47:28 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-6db64e40-2ead-48c1-94ee-90b2e2eab324 tempest-TestServerVolumeAttachmentScenario-573049963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:47:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-6db64e40-2ead-48c1-94ee-90b2e2eab324 tempest-TestServerVolumeAttachmentScenario-573049963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:47:28 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-6db64e40-2ead-48c1-94ee-90b2e2eab324 tempest-TestServerVolumeAttachmentScenario-573049963 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:47:28 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-6db64e40-2ead-48c1-94ee-90b2e2eab324 tempest-TestServerVolumeAttachmentScenario-573049963 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:47:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-6db64e40-2ead-48c1-94ee-90b2e2eab324 tempest-TestServerVolumeAttachmentScenario-573049963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c7a9b6df-c632-4576-90f6-3da9ae63fadf 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:47:28 devstack sudo[97786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c7a9b6df-c632-4576-90f6-3da9ae63fadf 1073741824 Sep 04 22:47:28 devstack sudo[97786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:47:28 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-647a592c-0cdd-4f69-b11e-d91f3f303373 tempest-TestServerVolumeAttachmentScenario-573049963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:47:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-647a592c-0cdd-4f69-b11e-d91f3f303373 tempest-TestServerVolumeAttachmentScenario-573049963 None] Flow 'volume_create_manager' (67a3be0a-96cf-4b53-9c06-e7a7e48355d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:47:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-647a592c-0cdd-4f69-b11e-d91f3f303373 tempest-TestServerVolumeAttachmentScenario-573049963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5cc2583-9799-43d0-a323-e312a0a2dea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:47:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-647a592c-0cdd-4f69-b11e-d91f3f303373 tempest-TestServerVolumeAttachmentScenario-573049963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5cc2583-9799-43d0-a323-e312a0a2dea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:47:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-799942919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72ffad8d-6e1b-4310-a8fd-1040d396228d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f31d2afa4994055b1b761dfebc6efd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:47:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:47:29Z,use_quota=True,user_id='3c337f3011b94bfa9653c87a6347073d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:47:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-647a592c-0cdd-4f69-b11e-d91f3f303373 tempest-TestServerVolumeAttachmentScenario-573049963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c80080f9-b777-4086-af97-d67998ec051f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:47:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-647a592c-0cdd-4f69-b11e-d91f3f303373 tempest-TestServerVolumeAttachmentScenario-573049963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c80080f9-b777-4086-af97-d67998ec051f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:47:29 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-647a592c-0cdd-4f69-b11e-d91f3f303373 tempest-TestServerVolumeAttachmentScenario-573049963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8948decf-f113-4ff1-80f0-342b7d3728d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:47:29 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-647a592c-0cdd-4f69-b11e-d91f3f303373 tempest-TestServerVolumeAttachmentScenario-573049963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8948decf-f113-4ff1-80f0-342b7d3728d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72ffad8d-6e1b-4310-a8fd-1040d396228d', 'volume_name': 'volume-72ffad8d-6e1b-4310-a8fd-1040d396228d', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:47:29 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-647a592c-0cdd-4f69-b11e-d91f3f303373 tempest-TestServerVolumeAttachmentScenario-573049963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7984e40a-737a-44d6-b5f9-b457f5754842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:47:29 devstack sudo[97786]: pam_unix(sudo:session): session closed for user root Sep 04 22:47:29 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-647a592c-0cdd-4f69-b11e-d91f3f303373 tempest-TestServerVolumeAttachmentScenario-573049963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7984e40a-737a-44d6-b5f9-b457f5754842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:47:29 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-647a592c-0cdd-4f69-b11e-d91f3f303373 tempest-TestServerVolumeAttachmentScenario-573049963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1efd6129-cf98-4368-b35c-857c6663c269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:47:29 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-647a592c-0cdd-4f69-b11e-d91f3f303373 tempest-TestServerVolumeAttachmentScenario-573049963 None] Volume 72ffad8d-6e1b-4310-a8fd-1040d396228d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72ffad8d-6e1b-4310-a8fd-1040d396228d', 'volume_size': 1} Sep 04 22:47:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-647a592c-0cdd-4f69-b11e-d91f3f303373 tempest-TestServerVolumeAttachmentScenario-573049963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:47:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-6db64e40-2ead-48c1-94ee-90b2e2eab324 tempest-TestServerVolumeAttachmentScenario-573049963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c7a9b6df-c632-4576-90f6-3da9ae63fadf 1073741824" returned: 0 in 0.864s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:47:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-6db64e40-2ead-48c1-94ee-90b2e2eab324 tempest-TestServerVolumeAttachmentScenario-573049963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c7a9b6df-c632-4576-90f6-3da9ae63fadf {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:47:29 devstack sudo[97794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c7a9b6df-c632-4576-90f6-3da9ae63fadf Sep 04 22:47:29 devstack sudo[97794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:47:29 devstack sudo[97794]: pam_unix(sudo:session): session closed for user root Sep 04 22:47:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-6db64e40-2ead-48c1-94ee-90b2e2eab324 tempest-TestServerVolumeAttachmentScenario-573049963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c7a9b6df-c632-4576-90f6-3da9ae63fadf" returned: 0 in 0.485s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:47:29 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-6db64e40-2ead-48c1-94ee-90b2e2eab324 tempest-TestServerVolumeAttachmentScenario-573049963 None] <== create_volume: return (1425ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:47:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-6db64e40-2ead-48c1-94ee-90b2e2eab324 tempest-TestServerVolumeAttachmentScenario-573049963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.428s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:47:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-647a592c-0cdd-4f69-b11e-d91f3f303373 tempest-TestServerVolumeAttachmentScenario-573049963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.559s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:47:29 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-647a592c-0cdd-4f69-b11e-d91f3f303373 tempest-TestServerVolumeAttachmentScenario-573049963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:47:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-799942919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72ffad8d-6e1b-4310-a8fd-1040d396228d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f31d2afa4994055b1b761dfebc6efd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:47:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:47:29Z,use_quota=True,user_id='3c337f3011b94bfa9653c87a6347073d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:47:29 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-647a592c-0cdd-4f69-b11e-d91f3f303373 tempest-TestServerVolumeAttachmentScenario-573049963 None] Creating volume 72ffad8d-6e1b-4310-a8fd-1040d396228d {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:47:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-647a592c-0cdd-4f69-b11e-d91f3f303373 tempest-TestServerVolumeAttachmentScenario-573049963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:47:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-647a592c-0cdd-4f69-b11e-d91f3f303373 tempest-TestServerVolumeAttachmentScenario-573049963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:47:29 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-647a592c-0cdd-4f69-b11e-d91f3f303373 tempest-TestServerVolumeAttachmentScenario-573049963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:47:29 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-647a592c-0cdd-4f69-b11e-d91f3f303373 tempest-TestServerVolumeAttachmentScenario-573049963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:47:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-647a592c-0cdd-4f69-b11e-d91f3f303373 tempest-TestServerVolumeAttachmentScenario-573049963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:47:29 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-647a592c-0cdd-4f69-b11e-d91f3f303373 tempest-TestServerVolumeAttachmentScenario-573049963 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:47:29 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-647a592c-0cdd-4f69-b11e-d91f3f303373 tempest-TestServerVolumeAttachmentScenario-573049963 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:47:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-647a592c-0cdd-4f69-b11e-d91f3f303373 tempest-TestServerVolumeAttachmentScenario-573049963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-72ffad8d-6e1b-4310-a8fd-1040d396228d 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:47:29 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6db64e40-2ead-48c1-94ee-90b2e2eab324 tempest-TestServerVolumeAttachmentScenario-573049963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f537504-7031-4d85-9ba2-08f683ab0665) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7a9b6df-c632-4576-90f6-3da9ae63fadf', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:47:29 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6db64e40-2ead-48c1-94ee-90b2e2eab324 tempest-TestServerVolumeAttachmentScenario-573049963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a0e50c6-58f6-4924-acd1-75da00f77e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:47:29 devstack sudo[97797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-72ffad8d-6e1b-4310-a8fd-1040d396228d 1073741824 Sep 04 22:47:29 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-6db64e40-2ead-48c1-94ee-90b2e2eab324 tempest-TestServerVolumeAttachmentScenario-573049963 None] Volume volume-c7a9b6df-c632-4576-90f6-3da9ae63fadf (c7a9b6df-c632-4576-90f6-3da9ae63fadf): created successfully Sep 04 22:47:29 devstack sudo[97797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:47:29 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6db64e40-2ead-48c1-94ee-90b2e2eab324 tempest-TestServerVolumeAttachmentScenario-573049963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a0e50c6-58f6-4924-acd1-75da00f77e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:47:29 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6db64e40-2ead-48c1-94ee-90b2e2eab324 tempest-TestServerVolumeAttachmentScenario-573049963 None] Flow 'volume_create_manager' (3f04260d-cc7a-41e0-8894-3487776426f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:47:29 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-6db64e40-2ead-48c1-94ee-90b2e2eab324 tempest-TestServerVolumeAttachmentScenario-573049963 None] Created volume successfully. Sep 04 22:47:30 devstack cinder-volume[87576]: INFO cinder.volume.manager [req-bddc4b30-eae3-4252-a1e1-6798655e63af req-026defb7-ade7-442e-9427-15071b667dd3 tempest-AttachVolumeTestJSON-1147748540 None] Terminate volume connection completed successfully. Sep 04 22:47:30 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-bddc4b30-eae3-4252-a1e1-6798655e63af req-026defb7-ade7-442e-9427-15071b667dd3 tempest-AttachVolumeTestJSON-1147748540 None] Deleting attachment 520bf0ca-1e92-4d28-8b7c-abcbbcbeb89f. {{(pid=87576) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 22:47:30 devstack sudo[97797]: pam_unix(sudo:session): session closed for user root Sep 04 22:47:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-647a592c-0cdd-4f69-b11e-d91f3f303373 tempest-TestServerVolumeAttachmentScenario-573049963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-72ffad8d-6e1b-4310-a8fd-1040d396228d 1073741824" returned: 0 in 0.884s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:47:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-647a592c-0cdd-4f69-b11e-d91f3f303373 tempest-TestServerVolumeAttachmentScenario-573049963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-72ffad8d-6e1b-4310-a8fd-1040d396228d {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:47:30 devstack sudo[97832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-72ffad8d-6e1b-4310-a8fd-1040d396228d Sep 04 22:47:30 devstack sudo[97832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:47:30 devstack sudo[97832]: pam_unix(sudo:session): session closed for user root Sep 04 22:47:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-647a592c-0cdd-4f69-b11e-d91f3f303373 tempest-TestServerVolumeAttachmentScenario-573049963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-72ffad8d-6e1b-4310-a8fd-1040d396228d" returned: 0 in 0.379s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:47:30 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-647a592c-0cdd-4f69-b11e-d91f3f303373 tempest-TestServerVolumeAttachmentScenario-573049963 None] <== create_volume: return (1351ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:47:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-647a592c-0cdd-4f69-b11e-d91f3f303373 tempest-TestServerVolumeAttachmentScenario-573049963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.369s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:47:31 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-647a592c-0cdd-4f69-b11e-d91f3f303373 tempest-TestServerVolumeAttachmentScenario-573049963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1efd6129-cf98-4368-b35c-857c6663c269) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72ffad8d-6e1b-4310-a8fd-1040d396228d', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:47:31 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-647a592c-0cdd-4f69-b11e-d91f3f303373 tempest-TestServerVolumeAttachmentScenario-573049963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (984e3fee-26cb-44d5-9248-0abface87917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:47:31 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-647a592c-0cdd-4f69-b11e-d91f3f303373 tempest-TestServerVolumeAttachmentScenario-573049963 None] Volume volume-72ffad8d-6e1b-4310-a8fd-1040d396228d (72ffad8d-6e1b-4310-a8fd-1040d396228d): created successfully Sep 04 22:47:31 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-647a592c-0cdd-4f69-b11e-d91f3f303373 tempest-TestServerVolumeAttachmentScenario-573049963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (984e3fee-26cb-44d5-9248-0abface87917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:47:31 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-647a592c-0cdd-4f69-b11e-d91f3f303373 tempest-TestServerVolumeAttachmentScenario-573049963 None] Flow 'volume_create_manager' (67a3be0a-96cf-4b53-9c06-e7a7e48355d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:47:31 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-647a592c-0cdd-4f69-b11e-d91f3f303373 tempest-TestServerVolumeAttachmentScenario-573049963 None] Created volume successfully. Sep 04 22:47:32 devstack cinder-volume[87576]: INFO cinder.volume.manager [req-0ded98ca-a4a6-4cd2-a423-377daf99667e req-30a054ee-ab85-460d-8eee-e3f282659ac1 tempest-AttachVolumeTestJSON-1147748540 None] Terminate volume connection completed successfully. Sep 04 22:47:32 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-0ded98ca-a4a6-4cd2-a423-377daf99667e req-30a054ee-ab85-460d-8eee-e3f282659ac1 tempest-AttachVolumeTestJSON-1147748540 None] Deleting attachment 0524f045-50e5-4a28-8c40-04340ed99bcb. {{(pid=87576) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 22:47:37 devstack cinder-volume[87576]: DEBUG dbcounter [-] [87576] Writing DB stats cinder:SELECT=72,cinder:UPDATE=80,cinder:INSERT=22,cinder:DELETE=8 {{(pid=87576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 22:47:37 devstack cinder-volume[87576]: DEBUG dbcounter [-] [87576] Writing DB stats cinder:UPDATE=82,cinder:SELECT=91,cinder:DELETE=7,cinder:INSERT=21 {{(pid=87576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 22:47:37 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cd2a990-a15f-4c89-8802-45dc24968be7 tempest-VolumesImageMetadata-1065351027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:47:37 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-5cd2a990-a15f-4c89-8802-45dc24968be7 tempest-VolumesImageMetadata-1065351027 None] Flow 'volume_create_manager' (305d0ef4-18fe-46b8-b262-71437c283ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:47:37 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-5cd2a990-a15f-4c89-8802-45dc24968be7 tempest-VolumesImageMetadata-1065351027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6b1dbbf-10f1-4154-a22e-6aebc2d4fbf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:47:37 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-5cd2a990-a15f-4c89-8802-45dc24968be7 tempest-VolumesImageMetadata-1065351027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6b1dbbf-10f1-4154-a22e-6aebc2d4fbf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:47:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1768619027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=925ba8f2-03b1-45f9-845c-b7d78786c438,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='813f7064d6c34f48b07f2130f777e24c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:47:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:47:38Z,use_quota=True,user_id='aebd8c109dda4dd192e742b836a3ad3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:47:37 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-5cd2a990-a15f-4c89-8802-45dc24968be7 tempest-VolumesImageMetadata-1065351027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80db2977-a754-4c52-a1f8-64f4a161d6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:47:37 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-5cd2a990-a15f-4c89-8802-45dc24968be7 tempest-VolumesImageMetadata-1065351027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80db2977-a754-4c52-a1f8-64f4a161d6b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:47:37 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-5cd2a990-a15f-4c89-8802-45dc24968be7 tempest-VolumesImageMetadata-1065351027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a07867a-c0dc-4e92-b029-33dc4e3ac5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:47:37 devstack cinder-volume[87576]: DEBUG cinder.image.glance [None req-5cd2a990-a15f-4c89-8802-45dc24968be7 tempest-VolumesImageMetadata-1065351027 None] Creating Keystone auth plugin from conf {{(pid=87576) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 04 22:47:37 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-62ed02dc-aad7-4a68-a6f2-ee64dc2d3105 tempest-AttachVolumeTestJSON-1147748540 None] Acquiring lock "cinder-fbacd3f7-20cb-44aa-9b37-8bc5967c3908-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:47:37 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-62ed02dc-aad7-4a68-a6f2-ee64dc2d3105 tempest-AttachVolumeTestJSON-1147748540 None] Lock "cinder-fbacd3f7-20cb-44aa-9b37-8bc5967c3908-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:47:37 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-62ed02dc-aad7-4a68-a6f2-ee64dc2d3105 tempest-AttachVolumeTestJSON-1147748540 None] Acquiring lock "cinder-quobyte-fbacd3f7-20cb-44aa-9b37-8bc5967c3908" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:47:38 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-62ed02dc-aad7-4a68-a6f2-ee64dc2d3105 tempest-AttachVolumeTestJSON-1147748540 None] Lock "cinder-quobyte-fbacd3f7-20cb-44aa-9b37-8bc5967c3908" acquired by "delete_volume" :: waited 0.021s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:47:38 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e526a5d-da8c-4fd5-956b-2884ef587b44]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:47:38 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-62ed02dc-aad7-4a68-a6f2-ee64dc2d3105 tempest-AttachVolumeTestJSON-1147748540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fbacd3f7-20cb-44aa-9b37-8bc5967c3908 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:47:38 devstack sudo[97897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fbacd3f7-20cb-44aa-9b37-8bc5967c3908 Sep 04 22:47:38 devstack sudo[97897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:47:38 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-5cd2a990-a15f-4c89-8802-45dc24968be7 tempest-VolumesImageMetadata-1065351027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a07867a-c0dc-4e92-b029-33dc4e3ac5a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '925ba8f2-03b1-45f9-845c-b7d78786c438', 'volume_name': 'volume-925ba8f2-03b1-45f9-845c-b7d78786c438', 'volume_size': 1, 'image_id': '4f8d7a81-6282-4f52-a601-d840d8973365', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4f8d7a81-6282-4f52-a601-d840d8973365', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5d1fd1f571ef419184ac7eda6748fdd3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4f8d7a81-6282-4f52-a601-d840d8973365', 'created_at': datetime.datetime(2026, 9, 4, 20, 33, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 20, 33, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f8d7a81-6282-4f52-a601-d840d8973365/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:47:38 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-5cd2a990-a15f-4c89-8802-45dc24968be7 tempest-VolumesImageMetadata-1065351027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ce65f75-6c4f-4b16-a87e-738e906605e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:47:38 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-5cd2a990-a15f-4c89-8802-45dc24968be7 tempest-VolumesImageMetadata-1065351027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ce65f75-6c4f-4b16-a87e-738e906605e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:47:38 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-5cd2a990-a15f-4c89-8802-45dc24968be7 tempest-VolumesImageMetadata-1065351027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (419ba2a2-5b17-40bd-ab6c-88498b6dcdd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:47:38 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-5cd2a990-a15f-4c89-8802-45dc24968be7 tempest-VolumesImageMetadata-1065351027 None] Volume 925ba8f2-03b1-45f9-845c-b7d78786c438: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-925ba8f2-03b1-45f9-845c-b7d78786c438', 'volume_size': 1, 'image_id': '4f8d7a81-6282-4f52-a601-d840d8973365', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4f8d7a81-6282-4f52-a601-d840d8973365', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5d1fd1f571ef419184ac7eda6748fdd3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4f8d7a81-6282-4f52-a601-d840d8973365', 'created_at': datetime.datetime(2026, 9, 4, 20, 33, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 20, 33, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f8d7a81-6282-4f52-a601-d840d8973365/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 04 22:47:38 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cd2a990-a15f-4c89-8802-45dc24968be7 tempest-VolumesImageMetadata-1065351027 None] Trying to clone 925ba8f2-03b1-45f9-845c-b7d78786c438 from image 4f8d7a81-6282-4f52-a601-d840d8973365 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4f8d7a81-6282-4f52-a601-d840d8973365', 'metadata': {}}]). {{(pid=87576) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 04 22:47:38 devstack sudo[97897]: pam_unix(sudo:session): session closed for user root Sep 04 22:47:38 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-62ed02dc-aad7-4a68-a6f2-ee64dc2d3105 tempest-AttachVolumeTestJSON-1147748540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fbacd3f7-20cb-44aa-9b37-8bc5967c3908" returned: 0 in 0.536s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:47:38 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-62ed02dc-aad7-4a68-a6f2-ee64dc2d3105 tempest-AttachVolumeTestJSON-1147748540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fbacd3f7-20cb-44aa-9b37-8bc5967c3908 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:47:38 devstack sudo[97902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fbacd3f7-20cb-44aa-9b37-8bc5967c3908 Sep 04 22:47:38 devstack sudo[97902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:47:38 devstack cinder-volume[87576]: DEBUG cinder.image.image_utils [None req-5cd2a990-a15f-4c89-8802-45dc24968be7 tempest-VolumesImageMetadata-1065351027 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4f8d7a81-6282-4f52-a601-d840d8973365_2p0jbzbzdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87576) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 04 22:47:38 devstack cinder-volume[87576]: INFO cinder.image.image_utils [None req-5cd2a990-a15f-4c89-8802-45dc24968be7 tempest-VolumesImageMetadata-1065351027 None] Image download 20.69 MB at 20.69 MB/s Sep 04 22:47:39 devstack sudo[97902]: pam_unix(sudo:session): session closed for user root Sep 04 22:47:39 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1165680-e35b-4e7a-b0be-c94747e4fa4d]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:47:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5cd2a990-a15f-4c89-8802-45dc24968be7 tempest-VolumesImageMetadata-1065351027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f8d7a81-6282-4f52-a601-d840d8973365_2p0jbzbzdevstack@QuobyteHD {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:47:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-62ed02dc-aad7-4a68-a6f2-ee64dc2d3105 tempest-AttachVolumeTestJSON-1147748540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fbacd3f7-20cb-44aa-9b37-8bc5967c3908" returned: 0 in 0.521s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:47:39 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-62ed02dc-aad7-4a68-a6f2-ee64dc2d3105 tempest-AttachVolumeTestJSON-1147748540 None] Lock "cinder-quobyte-fbacd3f7-20cb-44aa-9b37-8bc5967c3908" released by "delete_volume" :: held 1.136s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:47:39 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-62ed02dc-aad7-4a68-a6f2-ee64dc2d3105 tempest-AttachVolumeTestJSON-1147748540 None] Created reservations ['6aa21e3f-9bbd-49db-a104-8f090b497254', '703616df-22a1-4800-b815-2a82d34f142a', '2bda2e21-c497-483f-a9d8-5840f28a5487', '0649554e-c941-4914-9ec0-403b2d919396'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:47:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-62ed02dc-aad7-4a68-a6f2-ee64dc2d3105 tempest-AttachVolumeTestJSON-1147748540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:47:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-62ed02dc-aad7-4a68-a6f2-ee64dc2d3105 tempest-AttachVolumeTestJSON-1147748540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:47:39 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-62ed02dc-aad7-4a68-a6f2-ee64dc2d3105 tempest-AttachVolumeTestJSON-1147748540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:47:39 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-62ed02dc-aad7-4a68-a6f2-ee64dc2d3105 tempest-AttachVolumeTestJSON-1147748540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:47:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-62ed02dc-aad7-4a68-a6f2-ee64dc2d3105 tempest-AttachVolumeTestJSON-1147748540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:47:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-62ed02dc-aad7-4a68-a6f2-ee64dc2d3105 tempest-AttachVolumeTestJSON-1147748540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:47:39 devstack sudo[97946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:47:39 devstack sudo[97946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:47:39 devstack sudo[97922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f8d7a81-6282-4f52-a601-d840d8973365_2p0jbzbzdevstack@QuobyteHD Sep 04 22:47:39 devstack sudo[97922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:47:39 devstack sudo[97922]: pam_unix(sudo:session): session closed for user root Sep 04 22:47:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5cd2a990-a15f-4c89-8802-45dc24968be7 tempest-VolumesImageMetadata-1065351027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f8d7a81-6282-4f52-a601-d840d8973365_2p0jbzbzdevstack@QuobyteHD" returned: 0 in 0.601s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:47:39 devstack cinder-volume[87576]: DEBUG cinder.image.image_utils [None req-5cd2a990-a15f-4c89-8802-45dc24968be7 tempest-VolumesImageMetadata-1065351027 None] Temporary image 4f8d7a81-6282-4f52-a601-d840d8973365 is fetched for user aebd8c109dda4dd192e742b836a3ad3c. {{(pid=87576) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 04 22:47:39 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7e45b4-65a2-4290-a32e-4efebe94e766]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:47:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5cd2a990-a15f-4c89-8802-45dc24968be7 tempest-VolumesImageMetadata-1065351027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f8d7a81-6282-4f52-a601-d840d8973365_2p0jbzbzdevstack@QuobyteHD {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:47:39 devstack sudo[97946]: pam_unix(sudo:session): session closed for user root Sep 04 22:47:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-62ed02dc-aad7-4a68-a6f2-ee64dc2d3105 tempest-AttachVolumeTestJSON-1147748540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.593s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:47:39 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-62ed02dc-aad7-4a68-a6f2-ee64dc2d3105 tempest-AttachVolumeTestJSON-1147748540 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:47:39 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-62ed02dc-aad7-4a68-a6f2-ee64dc2d3105 tempest-AttachVolumeTestJSON-1147748540 None] Deleted volume successfully. Sep 04 22:47:39 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-62ed02dc-aad7-4a68-a6f2-ee64dc2d3105 tempest-AttachVolumeTestJSON-1147748540 None] Lock "cinder-fbacd3f7-20cb-44aa-9b37-8bc5967c3908-delete_volume" released by "delete_volume" :: held 2.053s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:47:40 devstack sudo[97972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f8d7a81-6282-4f52-a601-d840d8973365_2p0jbzbzdevstack@QuobyteHD Sep 04 22:47:40 devstack sudo[97972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:47:40 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-8adb55af-dc37-4516-8239-1fa767231c8a tempest-AttachVolumeTestJSON-1147748540 None] Acquiring lock "cinder-6e4154d0-fd3d-40ff-8be4-d25f4c851054-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:47:40 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-8adb55af-dc37-4516-8239-1fa767231c8a tempest-AttachVolumeTestJSON-1147748540 None] Lock "cinder-6e4154d0-fd3d-40ff-8be4-d25f4c851054-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:47:40 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-8adb55af-dc37-4516-8239-1fa767231c8a tempest-AttachVolumeTestJSON-1147748540 None] Acquiring lock "cinder-quobyte-6e4154d0-fd3d-40ff-8be4-d25f4c851054" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:47:40 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-8adb55af-dc37-4516-8239-1fa767231c8a tempest-AttachVolumeTestJSON-1147748540 None] Lock "cinder-quobyte-6e4154d0-fd3d-40ff-8be4-d25f4c851054" acquired by "delete_volume" :: waited 0.042s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:47:40 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[912a7fea-e599-4cf1-8f76-ae6e5b9de6d7]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:47:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-8adb55af-dc37-4516-8239-1fa767231c8a tempest-AttachVolumeTestJSON-1147748540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e4154d0-fd3d-40ff-8be4-d25f4c851054 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:47:40 devstack sudo[97972]: pam_unix(sudo:session): session closed for user root Sep 04 22:47:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5cd2a990-a15f-4c89-8802-45dc24968be7 tempest-VolumesImageMetadata-1065351027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f8d7a81-6282-4f52-a601-d840d8973365_2p0jbzbzdevstack@QuobyteHD" returned: 0 in 0.996s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:47:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-5cd2a990-a15f-4c89-8802-45dc24968be7 tempest-VolumesImageMetadata-1065351027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:47:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-5cd2a990-a15f-4c89-8802-45dc24968be7 tempest-VolumesImageMetadata-1065351027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:47:40 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-5cd2a990-a15f-4c89-8802-45dc24968be7 tempest-VolumesImageMetadata-1065351027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:47:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1768619027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=925ba8f2-03b1-45f9-845c-b7d78786c438,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='813f7064d6c34f48b07f2130f777e24c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:47:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:47:38Z,use_quota=True,user_id='aebd8c109dda4dd192e742b836a3ad3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:47:40 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-5cd2a990-a15f-4c89-8802-45dc24968be7 tempest-VolumesImageMetadata-1065351027 None] Creating volume 925ba8f2-03b1-45f9-845c-b7d78786c438 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:47:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-5cd2a990-a15f-4c89-8802-45dc24968be7 tempest-VolumesImageMetadata-1065351027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:47:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-5cd2a990-a15f-4c89-8802-45dc24968be7 tempest-VolumesImageMetadata-1065351027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:47:40 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-5cd2a990-a15f-4c89-8802-45dc24968be7 tempest-VolumesImageMetadata-1065351027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:47:40 devstack sudo[97987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e4154d0-fd3d-40ff-8be4-d25f4c851054 Sep 04 22:47:40 devstack sudo[97987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:47:40 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-5cd2a990-a15f-4c89-8802-45dc24968be7 tempest-VolumesImageMetadata-1065351027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:47:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-5cd2a990-a15f-4c89-8802-45dc24968be7 tempest-VolumesImageMetadata-1065351027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:47:40 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-5cd2a990-a15f-4c89-8802-45dc24968be7 tempest-VolumesImageMetadata-1065351027 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:47:40 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-5cd2a990-a15f-4c89-8802-45dc24968be7 tempest-VolumesImageMetadata-1065351027 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:47:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5cd2a990-a15f-4c89-8802-45dc24968be7 tempest-VolumesImageMetadata-1065351027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-925ba8f2-03b1-45f9-845c-b7d78786c438 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:47:41 devstack sudo[97991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-925ba8f2-03b1-45f9-845c-b7d78786c438 1073741824 Sep 04 22:47:41 devstack sudo[97991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:47:41 devstack sudo[97987]: pam_unix(sudo:session): session closed for user root Sep 04 22:47:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-8adb55af-dc37-4516-8239-1fa767231c8a tempest-AttachVolumeTestJSON-1147748540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e4154d0-fd3d-40ff-8be4-d25f4c851054" returned: 0 in 0.962s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:47:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-8adb55af-dc37-4516-8239-1fa767231c8a tempest-AttachVolumeTestJSON-1147748540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e4154d0-fd3d-40ff-8be4-d25f4c851054 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:47:41 devstack sudo[98000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e4154d0-fd3d-40ff-8be4-d25f4c851054 Sep 04 22:47:41 devstack sudo[98000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:47:41 devstack sudo[97991]: pam_unix(sudo:session): session closed for user root Sep 04 22:47:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5cd2a990-a15f-4c89-8802-45dc24968be7 tempest-VolumesImageMetadata-1065351027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-925ba8f2-03b1-45f9-845c-b7d78786c438 1073741824" returned: 0 in 0.938s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:47:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5cd2a990-a15f-4c89-8802-45dc24968be7 tempest-VolumesImageMetadata-1065351027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-925ba8f2-03b1-45f9-845c-b7d78786c438 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:47:41 devstack sudo[98003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-925ba8f2-03b1-45f9-845c-b7d78786c438 Sep 04 22:47:41 devstack sudo[98003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:47:42 devstack sudo[98000]: pam_unix(sudo:session): session closed for user root Sep 04 22:47:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-8adb55af-dc37-4516-8239-1fa767231c8a tempest-AttachVolumeTestJSON-1147748540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e4154d0-fd3d-40ff-8be4-d25f4c851054" returned: 0 in 0.426s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:47:42 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-8adb55af-dc37-4516-8239-1fa767231c8a tempest-AttachVolumeTestJSON-1147748540 None] Lock "cinder-quobyte-6e4154d0-fd3d-40ff-8be4-d25f4c851054" released by "delete_volume" :: held 1.482s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:47:42 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-8adb55af-dc37-4516-8239-1fa767231c8a tempest-AttachVolumeTestJSON-1147748540 None] Created reservations ['b28f2656-25f5-4c44-91bd-d418b357acae', '352dcdef-53fd-4bc4-a800-1f3d8bd630db', 'd0667c1a-0a60-4541-b9b3-bb9d028c1ed4', 'c8bfab53-3e59-472c-a1ca-5b8262c13720'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:47:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-8adb55af-dc37-4516-8239-1fa767231c8a tempest-AttachVolumeTestJSON-1147748540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:47:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-8adb55af-dc37-4516-8239-1fa767231c8a tempest-AttachVolumeTestJSON-1147748540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:47:42 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-8adb55af-dc37-4516-8239-1fa767231c8a tempest-AttachVolumeTestJSON-1147748540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:47:42 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-8adb55af-dc37-4516-8239-1fa767231c8a tempest-AttachVolumeTestJSON-1147748540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:47:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-8adb55af-dc37-4516-8239-1fa767231c8a tempest-AttachVolumeTestJSON-1147748540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:47:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-8adb55af-dc37-4516-8239-1fa767231c8a tempest-AttachVolumeTestJSON-1147748540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:47:42 devstack sudo[98006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:47:42 devstack sudo[98006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:47:42 devstack sudo[98003]: pam_unix(sudo:session): session closed for user root Sep 04 22:47:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5cd2a990-a15f-4c89-8802-45dc24968be7 tempest-VolumesImageMetadata-1065351027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-925ba8f2-03b1-45f9-845c-b7d78786c438" returned: 0 in 0.448s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:47:42 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-5cd2a990-a15f-4c89-8802-45dc24968be7 tempest-VolumesImageMetadata-1065351027 None] <== create_volume: return (1478ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:47:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-5cd2a990-a15f-4c89-8802-45dc24968be7 tempest-VolumesImageMetadata-1065351027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.484s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:47:42 devstack cinder-volume[87576]: DEBUG cinder.volume.volume_utils [None req-5cd2a990-a15f-4c89-8802-45dc24968be7 tempest-VolumesImageMetadata-1065351027 None] Attempting download of 4f8d7a81-6282-4f52-a601-d840d8973365 ((None, [{'url': 'file:///opt/stack/data/glance/images/4f8d7a81-6282-4f52-a601-d840d8973365', 'metadata': {}}])) to volume 925ba8f2-03b1-45f9-845c-b7d78786c438. {{(pid=87576) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 04 22:47:42 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c040da-aa14-467e-9e15-f55e56f27a6c]: (4, 'raw') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:47:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5cd2a990-a15f-4c89-8802-45dc24968be7 tempest-VolumesImageMetadata-1065351027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4f8d7a81-6282-4f52-a601-d840d8973365_rzvz9yyo {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:47:42 devstack sudo[98006]: pam_unix(sudo:session): session closed for user root Sep 04 22:47:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-8adb55af-dc37-4516-8239-1fa767231c8a tempest-AttachVolumeTestJSON-1147748540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.370s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:47:42 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-8adb55af-dc37-4516-8239-1fa767231c8a tempest-AttachVolumeTestJSON-1147748540 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:47:42 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-8adb55af-dc37-4516-8239-1fa767231c8a tempest-AttachVolumeTestJSON-1147748540 None] Deleted volume successfully. Sep 04 22:47:42 devstack sudo[98009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4f8d7a81-6282-4f52-a601-d840d8973365_rzvz9yyo Sep 04 22:47:42 devstack sudo[98009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:47:42 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-8adb55af-dc37-4516-8239-1fa767231c8a tempest-AttachVolumeTestJSON-1147748540 None] Lock "cinder-6e4154d0-fd3d-40ff-8be4-d25f4c851054-delete_volume" released by "delete_volume" :: held 2.250s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:47:42 devstack sudo[98009]: pam_unix(sudo:session): session closed for user root Sep 04 22:47:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5cd2a990-a15f-4c89-8802-45dc24968be7 tempest-VolumesImageMetadata-1065351027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4f8d7a81-6282-4f52-a601-d840d8973365_rzvz9yyo" returned: 0 in 0.433s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:47:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5cd2a990-a15f-4c89-8802-45dc24968be7 tempest-VolumesImageMetadata-1065351027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4f8d7a81-6282-4f52-a601-d840d8973365_rzvz9yyo {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:47:43 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-cb0f515e-e757-479c-8554-244a4552bc3f tempest-AttachVolumeTestJSON-1147748540 None] Acquiring lock "cinder-835ac009-3ab0-4394-9610-dd40ebca0fd6-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:47:43 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-cb0f515e-e757-479c-8554-244a4552bc3f tempest-AttachVolumeTestJSON-1147748540 None] Lock "cinder-835ac009-3ab0-4394-9610-dd40ebca0fd6-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:47:43 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-cb0f515e-e757-479c-8554-244a4552bc3f tempest-AttachVolumeTestJSON-1147748540 None] Acquiring lock "cinder-quobyte-835ac009-3ab0-4394-9610-dd40ebca0fd6" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:47:43 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-cb0f515e-e757-479c-8554-244a4552bc3f tempest-AttachVolumeTestJSON-1147748540 None] Lock "cinder-quobyte-835ac009-3ab0-4394-9610-dd40ebca0fd6" acquired by "delete_volume" :: waited 0.037s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:47:43 devstack sudo[98021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4f8d7a81-6282-4f52-a601-d840d8973365_rzvz9yyo Sep 04 22:47:43 devstack sudo[98021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:47:43 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1cb7be-c1dd-4bb2-bb51-6444fc289b4c]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:47:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-cb0f515e-e757-479c-8554-244a4552bc3f tempest-AttachVolumeTestJSON-1147748540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-835ac009-3ab0-4394-9610-dd40ebca0fd6 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:47:43 devstack sudo[98023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-835ac009-3ab0-4394-9610-dd40ebca0fd6 Sep 04 22:47:43 devstack sudo[98023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:47:43 devstack sudo[98021]: pam_unix(sudo:session): session closed for user root Sep 04 22:47:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5cd2a990-a15f-4c89-8802-45dc24968be7 tempest-VolumesImageMetadata-1065351027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4f8d7a81-6282-4f52-a601-d840d8973365_rzvz9yyo" returned: 1 in 0.713s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:47:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5cd2a990-a15f-4c89-8802-45dc24968be7 tempest-VolumesImageMetadata-1065351027 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4f8d7a81-6282-4f52-a601-d840d8973365_rzvz9yyo' failed. Not Retrying. {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 22:47:43 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5823243-240f-4443-89a5-c4056f9a2863]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:47:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5cd2a990-a15f-4c89-8802-45dc24968be7 tempest-VolumesImageMetadata-1065351027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f8d7a81-6282-4f52-a601-d840d8973365_2p0jbzbzdevstack@QuobyteHD {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:47:43 devstack sudo[98032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f8d7a81-6282-4f52-a601-d840d8973365_2p0jbzbzdevstack@QuobyteHD Sep 04 22:47:43 devstack sudo[98032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:47:44 devstack sudo[98023]: pam_unix(sudo:session): session closed for user root Sep 04 22:47:44 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-cb0f515e-e757-479c-8554-244a4552bc3f tempest-AttachVolumeTestJSON-1147748540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-835ac009-3ab0-4394-9610-dd40ebca0fd6" returned: 0 in 0.805s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:47:44 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-cb0f515e-e757-479c-8554-244a4552bc3f tempest-AttachVolumeTestJSON-1147748540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-835ac009-3ab0-4394-9610-dd40ebca0fd6 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:47:44 devstack sudo[98038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-835ac009-3ab0-4394-9610-dd40ebca0fd6 Sep 04 22:47:44 devstack sudo[98038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:47:44 devstack sudo[98032]: pam_unix(sudo:session): session closed for user root Sep 04 22:47:44 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5cd2a990-a15f-4c89-8802-45dc24968be7 tempest-VolumesImageMetadata-1065351027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f8d7a81-6282-4f52-a601-d840d8973365_2p0jbzbzdevstack@QuobyteHD" returned: 0 in 0.550s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:47:44 devstack cinder-volume[87576]: DEBUG cinder.image.image_utils [None req-5cd2a990-a15f-4c89-8802-45dc24968be7 tempest-VolumesImageMetadata-1065351027 None] 4f8d7a81-6282-4f52-a601-d840d8973365 was qcow2, converting to qcow2 {{(pid=87576) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 04 22:47:44 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5cd2a990-a15f-4c89-8802-45dc24968be7 tempest-VolumesImageMetadata-1065351027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4f8d7a81-6282-4f52-a601-d840d8973365_2p0jbzbzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-925ba8f2-03b1-45f9-845c-b7d78786c438 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:47:44 devstack sudo[98046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4f8d7a81-6282-4f52-a601-d840d8973365_2p0jbzbzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-925ba8f2-03b1-45f9-845c-b7d78786c438 Sep 04 22:47:44 devstack sudo[98046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:47:44 devstack sudo[98038]: pam_unix(sudo:session): session closed for user root Sep 04 22:47:44 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-cb0f515e-e757-479c-8554-244a4552bc3f tempest-AttachVolumeTestJSON-1147748540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-835ac009-3ab0-4394-9610-dd40ebca0fd6" returned: 0 in 0.515s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:47:44 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-cb0f515e-e757-479c-8554-244a4552bc3f tempest-AttachVolumeTestJSON-1147748540 None] Lock "cinder-quobyte-835ac009-3ab0-4394-9610-dd40ebca0fd6" released by "delete_volume" :: held 1.439s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:47:44 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-cb0f515e-e757-479c-8554-244a4552bc3f tempest-AttachVolumeTestJSON-1147748540 None] Created reservations ['3538fbe6-0a7f-41f1-ad6a-a462c680b947', 'f579f15e-5658-444a-94b9-bd916bbf8705', 'd230fa3a-fc51-4042-a9d8-5f8a43e91308', 'c30ce722-6477-46e6-beeb-f1d76485f037'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:47:44 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-cb0f515e-e757-479c-8554-244a4552bc3f tempest-AttachVolumeTestJSON-1147748540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:47:44 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-cb0f515e-e757-479c-8554-244a4552bc3f tempest-AttachVolumeTestJSON-1147748540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:47:44 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-cb0f515e-e757-479c-8554-244a4552bc3f tempest-AttachVolumeTestJSON-1147748540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:47:44 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-cb0f515e-e757-479c-8554-244a4552bc3f tempest-AttachVolumeTestJSON-1147748540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:47:44 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-cb0f515e-e757-479c-8554-244a4552bc3f tempest-AttachVolumeTestJSON-1147748540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:47:44 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-cb0f515e-e757-479c-8554-244a4552bc3f tempest-AttachVolumeTestJSON-1147748540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:47:44 devstack sudo[98053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:47:44 devstack sudo[98053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:47:45 devstack sudo[98053]: pam_unix(sudo:session): session closed for user root Sep 04 22:47:45 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-cb0f515e-e757-479c-8554-244a4552bc3f tempest-AttachVolumeTestJSON-1147748540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.423s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:47:45 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-cb0f515e-e757-479c-8554-244a4552bc3f tempest-AttachVolumeTestJSON-1147748540 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:47:45 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-cb0f515e-e757-479c-8554-244a4552bc3f tempest-AttachVolumeTestJSON-1147748540 None] Deleted volume successfully. Sep 04 22:47:45 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-cb0f515e-e757-479c-8554-244a4552bc3f tempest-AttachVolumeTestJSON-1147748540 None] Lock "cinder-835ac009-3ab0-4394-9610-dd40ebca0fd6-delete_volume" released by "delete_volume" :: held 2.309s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:47:46 devstack sudo[98046]: pam_unix(sudo:session): session closed for user root Sep 04 22:47:46 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5cd2a990-a15f-4c89-8802-45dc24968be7 tempest-VolumesImageMetadata-1065351027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4f8d7a81-6282-4f52-a601-d840d8973365_2p0jbzbzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-925ba8f2-03b1-45f9-845c-b7d78786c438" returned: 0 in 2.458s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:47:46 devstack cinder-volume[87576]: DEBUG cinder.image.image_utils [None req-5cd2a990-a15f-4c89-8802-45dc24968be7 tempest-VolumesImageMetadata-1065351027 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4f8d7a81-6282-4f52-a601-d840d8973365_2p0jbzbzdevstack@QuobyteHD, size 112.00 MB, duration 2.46 sec, destination /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-925ba8f2-03b1-45f9-845c-b7d78786c438 {{(pid=87576) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 22:47:46 devstack cinder-volume[87576]: INFO cinder.image.image_utils [None req-5cd2a990-a15f-4c89-8802-45dc24968be7 tempest-VolumesImageMetadata-1065351027 None] Converted 112.00 MB image at 45.54 MB/s Sep 04 22:47:46 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5cd2a990-a15f-4c89-8802-45dc24968be7 tempest-VolumesImageMetadata-1065351027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-925ba8f2-03b1-45f9-845c-b7d78786c438 1G {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:47:46 devstack sudo[98072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-925ba8f2-03b1-45f9-845c-b7d78786c438 1G Sep 04 22:47:46 devstack sudo[98072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:47:47 devstack sudo[98072]: pam_unix(sudo:session): session closed for user root Sep 04 22:47:47 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5cd2a990-a15f-4c89-8802-45dc24968be7 tempest-VolumesImageMetadata-1065351027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-925ba8f2-03b1-45f9-845c-b7d78786c438 1G" returned: 0 in 0.450s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:47:47 devstack cinder-volume[87576]: DEBUG cinder.volume.volume_utils [None req-5cd2a990-a15f-4c89-8802-45dc24968be7 tempest-VolumesImageMetadata-1065351027 None] Downloaded image 4f8d7a81-6282-4f52-a601-d840d8973365 ((None, [{'url': 'file:///opt/stack/data/glance/images/4f8d7a81-6282-4f52-a601-d840d8973365', 'metadata': {}}])) to volume 925ba8f2-03b1-45f9-845c-b7d78786c438 successfully. {{(pid=87576) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 04 22:47:47 devstack cinder-volume[87576]: DEBUG cinder.image.image_utils [None req-5cd2a990-a15f-4c89-8802-45dc24968be7 tempest-VolumesImageMetadata-1065351027 None] Temporary image 4f8d7a81-6282-4f52-a601-d840d8973365 for user aebd8c109dda4dd192e742b836a3ad3c is deleted. {{(pid=87576) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 04 22:47:47 devstack cinder-volume[87576]: DEBUG cinder.volume.volume_utils [None req-5cd2a990-a15f-4c89-8802-45dc24968be7 tempest-VolumesImageMetadata-1065351027 None] Marking volume 925ba8f2-03b1-45f9-845c-b7d78786c438 as bootable. {{(pid=87576) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 04 22:47:47 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cd2a990-a15f-4c89-8802-45dc24968be7 tempest-VolumesImageMetadata-1065351027 None] Copying metadata from image 4f8d7a81-6282-4f52-a601-d840d8973365 to 925ba8f2-03b1-45f9-845c-b7d78786c438. {{(pid=87576) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 04 22:47:47 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cd2a990-a15f-4c89-8802-45dc24968be7 tempest-VolumesImageMetadata-1065351027 None] Creating volume glance metadata for volume 925ba8f2-03b1-45f9-845c-b7d78786c438 backed by image 4f8d7a81-6282-4f52-a601-d840d8973365 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4f8d7a81-6282-4f52-a601-d840d8973365', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87576) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 04 22:47:47 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-5cd2a990-a15f-4c89-8802-45dc24968be7 tempest-VolumesImageMetadata-1065351027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (419ba2a2-5b17-40bd-ab6c-88498b6dcdd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-925ba8f2-03b1-45f9-845c-b7d78786c438', 'volume_size': 1, 'image_id': '4f8d7a81-6282-4f52-a601-d840d8973365', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4f8d7a81-6282-4f52-a601-d840d8973365', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5d1fd1f571ef419184ac7eda6748fdd3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4f8d7a81-6282-4f52-a601-d840d8973365', 'created_at': datetime.datetime(2026, 9, 4, 20, 33, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 20, 33, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f8d7a81-6282-4f52-a601-d840d8973365/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:47:47 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-5cd2a990-a15f-4c89-8802-45dc24968be7 tempest-VolumesImageMetadata-1065351027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfe27fb5-3deb-4c27-87ec-8549ab6d07c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:47:47 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-5cd2a990-a15f-4c89-8802-45dc24968be7 tempest-VolumesImageMetadata-1065351027 None] Volume volume-925ba8f2-03b1-45f9-845c-b7d78786c438 (925ba8f2-03b1-45f9-845c-b7d78786c438): created successfully Sep 04 22:47:47 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-5cd2a990-a15f-4c89-8802-45dc24968be7 tempest-VolumesImageMetadata-1065351027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfe27fb5-3deb-4c27-87ec-8549ab6d07c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:47:47 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-5cd2a990-a15f-4c89-8802-45dc24968be7 tempest-VolumesImageMetadata-1065351027 None] Flow 'volume_create_manager' (305d0ef4-18fe-46b8-b262-71437c283ef0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:47:47 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-5cd2a990-a15f-4c89-8802-45dc24968be7 tempest-VolumesImageMetadata-1065351027 None] Created volume successfully. Sep 04 22:47:48 devstack cinder-volume[87576]: INFO cinder.volume.manager [req-364eec8a-5dbf-4b6d-a6f5-eaf5cd06f293 req-c47695a8-7d28-4fb2-b2e3-bf124780626d tempest-TestShelveInstance-1943220238 None] Terminate volume connection completed successfully. Sep 04 22:47:48 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-364eec8a-5dbf-4b6d-a6f5-eaf5cd06f293 req-c47695a8-7d28-4fb2-b2e3-bf124780626d tempest-TestShelveInstance-1943220238 None] Deleting attachment 7bebe5ac-ab34-4ec4-8a00-1cdccce0f2bc. {{(pid=87576) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 22:47:48 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-a07cc988-abda-4e11-95b3-aba19385fbd0 tempest-VolumesImageMetadata-1065351027 None] Acquiring lock "cinder-925ba8f2-03b1-45f9-845c-b7d78786c438-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:47:48 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-a07cc988-abda-4e11-95b3-aba19385fbd0 tempest-VolumesImageMetadata-1065351027 None] Lock "cinder-925ba8f2-03b1-45f9-845c-b7d78786c438-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:47:48 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-a07cc988-abda-4e11-95b3-aba19385fbd0 tempest-VolumesImageMetadata-1065351027 None] Acquiring lock "cinder-quobyte-925ba8f2-03b1-45f9-845c-b7d78786c438" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:47:48 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-a07cc988-abda-4e11-95b3-aba19385fbd0 tempest-VolumesImageMetadata-1065351027 None] Lock "cinder-quobyte-925ba8f2-03b1-45f9-845c-b7d78786c438" acquired by "delete_volume" :: waited 0.059s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:47:48 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4dbcb2c-390d-4d2b-8286-8303fdb3ae6c]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:47:48 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a07cc988-abda-4e11-95b3-aba19385fbd0 tempest-VolumesImageMetadata-1065351027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-925ba8f2-03b1-45f9-845c-b7d78786c438 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:47:49 devstack sudo[98098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-925ba8f2-03b1-45f9-845c-b7d78786c438 Sep 04 22:47:49 devstack sudo[98098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:47:49 devstack sudo[98098]: pam_unix(sudo:session): session closed for user root Sep 04 22:47:49 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a07cc988-abda-4e11-95b3-aba19385fbd0 tempest-VolumesImageMetadata-1065351027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-925ba8f2-03b1-45f9-845c-b7d78786c438" returned: 0 in 0.693s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:47:49 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a07cc988-abda-4e11-95b3-aba19385fbd0 tempest-VolumesImageMetadata-1065351027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-925ba8f2-03b1-45f9-845c-b7d78786c438 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:47:49 devstack sudo[98103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-925ba8f2-03b1-45f9-845c-b7d78786c438 Sep 04 22:47:49 devstack sudo[98103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:47:49 devstack sudo[98103]: pam_unix(sudo:session): session closed for user root Sep 04 22:47:49 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a07cc988-abda-4e11-95b3-aba19385fbd0 tempest-VolumesImageMetadata-1065351027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-925ba8f2-03b1-45f9-845c-b7d78786c438" returned: 0 in 0.461s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:47:49 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-a07cc988-abda-4e11-95b3-aba19385fbd0 tempest-VolumesImageMetadata-1065351027 None] Lock "cinder-quobyte-925ba8f2-03b1-45f9-845c-b7d78786c438" released by "delete_volume" :: held 1.232s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:47:49 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-a07cc988-abda-4e11-95b3-aba19385fbd0 tempest-VolumesImageMetadata-1065351027 None] Created reservations ['cba5ab39-0fe4-4e6c-9726-fd23e74fffb0', 'e16759ea-c68f-41b0-b6d3-6feecad45f7d', '6249c112-3849-4fde-8a68-d6a6f4207cef', '79b3daf1-3209-43f2-acb0-060e46e050f4'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:47:50 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-a07cc988-abda-4e11-95b3-aba19385fbd0 tempest-VolumesImageMetadata-1065351027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:47:50 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-a07cc988-abda-4e11-95b3-aba19385fbd0 tempest-VolumesImageMetadata-1065351027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:47:50 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-a07cc988-abda-4e11-95b3-aba19385fbd0 tempest-VolumesImageMetadata-1065351027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:47:50 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-a07cc988-abda-4e11-95b3-aba19385fbd0 tempest-VolumesImageMetadata-1065351027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:47:50 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-a07cc988-abda-4e11-95b3-aba19385fbd0 tempest-VolumesImageMetadata-1065351027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:47:50 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a07cc988-abda-4e11-95b3-aba19385fbd0 tempest-VolumesImageMetadata-1065351027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:47:50 devstack sudo[98107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:47:50 devstack sudo[98107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:47:50 devstack sudo[98107]: pam_unix(sudo:session): session closed for user root Sep 04 22:47:50 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a07cc988-abda-4e11-95b3-aba19385fbd0 tempest-VolumesImageMetadata-1065351027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.302s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:47:50 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-a07cc988-abda-4e11-95b3-aba19385fbd0 tempest-VolumesImageMetadata-1065351027 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:47:50 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-a07cc988-abda-4e11-95b3-aba19385fbd0 tempest-VolumesImageMetadata-1065351027 None] Deleted volume successfully. Sep 04 22:47:50 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-a07cc988-abda-4e11-95b3-aba19385fbd0 tempest-VolumesImageMetadata-1065351027 None] Lock "cinder-925ba8f2-03b1-45f9-845c-b7d78786c438-delete_volume" released by "delete_volume" :: held 1.861s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:47:51 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-1a58b4b1-98fb-4818-b2ba-4b9fff936d69 req-d16e7e89-ffbe-40e3-a9f6-c3b5b3043f2d tempest-TestShelveInstance-1943220238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:47:51 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-1a58b4b1-98fb-4818-b2ba-4b9fff936d69 req-d16e7e89-ffbe-40e3-a9f6-c3b5b3043f2d tempest-TestShelveInstance-1943220238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:47:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-1a58b4b1-98fb-4818-b2ba-4b9fff936d69 req-d16e7e89-ffbe-40e3-a9f6-c3b5b3043f2d tempest-TestShelveInstance-1943220238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:47:52 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-1a58b4b1-98fb-4818-b2ba-4b9fff936d69 req-d16e7e89-ffbe-40e3-a9f6-c3b5b3043f2d tempest-TestShelveInstance-1943220238 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4', 'name': 'volume-031d7a31-f8fa-4263-b59c-7878b17ae9ca', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '22d84ed7-dac7-426e-8598-56c6bbb47a65', 'enforce_multipath': True} {{(pid=87576) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 22:47:52 devstack cinder-volume[87576]: INFO cinder.volume.manager [req-1a58b4b1-98fb-4818-b2ba-4b9fff936d69 req-d16e7e89-ffbe-40e3-a9f6-c3b5b3043f2d tempest-TestShelveInstance-1943220238 None] attachment_update completed successfully. Sep 04 22:47:55 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8e854de-3854-4b82-9b23-bf4e6df1e585 tempest-VolumesDeleteCascade-1845763094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:47:55 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-a8e854de-3854-4b82-9b23-bf4e6df1e585 tempest-VolumesDeleteCascade-1845763094 None] Flow 'volume_create_manager' (ba621d59-0ecd-48ec-b74e-a775066e46ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:47:55 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-a8e854de-3854-4b82-9b23-bf4e6df1e585 tempest-VolumesDeleteCascade-1845763094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca79ebbc-a404-4267-a9f8-5cc73c9d6f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:47:55 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-a8e854de-3854-4b82-9b23-bf4e6df1e585 tempest-VolumesDeleteCascade-1845763094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca79ebbc-a404-4267-a9f8-5cc73c9d6f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:47:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-836236868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be0ecd65-d241-42f0-b6cd-00a298729f6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52a95dfa6d9d44a79a69ab6ee4a56355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:47:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:47:55Z,use_quota=True,user_id='bc0860ddded44839b1cb824a29e3dd21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:47:55 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-a8e854de-3854-4b82-9b23-bf4e6df1e585 tempest-VolumesDeleteCascade-1845763094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb3f890f-4b68-44c9-abbe-5942e49d67ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:47:55 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-a8e854de-3854-4b82-9b23-bf4e6df1e585 tempest-VolumesDeleteCascade-1845763094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb3f890f-4b68-44c9-abbe-5942e49d67ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:47:55 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-a8e854de-3854-4b82-9b23-bf4e6df1e585 tempest-VolumesDeleteCascade-1845763094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b7273fd-8601-4e00-84a1-c2de673445e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:47:55 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-a8e854de-3854-4b82-9b23-bf4e6df1e585 tempest-VolumesDeleteCascade-1845763094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b7273fd-8601-4e00-84a1-c2de673445e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be0ecd65-d241-42f0-b6cd-00a298729f6a', 'volume_name': 'volume-be0ecd65-d241-42f0-b6cd-00a298729f6a', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:47:55 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-a8e854de-3854-4b82-9b23-bf4e6df1e585 tempest-VolumesDeleteCascade-1845763094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20de20fa-20dc-4d7e-9d13-4394cc8494be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:47:55 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-a8e854de-3854-4b82-9b23-bf4e6df1e585 tempest-VolumesDeleteCascade-1845763094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20de20fa-20dc-4d7e-9d13-4394cc8494be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:47:55 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-a8e854de-3854-4b82-9b23-bf4e6df1e585 tempest-VolumesDeleteCascade-1845763094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dbc7e2d-132a-4225-a5a0-e09da106bc09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:47:55 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-a8e854de-3854-4b82-9b23-bf4e6df1e585 tempest-VolumesDeleteCascade-1845763094 None] Volume be0ecd65-d241-42f0-b6cd-00a298729f6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be0ecd65-d241-42f0-b6cd-00a298729f6a', 'volume_size': 1} Sep 04 22:47:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-a8e854de-3854-4b82-9b23-bf4e6df1e585 tempest-VolumesDeleteCascade-1845763094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:47:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-a8e854de-3854-4b82-9b23-bf4e6df1e585 tempest-VolumesDeleteCascade-1845763094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:47:55 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-a8e854de-3854-4b82-9b23-bf4e6df1e585 tempest-VolumesDeleteCascade-1845763094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:47:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-836236868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be0ecd65-d241-42f0-b6cd-00a298729f6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52a95dfa6d9d44a79a69ab6ee4a56355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:47:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:47:55Z,use_quota=True,user_id='bc0860ddded44839b1cb824a29e3dd21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:47:55 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-a8e854de-3854-4b82-9b23-bf4e6df1e585 tempest-VolumesDeleteCascade-1845763094 None] Creating volume be0ecd65-d241-42f0-b6cd-00a298729f6a {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:47:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-a8e854de-3854-4b82-9b23-bf4e6df1e585 tempest-VolumesDeleteCascade-1845763094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:47:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-a8e854de-3854-4b82-9b23-bf4e6df1e585 tempest-VolumesDeleteCascade-1845763094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:47:55 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-a8e854de-3854-4b82-9b23-bf4e6df1e585 tempest-VolumesDeleteCascade-1845763094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:47:55 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-a8e854de-3854-4b82-9b23-bf4e6df1e585 tempest-VolumesDeleteCascade-1845763094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:47:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-a8e854de-3854-4b82-9b23-bf4e6df1e585 tempest-VolumesDeleteCascade-1845763094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:47:55 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-a8e854de-3854-4b82-9b23-bf4e6df1e585 tempest-VolumesDeleteCascade-1845763094 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:47:55 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-a8e854de-3854-4b82-9b23-bf4e6df1e585 tempest-VolumesDeleteCascade-1845763094 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:47:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a8e854de-3854-4b82-9b23-bf4e6df1e585 tempest-VolumesDeleteCascade-1845763094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:47:55 devstack sudo[98154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a 1073741824 Sep 04 22:47:55 devstack sudo[98154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:47:56 devstack sudo[98154]: pam_unix(sudo:session): session closed for user root Sep 04 22:47:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a8e854de-3854-4b82-9b23-bf4e6df1e585 tempest-VolumesDeleteCascade-1845763094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a 1073741824" returned: 0 in 0.546s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:47:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a8e854de-3854-4b82-9b23-bf4e6df1e585 tempest-VolumesDeleteCascade-1845763094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:47:56 devstack sudo[98160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a Sep 04 22:47:56 devstack sudo[98160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:47:56 devstack sudo[98160]: pam_unix(sudo:session): session closed for user root Sep 04 22:47:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a8e854de-3854-4b82-9b23-bf4e6df1e585 tempest-VolumesDeleteCascade-1845763094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a" returned: 0 in 0.390s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:47:56 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-a8e854de-3854-4b82-9b23-bf4e6df1e585 tempest-VolumesDeleteCascade-1845763094 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:47:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-a8e854de-3854-4b82-9b23-bf4e6df1e585 tempest-VolumesDeleteCascade-1845763094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:47:56 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-a8e854de-3854-4b82-9b23-bf4e6df1e585 tempest-VolumesDeleteCascade-1845763094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dbc7e2d-132a-4225-a5a0-e09da106bc09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be0ecd65-d241-42f0-b6cd-00a298729f6a', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:47:56 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-a8e854de-3854-4b82-9b23-bf4e6df1e585 tempest-VolumesDeleteCascade-1845763094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba3595df-2d40-46a6-9384-d86a1bb0af36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:47:56 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-a8e854de-3854-4b82-9b23-bf4e6df1e585 tempest-VolumesDeleteCascade-1845763094 None] Volume volume-be0ecd65-d241-42f0-b6cd-00a298729f6a (be0ecd65-d241-42f0-b6cd-00a298729f6a): created successfully Sep 04 22:47:56 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-a8e854de-3854-4b82-9b23-bf4e6df1e585 tempest-VolumesDeleteCascade-1845763094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba3595df-2d40-46a6-9384-d86a1bb0af36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:47:56 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-a8e854de-3854-4b82-9b23-bf4e6df1e585 tempest-VolumesDeleteCascade-1845763094 None] Flow 'volume_create_manager' (ba621d59-0ecd-48ec-b74e-a775066e46ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:47:56 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-a8e854de-3854-4b82-9b23-bf4e6df1e585 tempest-VolumesDeleteCascade-1845763094 None] Created volume successfully. Sep 04 22:47:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-15ff7217-3961-4ea7-89ba-adbe92bdb881 tempest-VolumesDeleteCascade-1845763094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:47:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-15ff7217-3961-4ea7-89ba-adbe92bdb881 tempest-VolumesDeleteCascade-1845763094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:47:58 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-15ff7217-3961-4ea7-89ba-adbe92bdb881 tempest-VolumesDeleteCascade-1845763094 None] Creating offline snapshot fc8a7313-fa88-483b-9ad0-9be90d70158d of volume be0ecd65-d241-42f0-b6cd-00a298729f6a {{(pid=87576) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 22:47:58 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[34620718-4313-4bbd-82cd-384c5172a09a]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:47:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-15ff7217-3961-4ea7-89ba-adbe92bdb881 tempest-VolumesDeleteCascade-1845763094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:47:58 devstack sudo[98605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a Sep 04 22:47:58 devstack sudo[98605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:47:58 devstack sudo[98605]: pam_unix(sudo:session): session closed for user root Sep 04 22:47:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-15ff7217-3961-4ea7-89ba-adbe92bdb881 tempest-VolumesDeleteCascade-1845763094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a" returned: 0 in 0.433s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:47:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-15ff7217-3961-4ea7-89ba-adbe92bdb881 tempest-VolumesDeleteCascade-1845763094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a.fc8a7313-fa88-483b-9ad0-9be90d70158d 1G {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:47:58 devstack sudo[98611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a.fc8a7313-fa88-483b-9ad0-9be90d70158d 1G Sep 04 22:47:58 devstack sudo[98611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:47:59 devstack sudo[98611]: pam_unix(sudo:session): session closed for user root Sep 04 22:47:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-15ff7217-3961-4ea7-89ba-adbe92bdb881 tempest-VolumesDeleteCascade-1845763094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a.fc8a7313-fa88-483b-9ad0-9be90d70158d 1G" returned: 0 in 0.636s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:47:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-15ff7217-3961-4ea7-89ba-adbe92bdb881 tempest-VolumesDeleteCascade-1845763094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be0ecd65-d241-42f0-b6cd-00a298729f6a -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a.fc8a7313-fa88-483b-9ad0-9be90d70158d {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:47:59 devstack sudo[98619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be0ecd65-d241-42f0-b6cd-00a298729f6a -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a.fc8a7313-fa88-483b-9ad0-9be90d70158d Sep 04 22:47:59 devstack sudo[98619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:47:59 devstack sudo[98619]: pam_unix(sudo:session): session closed for user root Sep 04 22:47:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-15ff7217-3961-4ea7-89ba-adbe92bdb881 tempest-VolumesDeleteCascade-1845763094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be0ecd65-d241-42f0-b6cd-00a298729f6a -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a.fc8a7313-fa88-483b-9ad0-9be90d70158d" returned: 0 in 0.312s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:47:59 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-15ff7217-3961-4ea7-89ba-adbe92bdb881 tempest-VolumesDeleteCascade-1845763094 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a.fc8a7313-fa88-483b-9ad0-9be90d70158d is being set with open permissions: ugo+rw Sep 04 22:47:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-15ff7217-3961-4ea7-89ba-adbe92bdb881 tempest-VolumesDeleteCascade-1845763094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a.fc8a7313-fa88-483b-9ad0-9be90d70158d {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:47:59 devstack sudo[98626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a.fc8a7313-fa88-483b-9ad0-9be90d70158d Sep 04 22:47:59 devstack sudo[98626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:47:59 devstack sudo[98626]: pam_unix(sudo:session): session closed for user root Sep 04 22:47:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-15ff7217-3961-4ea7-89ba-adbe92bdb881 tempest-VolumesDeleteCascade-1845763094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a.fc8a7313-fa88-483b-9ad0-9be90d70158d" returned: 0 in 0.324s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:47:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-15ff7217-3961-4ea7-89ba-adbe92bdb881 tempest-VolumesDeleteCascade-1845763094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:47:59 devstack sudo[98629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a.info Sep 04 22:47:59 devstack sudo[98629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:48:00 devstack sudo[98629]: pam_unix(sudo:session): session closed for user root Sep 04 22:48:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-15ff7217-3961-4ea7-89ba-adbe92bdb881 tempest-VolumesDeleteCascade-1845763094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a.info" returned: 0 in 0.333s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:48:00 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-15ff7217-3961-4ea7-89ba-adbe92bdb881 tempest-VolumesDeleteCascade-1845763094 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a.info is being set with open permissions: ugo+rw Sep 04 22:48:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-15ff7217-3961-4ea7-89ba-adbe92bdb881 tempest-VolumesDeleteCascade-1845763094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:48:00 devstack sudo[98632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a.info Sep 04 22:48:00 devstack sudo[98632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:48:00 devstack sudo[98632]: pam_unix(sudo:session): session closed for user root Sep 04 22:48:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-15ff7217-3961-4ea7-89ba-adbe92bdb881 tempest-VolumesDeleteCascade-1845763094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a.info" returned: 0 in 0.415s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:48:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-15ff7217-3961-4ea7-89ba-adbe92bdb881 tempest-VolumesDeleteCascade-1845763094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.582s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:48:00 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-15ff7217-3961-4ea7-89ba-adbe92bdb881 tempest-VolumesDeleteCascade-1845763094 None] Create snapshot completed successfully Sep 04 22:48:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-6cf9fb86-ffe8-4ccd-aa7d-bc6ecc3431c2 tempest-VolumesDeleteCascade-1845763094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:48:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-6cf9fb86-ffe8-4ccd-aa7d-bc6ecc3431c2 tempest-VolumesDeleteCascade-1845763094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:48:01 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-6cf9fb86-ffe8-4ccd-aa7d-bc6ecc3431c2 tempest-VolumesDeleteCascade-1845763094 None] Creating offline snapshot 86f1f6b9-75b1-49a7-bf3d-39736f481e3b of volume be0ecd65-d241-42f0-b6cd-00a298729f6a {{(pid=87576) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 22:48:01 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[d339de1f-fa7f-468f-a103-835b6e22383a]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:48:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-6cf9fb86-ffe8-4ccd-aa7d-bc6ecc3431c2 tempest-VolumesDeleteCascade-1845763094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a.fc8a7313-fa88-483b-9ad0-9be90d70158d {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:48:01 devstack sudo[98635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a.fc8a7313-fa88-483b-9ad0-9be90d70158d Sep 04 22:48:01 devstack sudo[98635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:48:02 devstack sudo[98635]: pam_unix(sudo:session): session closed for user root Sep 04 22:48:02 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-6cf9fb86-ffe8-4ccd-aa7d-bc6ecc3431c2 tempest-VolumesDeleteCascade-1845763094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a.fc8a7313-fa88-483b-9ad0-9be90d70158d" returned: 0 in 0.569s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:48:02 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-6cf9fb86-ffe8-4ccd-aa7d-bc6ecc3431c2 tempest-VolumesDeleteCascade-1845763094 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be0ecd65-d241-42f0-b6cd-00a298729f6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 22:48:02 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-6cf9fb86-ffe8-4ccd-aa7d-bc6ecc3431c2 tempest-VolumesDeleteCascade-1845763094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a.fc8a7313-fa88-483b-9ad0-9be90d70158d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a.86f1f6b9-75b1-49a7-bf3d-39736f481e3b 1G {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:48:02 devstack sudo[98640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a.fc8a7313-fa88-483b-9ad0-9be90d70158d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a.86f1f6b9-75b1-49a7-bf3d-39736f481e3b 1G Sep 04 22:48:02 devstack sudo[98640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:48:02 devstack sudo[98640]: pam_unix(sudo:session): session closed for user root Sep 04 22:48:02 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-6cf9fb86-ffe8-4ccd-aa7d-bc6ecc3431c2 tempest-VolumesDeleteCascade-1845763094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a.fc8a7313-fa88-483b-9ad0-9be90d70158d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a.86f1f6b9-75b1-49a7-bf3d-39736f481e3b 1G" returned: 0 in 0.609s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:48:02 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-6cf9fb86-ffe8-4ccd-aa7d-bc6ecc3431c2 tempest-VolumesDeleteCascade-1845763094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be0ecd65-d241-42f0-b6cd-00a298729f6a.fc8a7313-fa88-483b-9ad0-9be90d70158d -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a.86f1f6b9-75b1-49a7-bf3d-39736f481e3b {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:48:02 devstack sudo[98649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be0ecd65-d241-42f0-b6cd-00a298729f6a.fc8a7313-fa88-483b-9ad0-9be90d70158d -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a.86f1f6b9-75b1-49a7-bf3d-39736f481e3b Sep 04 22:48:02 devstack sudo[98649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:48:03 devstack sudo[98649]: pam_unix(sudo:session): session closed for user root Sep 04 22:48:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-6cf9fb86-ffe8-4ccd-aa7d-bc6ecc3431c2 tempest-VolumesDeleteCascade-1845763094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be0ecd65-d241-42f0-b6cd-00a298729f6a.fc8a7313-fa88-483b-9ad0-9be90d70158d -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a.86f1f6b9-75b1-49a7-bf3d-39736f481e3b" returned: 0 in 0.581s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:48:03 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-6cf9fb86-ffe8-4ccd-aa7d-bc6ecc3431c2 tempest-VolumesDeleteCascade-1845763094 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a.86f1f6b9-75b1-49a7-bf3d-39736f481e3b is being set with open permissions: ugo+rw Sep 04 22:48:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-6cf9fb86-ffe8-4ccd-aa7d-bc6ecc3431c2 tempest-VolumesDeleteCascade-1845763094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a.86f1f6b9-75b1-49a7-bf3d-39736f481e3b {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:48:03 devstack sudo[98655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a.86f1f6b9-75b1-49a7-bf3d-39736f481e3b Sep 04 22:48:03 devstack sudo[98655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:48:03 devstack sudo[98655]: pam_unix(sudo:session): session closed for user root Sep 04 22:48:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-6cf9fb86-ffe8-4ccd-aa7d-bc6ecc3431c2 tempest-VolumesDeleteCascade-1845763094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a.86f1f6b9-75b1-49a7-bf3d-39736f481e3b" returned: 0 in 0.294s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:48:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-6cf9fb86-ffe8-4ccd-aa7d-bc6ecc3431c2 tempest-VolumesDeleteCascade-1845763094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.187s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:48:03 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-6cf9fb86-ffe8-4ccd-aa7d-bc6ecc3431c2 tempest-VolumesDeleteCascade-1845763094 None] Create snapshot completed successfully Sep 04 22:48:04 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d5f5f7f3-a3a9-428b-94ba-f52ddd7b18d5 tempest-VolumesDeleteCascade-1845763094 None] Acquiring lock "cinder-be0ecd65-d241-42f0-b6cd-00a298729f6a-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:48:05 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d5f5f7f3-a3a9-428b-94ba-f52ddd7b18d5 tempest-VolumesDeleteCascade-1845763094 None] Lock "cinder-be0ecd65-d241-42f0-b6cd-00a298729f6a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:48:05 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d5f5f7f3-a3a9-428b-94ba-f52ddd7b18d5 tempest-VolumesDeleteCascade-1845763094 None] Performing cascade delete. {{(pid=87576) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 04 22:48:05 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d5f5f7f3-a3a9-428b-94ba-f52ddd7b18d5 tempest-VolumesDeleteCascade-1845763094 None] Acquiring lock "cinder-86f1f6b9-75b1-49a7-bf3d-39736f481e3b-delete_snapshot" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:48:05 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d5f5f7f3-a3a9-428b-94ba-f52ddd7b18d5 tempest-VolumesDeleteCascade-1845763094 None] Lock "cinder-86f1f6b9-75b1-49a7-bf3d-39736f481e3b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:48:05 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d5f5f7f3-a3a9-428b-94ba-f52ddd7b18d5 tempest-VolumesDeleteCascade-1845763094 None] Acquiring lock "cinder-quobyte-be0ecd65-d241-42f0-b6cd-00a298729f6a" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:48:05 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d5f5f7f3-a3a9-428b-94ba-f52ddd7b18d5 tempest-VolumesDeleteCascade-1845763094 None] Lock "cinder-quobyte-be0ecd65-d241-42f0-b6cd-00a298729f6a" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:48:05 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d5f5f7f3-a3a9-428b-94ba-f52ddd7b18d5 tempest-VolumesDeleteCascade-1845763094 None] Acquiring lock "cinder-quobyte-86f1f6b9-75b1-49a7-bf3d-39736f481e3b" by "_delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:48:05 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d5f5f7f3-a3a9-428b-94ba-f52ddd7b18d5 tempest-VolumesDeleteCascade-1845763094 None] Lock "cinder-quobyte-86f1f6b9-75b1-49a7-bf3d-39736f481e3b" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:48:05 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-d5f5f7f3-a3a9-428b-94ba-f52ddd7b18d5 tempest-VolumesDeleteCascade-1845763094 None] Deleting offline snapshot 86f1f6b9-75b1-49a7-bf3d-39736f481e3b of volume be0ecd65-d241-42f0-b6cd-00a298729f6a {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 22:48:05 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-d5f5f7f3-a3a9-428b-94ba-f52ddd7b18d5 tempest-VolumesDeleteCascade-1845763094 None] snapshot_file for this snap is: volume-be0ecd65-d241-42f0-b6cd-00a298729f6a.86f1f6b9-75b1-49a7-bf3d-39736f481e3b {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 22:48:05 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c279ff9-f15a-4eaf-87c6-4465e3092efd]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:48:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d5f5f7f3-a3a9-428b-94ba-f52ddd7b18d5 tempest-VolumesDeleteCascade-1845763094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a.86f1f6b9-75b1-49a7-bf3d-39736f481e3b {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:48:05 devstack sudo[98660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a.86f1f6b9-75b1-49a7-bf3d-39736f481e3b Sep 04 22:48:05 devstack sudo[98660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:48:05 devstack sudo[98660]: pam_unix(sudo:session): session closed for user root Sep 04 22:48:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d5f5f7f3-a3a9-428b-94ba-f52ddd7b18d5 tempest-VolumesDeleteCascade-1845763094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a.86f1f6b9-75b1-49a7-bf3d-39736f481e3b" returned: 0 in 0.528s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:48:05 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-d5f5f7f3-a3a9-428b-94ba-f52ddd7b18d5 tempest-VolumesDeleteCascade-1845763094 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be0ecd65-d241-42f0-b6cd-00a298729f6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 22:48:05 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee112ed-3701-4c07-8c7d-73cad030e18f]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:48:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d5f5f7f3-a3a9-428b-94ba-f52ddd7b18d5 tempest-VolumesDeleteCascade-1845763094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a.fc8a7313-fa88-483b-9ad0-9be90d70158d {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:48:06 devstack sudo[98668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a.fc8a7313-fa88-483b-9ad0-9be90d70158d Sep 04 22:48:06 devstack sudo[98668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:48:06 devstack sudo[98668]: pam_unix(sudo:session): session closed for user root Sep 04 22:48:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d5f5f7f3-a3a9-428b-94ba-f52ddd7b18d5 tempest-VolumesDeleteCascade-1845763094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a.fc8a7313-fa88-483b-9ad0-9be90d70158d" returned: 0 in 0.611s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:48:06 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-d5f5f7f3-a3a9-428b-94ba-f52ddd7b18d5 tempest-VolumesDeleteCascade-1845763094 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be0ecd65-d241-42f0-b6cd-00a298729f6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 22:48:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d5f5f7f3-a3a9-428b-94ba-f52ddd7b18d5 tempest-VolumesDeleteCascade-1845763094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a.86f1f6b9-75b1-49a7-bf3d-39736f481e3b {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:48:06 devstack sudo[98674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a.86f1f6b9-75b1-49a7-bf3d-39736f481e3b Sep 04 22:48:06 devstack sudo[98674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:48:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-a1467be6-fd14-46d1-a34b-65cd32896da3 req-a9e2e292-3595-4802-960b-11fd3e8668e4 tempest-TestServerVolumeAttachmentScenario-573049963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:48:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-a1467be6-fd14-46d1-a34b-65cd32896da3 req-a9e2e292-3595-4802-960b-11fd3e8668e4 tempest-TestServerVolumeAttachmentScenario-573049963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:48:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-a1467be6-fd14-46d1-a34b-65cd32896da3 req-a9e2e292-3595-4802-960b-11fd3e8668e4 tempest-TestServerVolumeAttachmentScenario-573049963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:48:07 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-a1467be6-fd14-46d1-a34b-65cd32896da3 req-a9e2e292-3595-4802-960b-11fd3e8668e4 tempest-TestServerVolumeAttachmentScenario-573049963 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4', 'name': 'volume-c7a9b6df-c632-4576-90f6-3da9ae63fadf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7bdbb561-5655-4e16-9f71-952a69ca0cdf', 'enforce_multipath': True} {{(pid=87576) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 22:48:07 devstack cinder-volume[87576]: INFO cinder.volume.manager [req-a1467be6-fd14-46d1-a34b-65cd32896da3 req-a9e2e292-3595-4802-960b-11fd3e8668e4 tempest-TestServerVolumeAttachmentScenario-573049963 None] attachment_update completed successfully. Sep 04 22:48:07 devstack sudo[98674]: pam_unix(sudo:session): session closed for user root Sep 04 22:48:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d5f5f7f3-a3a9-428b-94ba-f52ddd7b18d5 tempest-VolumesDeleteCascade-1845763094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a.86f1f6b9-75b1-49a7-bf3d-39736f481e3b" returned: 0 in 0.757s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:48:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d5f5f7f3-a3a9-428b-94ba-f52ddd7b18d5 tempest-VolumesDeleteCascade-1845763094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a.86f1f6b9-75b1-49a7-bf3d-39736f481e3b {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:48:07 devstack sudo[98690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a.86f1f6b9-75b1-49a7-bf3d-39736f481e3b Sep 04 22:48:07 devstack sudo[98690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:48:07 devstack sudo[98690]: pam_unix(sudo:session): session closed for user root Sep 04 22:48:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d5f5f7f3-a3a9-428b-94ba-f52ddd7b18d5 tempest-VolumesDeleteCascade-1845763094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a.86f1f6b9-75b1-49a7-bf3d-39736f481e3b" returned: 0 in 0.466s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:48:07 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d5f5f7f3-a3a9-428b-94ba-f52ddd7b18d5 tempest-VolumesDeleteCascade-1845763094 None] Lock "cinder-quobyte-86f1f6b9-75b1-49a7-bf3d-39736f481e3b" released by "_delete_snapshot" :: held 2.567s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:48:07 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d5f5f7f3-a3a9-428b-94ba-f52ddd7b18d5 tempest-VolumesDeleteCascade-1845763094 None] Lock "cinder-quobyte-be0ecd65-d241-42f0-b6cd-00a298729f6a" released by "delete_snapshot" :: held 2.613s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:48:07 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-d5f5f7f3-a3a9-428b-94ba-f52ddd7b18d5 tempest-VolumesDeleteCascade-1845763094 None] Created reservations ['4e6956e1-fedb-4dec-9af4-986218302063', '30e2cb1c-b87e-44bc-ad12-e69bbed63861', 'e9953367-6d10-461c-995d-278de8e77615', '9b607ded-cbb3-4819-8fa5-fdb3819792f7'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:48:08 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-d5f5f7f3-a3a9-428b-94ba-f52ddd7b18d5 tempest-VolumesDeleteCascade-1845763094 None] Delete snapshot completed successfully. Sep 04 22:48:08 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d5f5f7f3-a3a9-428b-94ba-f52ddd7b18d5 tempest-VolumesDeleteCascade-1845763094 None] Lock "cinder-86f1f6b9-75b1-49a7-bf3d-39736f481e3b-delete_snapshot" released by "delete_snapshot" :: held 2.925s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:48:08 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d5f5f7f3-a3a9-428b-94ba-f52ddd7b18d5 tempest-VolumesDeleteCascade-1845763094 None] Acquiring lock "cinder-fc8a7313-fa88-483b-9ad0-9be90d70158d-delete_snapshot" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:48:08 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d5f5f7f3-a3a9-428b-94ba-f52ddd7b18d5 tempest-VolumesDeleteCascade-1845763094 None] Lock "cinder-fc8a7313-fa88-483b-9ad0-9be90d70158d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:48:08 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d5f5f7f3-a3a9-428b-94ba-f52ddd7b18d5 tempest-VolumesDeleteCascade-1845763094 None] Acquiring lock "cinder-quobyte-be0ecd65-d241-42f0-b6cd-00a298729f6a" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:48:08 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d5f5f7f3-a3a9-428b-94ba-f52ddd7b18d5 tempest-VolumesDeleteCascade-1845763094 None] Lock "cinder-quobyte-be0ecd65-d241-42f0-b6cd-00a298729f6a" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:48:08 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d5f5f7f3-a3a9-428b-94ba-f52ddd7b18d5 tempest-VolumesDeleteCascade-1845763094 None] Acquiring lock "cinder-quobyte-fc8a7313-fa88-483b-9ad0-9be90d70158d" by "_delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:48:08 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d5f5f7f3-a3a9-428b-94ba-f52ddd7b18d5 tempest-VolumesDeleteCascade-1845763094 None] Lock "cinder-quobyte-fc8a7313-fa88-483b-9ad0-9be90d70158d" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:48:08 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-d5f5f7f3-a3a9-428b-94ba-f52ddd7b18d5 tempest-VolumesDeleteCascade-1845763094 None] Deleting offline snapshot fc8a7313-fa88-483b-9ad0-9be90d70158d of volume be0ecd65-d241-42f0-b6cd-00a298729f6a {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 22:48:08 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-d5f5f7f3-a3a9-428b-94ba-f52ddd7b18d5 tempest-VolumesDeleteCascade-1845763094 None] snapshot_file for this snap is: volume-be0ecd65-d241-42f0-b6cd-00a298729f6a.fc8a7313-fa88-483b-9ad0-9be90d70158d {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 22:48:08 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ae0b08-adc6-4f79-ad98-020e76436a2c]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:48:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d5f5f7f3-a3a9-428b-94ba-f52ddd7b18d5 tempest-VolumesDeleteCascade-1845763094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a.fc8a7313-fa88-483b-9ad0-9be90d70158d {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:48:08 devstack sudo[98694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a.fc8a7313-fa88-483b-9ad0-9be90d70158d Sep 04 22:48:08 devstack sudo[98694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:48:08 devstack sudo[98694]: pam_unix(sudo:session): session closed for user root Sep 04 22:48:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d5f5f7f3-a3a9-428b-94ba-f52ddd7b18d5 tempest-VolumesDeleteCascade-1845763094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a.fc8a7313-fa88-483b-9ad0-9be90d70158d" returned: 0 in 0.778s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:48:08 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-d5f5f7f3-a3a9-428b-94ba-f52ddd7b18d5 tempest-VolumesDeleteCascade-1845763094 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be0ecd65-d241-42f0-b6cd-00a298729f6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 22:48:09 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f604f0-2676-4d91-9426-a1454b394ae8]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:48:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d5f5f7f3-a3a9-428b-94ba-f52ddd7b18d5 tempest-VolumesDeleteCascade-1845763094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:48:09 devstack sudo[98699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a Sep 04 22:48:09 devstack sudo[98699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:48:09 devstack sudo[98699]: pam_unix(sudo:session): session closed for user root Sep 04 22:48:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d5f5f7f3-a3a9-428b-94ba-f52ddd7b18d5 tempest-VolumesDeleteCascade-1845763094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a" returned: 0 in 0.678s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:48:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d5f5f7f3-a3a9-428b-94ba-f52ddd7b18d5 tempest-VolumesDeleteCascade-1845763094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a.fc8a7313-fa88-483b-9ad0-9be90d70158d {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:48:09 devstack sudo[98705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a.fc8a7313-fa88-483b-9ad0-9be90d70158d Sep 04 22:48:09 devstack sudo[98705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:48:10 devstack sudo[98705]: pam_unix(sudo:session): session closed for user root Sep 04 22:48:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d5f5f7f3-a3a9-428b-94ba-f52ddd7b18d5 tempest-VolumesDeleteCascade-1845763094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a.fc8a7313-fa88-483b-9ad0-9be90d70158d" returned: 0 in 0.497s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:48:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d5f5f7f3-a3a9-428b-94ba-f52ddd7b18d5 tempest-VolumesDeleteCascade-1845763094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a.fc8a7313-fa88-483b-9ad0-9be90d70158d {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:48:10 devstack sudo[98711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a.fc8a7313-fa88-483b-9ad0-9be90d70158d Sep 04 22:48:10 devstack sudo[98711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:48:10 devstack sudo[98711]: pam_unix(sudo:session): session closed for user root Sep 04 22:48:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d5f5f7f3-a3a9-428b-94ba-f52ddd7b18d5 tempest-VolumesDeleteCascade-1845763094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a.fc8a7313-fa88-483b-9ad0-9be90d70158d" returned: 0 in 0.391s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:48:10 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d5f5f7f3-a3a9-428b-94ba-f52ddd7b18d5 tempest-VolumesDeleteCascade-1845763094 None] Lock "cinder-quobyte-fc8a7313-fa88-483b-9ad0-9be90d70158d" released by "_delete_snapshot" :: held 2.494s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:48:10 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d5f5f7f3-a3a9-428b-94ba-f52ddd7b18d5 tempest-VolumesDeleteCascade-1845763094 None] Lock "cinder-quobyte-be0ecd65-d241-42f0-b6cd-00a298729f6a" released by "delete_snapshot" :: held 2.528s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:48:10 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-d5f5f7f3-a3a9-428b-94ba-f52ddd7b18d5 tempest-VolumesDeleteCascade-1845763094 None] Created reservations ['d4e6ba36-4ab7-401d-8576-35212a0a27d7', '767d1717-181b-42a5-90fc-12110de6ed82', '397cad73-462f-475c-8e80-49faaa3b5c1f', 'dcfc2ffe-984f-4000-9ef6-2cf2423a2701'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:48:10 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-d5f5f7f3-a3a9-428b-94ba-f52ddd7b18d5 tempest-VolumesDeleteCascade-1845763094 None] Delete snapshot completed successfully. Sep 04 22:48:10 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d5f5f7f3-a3a9-428b-94ba-f52ddd7b18d5 tempest-VolumesDeleteCascade-1845763094 None] Lock "cinder-fc8a7313-fa88-483b-9ad0-9be90d70158d-delete_snapshot" released by "delete_snapshot" :: held 2.856s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:48:10 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d5f5f7f3-a3a9-428b-94ba-f52ddd7b18d5 tempest-VolumesDeleteCascade-1845763094 None] Snapshots deleted, issuing volume delete {{(pid=87576) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 04 22:48:10 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d5f5f7f3-a3a9-428b-94ba-f52ddd7b18d5 tempest-VolumesDeleteCascade-1845763094 None] Acquiring lock "cinder-quobyte-be0ecd65-d241-42f0-b6cd-00a298729f6a" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:48:11 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d5f5f7f3-a3a9-428b-94ba-f52ddd7b18d5 tempest-VolumesDeleteCascade-1845763094 None] Lock "cinder-quobyte-be0ecd65-d241-42f0-b6cd-00a298729f6a" acquired by "delete_volume" :: waited 0.051s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:48:11 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3053b8-dbfc-4d2d-9db3-5ee8ee3f063d]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:48:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d5f5f7f3-a3a9-428b-94ba-f52ddd7b18d5 tempest-VolumesDeleteCascade-1845763094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:48:11 devstack sudo[98714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a Sep 04 22:48:11 devstack sudo[98714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:48:11 devstack sudo[98714]: pam_unix(sudo:session): session closed for user root Sep 04 22:48:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d5f5f7f3-a3a9-428b-94ba-f52ddd7b18d5 tempest-VolumesDeleteCascade-1845763094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a" returned: 0 in 0.550s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:48:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d5f5f7f3-a3a9-428b-94ba-f52ddd7b18d5 tempest-VolumesDeleteCascade-1845763094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:48:11 devstack sudo[98719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a Sep 04 22:48:11 devstack sudo[98719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:48:11 devstack cinder-volume[87576]: DEBUG oslo_service.periodic_task [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87576) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 22:48:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:48:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:48:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:48:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:48:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:48:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:48:11 devstack sudo[98721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:48:11 devstack sudo[98721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:48:12 devstack sudo[98719]: pam_unix(sudo:session): session closed for user root Sep 04 22:48:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d5f5f7f3-a3a9-428b-94ba-f52ddd7b18d5 tempest-VolumesDeleteCascade-1845763094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-be0ecd65-d241-42f0-b6cd-00a298729f6a" returned: 0 in 0.477s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:48:12 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d5f5f7f3-a3a9-428b-94ba-f52ddd7b18d5 tempest-VolumesDeleteCascade-1845763094 None] Lock "cinder-quobyte-be0ecd65-d241-42f0-b6cd-00a298729f6a" released by "delete_volume" :: held 1.169s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:48:12 devstack sudo[98721]: pam_unix(sudo:session): session closed for user root Sep 04 22:48:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.351s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:48:12 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:48:12 devstack cinder-volume[87576]: DEBUG oslo_service.periodic_task [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Running periodic task VolumeManager._thread_info {{(pid=87576) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 22:48:12 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] thread count: 28 {{(pid=87576) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 22:48:12 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] thread info: [<_MainThread(MainThread, started 125730416963712)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87576) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 22:48:12 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-d5f5f7f3-a3a9-428b-94ba-f52ddd7b18d5 tempest-VolumesDeleteCascade-1845763094 None] Created reservations ['72cd7a89-bd51-41dc-8a32-188437324ed6', '04411f24-535e-4d95-ab1c-21aecc988950', '816d826d-490e-4226-977a-fc1f954407f0', 'db9aa906-a2a1-440f-8fa9-f2463ae79894'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:48:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-d5f5f7f3-a3a9-428b-94ba-f52ddd7b18d5 tempest-VolumesDeleteCascade-1845763094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:48:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-d5f5f7f3-a3a9-428b-94ba-f52ddd7b18d5 tempest-VolumesDeleteCascade-1845763094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:48:12 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-d5f5f7f3-a3a9-428b-94ba-f52ddd7b18d5 tempest-VolumesDeleteCascade-1845763094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:48:12 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-d5f5f7f3-a3a9-428b-94ba-f52ddd7b18d5 tempest-VolumesDeleteCascade-1845763094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:48:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-d5f5f7f3-a3a9-428b-94ba-f52ddd7b18d5 tempest-VolumesDeleteCascade-1845763094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:48:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d5f5f7f3-a3a9-428b-94ba-f52ddd7b18d5 tempest-VolumesDeleteCascade-1845763094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:48:12 devstack sudo[98725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:48:12 devstack sudo[98725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:48:12 devstack sudo[98725]: pam_unix(sudo:session): session closed for user root Sep 04 22:48:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d5f5f7f3-a3a9-428b-94ba-f52ddd7b18d5 tempest-VolumesDeleteCascade-1845763094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.364s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:48:12 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-d5f5f7f3-a3a9-428b-94ba-f52ddd7b18d5 tempest-VolumesDeleteCascade-1845763094 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:48:12 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-d5f5f7f3-a3a9-428b-94ba-f52ddd7b18d5 tempest-VolumesDeleteCascade-1845763094 None] Deleted volume successfully. Sep 04 22:48:12 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d5f5f7f3-a3a9-428b-94ba-f52ddd7b18d5 tempest-VolumesDeleteCascade-1845763094 None] Lock "cinder-be0ecd65-d241-42f0-b6cd-00a298729f6a-delete_volume" released by "delete_volume" :: held 7.843s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:48:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-2fcdb8cd-e470-453b-b582-4dcae4422b61 req-0e116180-e12a-49aa-a85f-1a6b2e6b95f6 tempest-TestServerVolumeAttachmentScenario-573049963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:48:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-2fcdb8cd-e470-453b-b582-4dcae4422b61 req-0e116180-e12a-49aa-a85f-1a6b2e6b95f6 tempest-TestServerVolumeAttachmentScenario-573049963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:48:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-2fcdb8cd-e470-453b-b582-4dcae4422b61 req-0e116180-e12a-49aa-a85f-1a6b2e6b95f6 tempest-TestServerVolumeAttachmentScenario-573049963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:48:13 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-2fcdb8cd-e470-453b-b582-4dcae4422b61 req-0e116180-e12a-49aa-a85f-1a6b2e6b95f6 tempest-TestServerVolumeAttachmentScenario-573049963 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4', 'name': 'volume-72ffad8d-6e1b-4310-a8fd-1040d396228d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5fd87209-c138-484a-8721-1a35427c8a22', 'enforce_multipath': True} {{(pid=87576) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 22:48:13 devstack cinder-volume[87576]: INFO cinder.volume.manager [req-2fcdb8cd-e470-453b-b582-4dcae4422b61 req-0e116180-e12a-49aa-a85f-1a6b2e6b95f6 tempest-TestServerVolumeAttachmentScenario-573049963 None] attachment_update completed successfully. Sep 04 22:48:14 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-19032386-5b56-4022-a578-f3a5ba3c9f26 tempest-VolumesDeleteCascade-1845763094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:48:14 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-19032386-5b56-4022-a578-f3a5ba3c9f26 tempest-VolumesDeleteCascade-1845763094 None] Flow 'volume_create_manager' (01c8c06b-0952-40cb-bfdd-0f558e58797a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:48:14 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-19032386-5b56-4022-a578-f3a5ba3c9f26 tempest-VolumesDeleteCascade-1845763094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09aab263-6a7a-40c4-957f-0f065365763c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:48:14 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-19032386-5b56-4022-a578-f3a5ba3c9f26 tempest-VolumesDeleteCascade-1845763094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09aab263-6a7a-40c4-957f-0f065365763c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:48:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2010071197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2a29295-b28c-42dc-8815-2ae5d215c267,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52a95dfa6d9d44a79a69ab6ee4a56355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:48:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:48:14Z,use_quota=True,user_id='bc0860ddded44839b1cb824a29e3dd21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:48:14 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-19032386-5b56-4022-a578-f3a5ba3c9f26 tempest-VolumesDeleteCascade-1845763094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84a969d5-4306-45c3-adf8-da903c0176d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:48:14 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-19032386-5b56-4022-a578-f3a5ba3c9f26 tempest-VolumesDeleteCascade-1845763094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84a969d5-4306-45c3-adf8-da903c0176d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:48:14 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-19032386-5b56-4022-a578-f3a5ba3c9f26 tempest-VolumesDeleteCascade-1845763094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dad1e7d2-a280-42a1-8d1f-a47e2c5730ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:48:14 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-19032386-5b56-4022-a578-f3a5ba3c9f26 tempest-VolumesDeleteCascade-1845763094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dad1e7d2-a280-42a1-8d1f-a47e2c5730ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2a29295-b28c-42dc-8815-2ae5d215c267', 'volume_name': 'volume-f2a29295-b28c-42dc-8815-2ae5d215c267', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:48:14 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-19032386-5b56-4022-a578-f3a5ba3c9f26 tempest-VolumesDeleteCascade-1845763094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6928482-cd6a-4157-9717-b8615029e5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:48:14 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-19032386-5b56-4022-a578-f3a5ba3c9f26 tempest-VolumesDeleteCascade-1845763094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6928482-cd6a-4157-9717-b8615029e5b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:48:14 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-19032386-5b56-4022-a578-f3a5ba3c9f26 tempest-VolumesDeleteCascade-1845763094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aed7db2f-21d1-411b-b376-7e5f31dd5542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:48:14 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-19032386-5b56-4022-a578-f3a5ba3c9f26 tempest-VolumesDeleteCascade-1845763094 None] Volume f2a29295-b28c-42dc-8815-2ae5d215c267: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2a29295-b28c-42dc-8815-2ae5d215c267', 'volume_size': 1} Sep 04 22:48:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-19032386-5b56-4022-a578-f3a5ba3c9f26 tempest-VolumesDeleteCascade-1845763094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:48:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-19032386-5b56-4022-a578-f3a5ba3c9f26 tempest-VolumesDeleteCascade-1845763094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:48:14 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-19032386-5b56-4022-a578-f3a5ba3c9f26 tempest-VolumesDeleteCascade-1845763094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:48:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2010071197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2a29295-b28c-42dc-8815-2ae5d215c267,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52a95dfa6d9d44a79a69ab6ee4a56355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:48:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:48:14Z,use_quota=True,user_id='bc0860ddded44839b1cb824a29e3dd21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:48:14 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-19032386-5b56-4022-a578-f3a5ba3c9f26 tempest-VolumesDeleteCascade-1845763094 None] Creating volume f2a29295-b28c-42dc-8815-2ae5d215c267 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:48:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-19032386-5b56-4022-a578-f3a5ba3c9f26 tempest-VolumesDeleteCascade-1845763094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:48:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-19032386-5b56-4022-a578-f3a5ba3c9f26 tempest-VolumesDeleteCascade-1845763094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:48:14 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-19032386-5b56-4022-a578-f3a5ba3c9f26 tempest-VolumesDeleteCascade-1845763094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:48:14 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-19032386-5b56-4022-a578-f3a5ba3c9f26 tempest-VolumesDeleteCascade-1845763094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:48:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-19032386-5b56-4022-a578-f3a5ba3c9f26 tempest-VolumesDeleteCascade-1845763094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:48:14 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-19032386-5b56-4022-a578-f3a5ba3c9f26 tempest-VolumesDeleteCascade-1845763094 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:48:14 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-19032386-5b56-4022-a578-f3a5ba3c9f26 tempest-VolumesDeleteCascade-1845763094 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:48:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-19032386-5b56-4022-a578-f3a5ba3c9f26 tempest-VolumesDeleteCascade-1845763094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f2a29295-b28c-42dc-8815-2ae5d215c267 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:48:14 devstack sudo[98757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f2a29295-b28c-42dc-8815-2ae5d215c267 1073741824 Sep 04 22:48:14 devstack sudo[98757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:48:14 devstack sudo[98757]: pam_unix(sudo:session): session closed for user root Sep 04 22:48:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-19032386-5b56-4022-a578-f3a5ba3c9f26 tempest-VolumesDeleteCascade-1845763094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f2a29295-b28c-42dc-8815-2ae5d215c267 1073741824" returned: 0 in 0.579s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:48:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-19032386-5b56-4022-a578-f3a5ba3c9f26 tempest-VolumesDeleteCascade-1845763094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f2a29295-b28c-42dc-8815-2ae5d215c267 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:48:15 devstack sudo[98762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f2a29295-b28c-42dc-8815-2ae5d215c267 Sep 04 22:48:15 devstack sudo[98762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:48:15 devstack sudo[98762]: pam_unix(sudo:session): session closed for user root Sep 04 22:48:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-19032386-5b56-4022-a578-f3a5ba3c9f26 tempest-VolumesDeleteCascade-1845763094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f2a29295-b28c-42dc-8815-2ae5d215c267" returned: 0 in 0.307s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:48:15 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-19032386-5b56-4022-a578-f3a5ba3c9f26 tempest-VolumesDeleteCascade-1845763094 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:48:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-19032386-5b56-4022-a578-f3a5ba3c9f26 tempest-VolumesDeleteCascade-1845763094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:48:15 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-19032386-5b56-4022-a578-f3a5ba3c9f26 tempest-VolumesDeleteCascade-1845763094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aed7db2f-21d1-411b-b376-7e5f31dd5542) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2a29295-b28c-42dc-8815-2ae5d215c267', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:48:15 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-19032386-5b56-4022-a578-f3a5ba3c9f26 tempest-VolumesDeleteCascade-1845763094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (653d2cbc-a51b-4545-a9c0-acd0c876efb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:48:15 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-19032386-5b56-4022-a578-f3a5ba3c9f26 tempest-VolumesDeleteCascade-1845763094 None] Volume volume-f2a29295-b28c-42dc-8815-2ae5d215c267 (f2a29295-b28c-42dc-8815-2ae5d215c267): created successfully Sep 04 22:48:15 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-19032386-5b56-4022-a578-f3a5ba3c9f26 tempest-VolumesDeleteCascade-1845763094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (653d2cbc-a51b-4545-a9c0-acd0c876efb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:48:15 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-19032386-5b56-4022-a578-f3a5ba3c9f26 tempest-VolumesDeleteCascade-1845763094 None] Flow 'volume_create_manager' (01c8c06b-0952-40cb-bfdd-0f558e58797a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:48:15 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-19032386-5b56-4022-a578-f3a5ba3c9f26 tempest-VolumesDeleteCascade-1845763094 None] Created volume successfully. Sep 04 22:48:16 devstack cinder-volume[87576]: INFO cinder.volume.manager [req-3b6ab98f-b44b-45bd-9933-3c3cc9656919 req-a0ad1201-8e88-43fe-94a4-5c7e7bd5ff4c tempest-TestServerVolumeAttachmentScenario-573049963 None] Terminate volume connection completed successfully. Sep 04 22:48:16 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-3b6ab98f-b44b-45bd-9933-3c3cc9656919 req-a0ad1201-8e88-43fe-94a4-5c7e7bd5ff4c tempest-TestServerVolumeAttachmentScenario-573049963 None] Deleting attachment 5fd87209-c138-484a-8721-1a35427c8a22. {{(pid=87576) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 22:48:16 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-2e76246e-b280-4b23-b1a4-9955ec7c4b06 tempest-VolumesDeleteCascade-1845763094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:48:16 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-2e76246e-b280-4b23-b1a4-9955ec7c4b06 tempest-VolumesDeleteCascade-1845763094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:48:16 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-2e76246e-b280-4b23-b1a4-9955ec7c4b06 tempest-VolumesDeleteCascade-1845763094 None] Creating offline snapshot 368fec65-49bc-49f4-9ebe-bdef01959fc1 of volume f2a29295-b28c-42dc-8815-2ae5d215c267 {{(pid=87576) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 22:48:16 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c68eeec-c297-441d-8d8c-f3b39f6f090e]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:48:16 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2e76246e-b280-4b23-b1a4-9955ec7c4b06 tempest-VolumesDeleteCascade-1845763094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f2a29295-b28c-42dc-8815-2ae5d215c267 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:48:16 devstack sudo[98806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f2a29295-b28c-42dc-8815-2ae5d215c267 Sep 04 22:48:16 devstack sudo[98806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:48:17 devstack sudo[98806]: pam_unix(sudo:session): session closed for user root Sep 04 22:48:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2e76246e-b280-4b23-b1a4-9955ec7c4b06 tempest-VolumesDeleteCascade-1845763094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f2a29295-b28c-42dc-8815-2ae5d215c267" returned: 0 in 0.470s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:48:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2e76246e-b280-4b23-b1a4-9955ec7c4b06 tempest-VolumesDeleteCascade-1845763094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f2a29295-b28c-42dc-8815-2ae5d215c267,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f2a29295-b28c-42dc-8815-2ae5d215c267.368fec65-49bc-49f4-9ebe-bdef01959fc1 1G {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:48:17 devstack sudo[98814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f2a29295-b28c-42dc-8815-2ae5d215c267,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f2a29295-b28c-42dc-8815-2ae5d215c267.368fec65-49bc-49f4-9ebe-bdef01959fc1 1G Sep 04 22:48:17 devstack sudo[98814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:48:17 devstack sudo[98814]: pam_unix(sudo:session): session closed for user root Sep 04 22:48:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2e76246e-b280-4b23-b1a4-9955ec7c4b06 tempest-VolumesDeleteCascade-1845763094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f2a29295-b28c-42dc-8815-2ae5d215c267,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f2a29295-b28c-42dc-8815-2ae5d215c267.368fec65-49bc-49f4-9ebe-bdef01959fc1 1G" returned: 0 in 0.509s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:48:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2e76246e-b280-4b23-b1a4-9955ec7c4b06 tempest-VolumesDeleteCascade-1845763094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2a29295-b28c-42dc-8815-2ae5d215c267 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f2a29295-b28c-42dc-8815-2ae5d215c267.368fec65-49bc-49f4-9ebe-bdef01959fc1 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:48:17 devstack sudo[98821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2a29295-b28c-42dc-8815-2ae5d215c267 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f2a29295-b28c-42dc-8815-2ae5d215c267.368fec65-49bc-49f4-9ebe-bdef01959fc1 Sep 04 22:48:17 devstack sudo[98821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:48:17 devstack cinder-volume[87576]: INFO cinder.volume.manager [req-b9dd338e-ae17-400a-9540-7230fb8d9f11 req-c9453433-5ca8-499c-9d3e-872e8cf5577f tempest-TestServerVolumeAttachmentScenario-573049963 None] Terminate volume connection completed successfully. Sep 04 22:48:17 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-b9dd338e-ae17-400a-9540-7230fb8d9f11 req-c9453433-5ca8-499c-9d3e-872e8cf5577f tempest-TestServerVolumeAttachmentScenario-573049963 None] Deleting attachment 7bdbb561-5655-4e16-9f71-952a69ca0cdf. {{(pid=87576) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 22:48:18 devstack sudo[98821]: pam_unix(sudo:session): session closed for user root Sep 04 22:48:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2e76246e-b280-4b23-b1a4-9955ec7c4b06 tempest-VolumesDeleteCascade-1845763094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2a29295-b28c-42dc-8815-2ae5d215c267 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f2a29295-b28c-42dc-8815-2ae5d215c267.368fec65-49bc-49f4-9ebe-bdef01959fc1" returned: 0 in 0.336s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:48:18 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-2e76246e-b280-4b23-b1a4-9955ec7c4b06 tempest-VolumesDeleteCascade-1845763094 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f2a29295-b28c-42dc-8815-2ae5d215c267.368fec65-49bc-49f4-9ebe-bdef01959fc1 is being set with open permissions: ugo+rw Sep 04 22:48:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2e76246e-b280-4b23-b1a4-9955ec7c4b06 tempest-VolumesDeleteCascade-1845763094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f2a29295-b28c-42dc-8815-2ae5d215c267.368fec65-49bc-49f4-9ebe-bdef01959fc1 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:48:18 devstack sudo[98828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f2a29295-b28c-42dc-8815-2ae5d215c267.368fec65-49bc-49f4-9ebe-bdef01959fc1 Sep 04 22:48:18 devstack sudo[98828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:48:18 devstack sudo[98828]: pam_unix(sudo:session): session closed for user root Sep 04 22:48:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2e76246e-b280-4b23-b1a4-9955ec7c4b06 tempest-VolumesDeleteCascade-1845763094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f2a29295-b28c-42dc-8815-2ae5d215c267.368fec65-49bc-49f4-9ebe-bdef01959fc1" returned: 0 in 0.293s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:48:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2e76246e-b280-4b23-b1a4-9955ec7c4b06 tempest-VolumesDeleteCascade-1845763094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f2a29295-b28c-42dc-8815-2ae5d215c267.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:48:18 devstack sudo[98832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f2a29295-b28c-42dc-8815-2ae5d215c267.info Sep 04 22:48:18 devstack sudo[98832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:48:18 devstack sudo[98832]: pam_unix(sudo:session): session closed for user root Sep 04 22:48:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2e76246e-b280-4b23-b1a4-9955ec7c4b06 tempest-VolumesDeleteCascade-1845763094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f2a29295-b28c-42dc-8815-2ae5d215c267.info" returned: 0 in 0.273s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:48:18 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-2e76246e-b280-4b23-b1a4-9955ec7c4b06 tempest-VolumesDeleteCascade-1845763094 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f2a29295-b28c-42dc-8815-2ae5d215c267.info is being set with open permissions: ugo+rw Sep 04 22:48:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2e76246e-b280-4b23-b1a4-9955ec7c4b06 tempest-VolumesDeleteCascade-1845763094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f2a29295-b28c-42dc-8815-2ae5d215c267.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:48:18 devstack sudo[98835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f2a29295-b28c-42dc-8815-2ae5d215c267.info Sep 04 22:48:18 devstack sudo[98835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:48:19 devstack sudo[98835]: pam_unix(sudo:session): session closed for user root Sep 04 22:48:19 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2e76246e-b280-4b23-b1a4-9955ec7c4b06 tempest-VolumesDeleteCascade-1845763094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f2a29295-b28c-42dc-8815-2ae5d215c267.info" returned: 0 in 0.472s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:48:19 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-2e76246e-b280-4b23-b1a4-9955ec7c4b06 tempest-VolumesDeleteCascade-1845763094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.503s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:48:19 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-2e76246e-b280-4b23-b1a4-9955ec7c4b06 tempest-VolumesDeleteCascade-1845763094 None] Create snapshot completed successfully Sep 04 22:48:21 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-3906069e-6d5f-4a4a-a3ae-64fef1fb6589 tempest-VolumesDeleteCascade-1845763094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:48:21 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3906069e-6d5f-4a4a-a3ae-64fef1fb6589 tempest-VolumesDeleteCascade-1845763094 None] Flow 'volume_create_manager' (2ba7a707-57b5-4123-9324-751055b4e968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:48:21 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3906069e-6d5f-4a4a-a3ae-64fef1fb6589 tempest-VolumesDeleteCascade-1845763094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (907b0103-7ece-4c68-907d-4e5240bf687c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:48:21 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3906069e-6d5f-4a4a-a3ae-64fef1fb6589 tempest-VolumesDeleteCascade-1845763094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (907b0103-7ece-4c68-907d-4e5240bf687c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1917352227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b77b599-5cf8-4a22-87c1-50eee02e883d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52a95dfa6d9d44a79a69ab6ee4a56355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=368fec65-49bc-49f4-9ebe-bdef01959fc1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:48:21Z,use_quota=True,user_id='bc0860ddded44839b1cb824a29e3dd21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:48:21 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3906069e-6d5f-4a4a-a3ae-64fef1fb6589 tempest-VolumesDeleteCascade-1845763094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30d2c654-91af-42c8-9a75-876ae11d26e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:48:21 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3906069e-6d5f-4a4a-a3ae-64fef1fb6589 tempest-VolumesDeleteCascade-1845763094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30d2c654-91af-42c8-9a75-876ae11d26e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:48:21 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3906069e-6d5f-4a4a-a3ae-64fef1fb6589 tempest-VolumesDeleteCascade-1845763094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ed8afef-8008-429e-a779-539ecc5de272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:48:21 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3906069e-6d5f-4a4a-a3ae-64fef1fb6589 tempest-VolumesDeleteCascade-1845763094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ed8afef-8008-429e-a779-539ecc5de272) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7b77b599-5cf8-4a22-87c1-50eee02e883d', 'volume_name': 'volume-7b77b599-5cf8-4a22-87c1-50eee02e883d', 'volume_size': 1, 'snapshot_id': '368fec65-49bc-49f4-9ebe-bdef01959fc1'}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:48:21 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3906069e-6d5f-4a4a-a3ae-64fef1fb6589 tempest-VolumesDeleteCascade-1845763094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33d8878d-c239-4d61-a1d2-1cc798fb59a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:48:21 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3906069e-6d5f-4a4a-a3ae-64fef1fb6589 tempest-VolumesDeleteCascade-1845763094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33d8878d-c239-4d61-a1d2-1cc798fb59a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:48:21 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3906069e-6d5f-4a4a-a3ae-64fef1fb6589 tempest-VolumesDeleteCascade-1845763094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dedddeb-a0c9-48fd-a31c-848c9244ac67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:48:21 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-3906069e-6d5f-4a4a-a3ae-64fef1fb6589 tempest-VolumesDeleteCascade-1845763094 None] Volume 7b77b599-5cf8-4a22-87c1-50eee02e883d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7b77b599-5cf8-4a22-87c1-50eee02e883d', 'volume_size': 1, 'snapshot_id': '368fec65-49bc-49f4-9ebe-bdef01959fc1'} Sep 04 22:48:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-3906069e-6d5f-4a4a-a3ae-64fef1fb6589 tempest-VolumesDeleteCascade-1845763094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:48:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-3906069e-6d5f-4a4a-a3ae-64fef1fb6589 tempest-VolumesDeleteCascade-1845763094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.003s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:48:21 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-3906069e-6d5f-4a4a-a3ae-64fef1fb6589 tempest-VolumesDeleteCascade-1845763094 None] Acquiring lock "cinder-quobyte-368fec65-49bc-49f4-9ebe-bdef01959fc1-7b77b599-5cf8-4a22-87c1-50eee02e883d" by "_create_volume_from_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:48:21 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-3906069e-6d5f-4a4a-a3ae-64fef1fb6589 tempest-VolumesDeleteCascade-1845763094 None] Lock "cinder-quobyte-368fec65-49bc-49f4-9ebe-bdef01959fc1-7b77b599-5cf8-4a22-87c1-50eee02e883d" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:48:21 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-3906069e-6d5f-4a4a-a3ae-64fef1fb6589 tempest-VolumesDeleteCascade-1845763094 None] Creating volume 7b77b599-5cf8-4a22-87c1-50eee02e883d from snapshot 368fec65-49bc-49f4-9ebe-bdef01959fc1 {{(pid=87576) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 04 22:48:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-3906069e-6d5f-4a4a-a3ae-64fef1fb6589 tempest-VolumesDeleteCascade-1845763094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:48:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-3906069e-6d5f-4a4a-a3ae-64fef1fb6589 tempest-VolumesDeleteCascade-1845763094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:48:21 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-3906069e-6d5f-4a4a-a3ae-64fef1fb6589 tempest-VolumesDeleteCascade-1845763094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:48:21 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-3906069e-6d5f-4a4a-a3ae-64fef1fb6589 tempest-VolumesDeleteCascade-1845763094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:48:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-3906069e-6d5f-4a4a-a3ae-64fef1fb6589 tempest-VolumesDeleteCascade-1845763094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:48:21 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-3906069e-6d5f-4a4a-a3ae-64fef1fb6589 tempest-VolumesDeleteCascade-1845763094 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:48:21 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-3906069e-6d5f-4a4a-a3ae-64fef1fb6589 tempest-VolumesDeleteCascade-1845763094 None] Acquiring lock "cinder-quobyte-7b77b599-5cf8-4a22-87c1-50eee02e883d" by "_copy_volume_from_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:48:21 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-3906069e-6d5f-4a4a-a3ae-64fef1fb6589 tempest-VolumesDeleteCascade-1845763094 None] Lock "cinder-quobyte-7b77b599-5cf8-4a22-87c1-50eee02e883d" acquired by "_copy_volume_from_snapshot" :: waited 0.050s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:48:21 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-3906069e-6d5f-4a4a-a3ae-64fef1fb6589 tempest-VolumesDeleteCascade-1845763094 None] snapshot: 368fec65-49bc-49f4-9ebe-bdef01959fc1, volume: 7b77b599-5cf8-4a22-87c1-50eee02e883d, {{(pid=87576) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 04 22:48:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-3906069e-6d5f-4a4a-a3ae-64fef1fb6589 tempest-VolumesDeleteCascade-1845763094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:48:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-3906069e-6d5f-4a4a-a3ae-64fef1fb6589 tempest-VolumesDeleteCascade-1845763094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:48:21 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-3906069e-6d5f-4a4a-a3ae-64fef1fb6589 tempest-VolumesDeleteCascade-1845763094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:48:21 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-3906069e-6d5f-4a4a-a3ae-64fef1fb6589 tempest-VolumesDeleteCascade-1845763094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:48:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-3906069e-6d5f-4a4a-a3ae-64fef1fb6589 tempest-VolumesDeleteCascade-1845763094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:48:21 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb3e8fb-1822-4896-882c-b9dbecae1a5d]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:48:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3906069e-6d5f-4a4a-a3ae-64fef1fb6589 tempest-VolumesDeleteCascade-1845763094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f2a29295-b28c-42dc-8815-2ae5d215c267.368fec65-49bc-49f4-9ebe-bdef01959fc1 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:48:21 devstack sudo[98925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f2a29295-b28c-42dc-8815-2ae5d215c267.368fec65-49bc-49f4-9ebe-bdef01959fc1 Sep 04 22:48:21 devstack sudo[98925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:48:22 devstack sudo[98925]: pam_unix(sudo:session): session closed for user root Sep 04 22:48:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3906069e-6d5f-4a4a-a3ae-64fef1fb6589 tempest-VolumesDeleteCascade-1845763094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f2a29295-b28c-42dc-8815-2ae5d215c267.368fec65-49bc-49f4-9ebe-bdef01959fc1" returned: 0 in 0.790s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:48:22 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-3906069e-6d5f-4a4a-a3ae-64fef1fb6589 tempest-VolumesDeleteCascade-1845763094 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2a29295-b28c-42dc-8815-2ae5d215c267(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 22:48:22 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e498003-5475-4c83-901e-479b09ec3530]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:48:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3906069e-6d5f-4a4a-a3ae-64fef1fb6589 tempest-VolumesDeleteCascade-1845763094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f2a29295-b28c-42dc-8815-2ae5d215c267 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:48:22 devstack sudo[98934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f2a29295-b28c-42dc-8815-2ae5d215c267 Sep 04 22:48:22 devstack sudo[98934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:48:23 devstack sudo[98934]: pam_unix(sudo:session): session closed for user root Sep 04 22:48:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3906069e-6d5f-4a4a-a3ae-64fef1fb6589 tempest-VolumesDeleteCascade-1845763094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f2a29295-b28c-42dc-8815-2ae5d215c267" returned: 0 in 0.540s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:48:23 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-3906069e-6d5f-4a4a-a3ae-64fef1fb6589 tempest-VolumesDeleteCascade-1845763094 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f2a29295-b28c-42dc-8815-2ae5d215c267 {{(pid=87576) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 04 22:48:23 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-3906069e-6d5f-4a4a-a3ae-64fef1fb6589 tempest-VolumesDeleteCascade-1845763094 None] Creating direct copy from snapshot {{(pid=87576) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 04 22:48:23 devstack cinder-volume[87576]: DEBUG cinder.utils [None req-3906069e-6d5f-4a4a-a3ae-64fef1fb6589 tempest-VolumesDeleteCascade-1845763094 None] Path /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7b77b599-5cf8-4a22-87c1-50eee02e883d not found in is_blk_device check {{(pid=87576) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 04 22:48:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3906069e-6d5f-4a4a-a3ae-64fef1fb6589 tempest-VolumesDeleteCascade-1845763094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f2a29295-b28c-42dc-8815-2ae5d215c267 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7b77b599-5cf8-4a22-87c1-50eee02e883d {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:48:23 devstack sudo[98942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f2a29295-b28c-42dc-8815-2ae5d215c267 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7b77b599-5cf8-4a22-87c1-50eee02e883d Sep 04 22:48:23 devstack sudo[98942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:48:30 devstack cinder-volume[87576]: INFO cinder.volume.manager [req-2a8e37e5-2704-4b44-be3b-a04f1833f2e8 req-a56d3ac5-b4e0-47dd-aed6-18e5511abbab tempest-TestShelveInstance-1943220238 None] Terminate volume connection completed successfully. Sep 04 22:48:30 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-2a8e37e5-2704-4b44-be3b-a04f1833f2e8 req-a56d3ac5-b4e0-47dd-aed6-18e5511abbab tempest-TestShelveInstance-1943220238 None] Deleting attachment 22d84ed7-dac7-426e-8598-56c6bbb47a65. {{(pid=87576) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 22:48:31 devstack cinder-volume[87576]: DEBUG cinder.coordination [req-2a8e37e5-2704-4b44-be3b-a04f1833f2e8 req-7c90bfe5-1e9a-495e-be9f-3b8168e72fe2 tempest-TestShelveInstance-1943220238 None] Acquiring lock "cinder-031d7a31-f8fa-4263-b59c-7878b17ae9ca-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:48:31 devstack cinder-volume[87576]: DEBUG cinder.coordination [req-2a8e37e5-2704-4b44-be3b-a04f1833f2e8 req-7c90bfe5-1e9a-495e-be9f-3b8168e72fe2 tempest-TestShelveInstance-1943220238 None] Lock "cinder-031d7a31-f8fa-4263-b59c-7878b17ae9ca-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:48:31 devstack cinder-volume[87576]: DEBUG cinder.coordination [req-2a8e37e5-2704-4b44-be3b-a04f1833f2e8 req-7c90bfe5-1e9a-495e-be9f-3b8168e72fe2 tempest-TestShelveInstance-1943220238 None] Acquiring lock "cinder-quobyte-031d7a31-f8fa-4263-b59c-7878b17ae9ca" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:48:31 devstack cinder-volume[87576]: DEBUG cinder.coordination [req-2a8e37e5-2704-4b44-be3b-a04f1833f2e8 req-7c90bfe5-1e9a-495e-be9f-3b8168e72fe2 tempest-TestShelveInstance-1943220238 None] Lock "cinder-quobyte-031d7a31-f8fa-4263-b59c-7878b17ae9ca" acquired by "delete_volume" :: waited 0.084s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:48:31 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[3638f59f-dc8c-4afa-84e4-3e82c51db17c]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:48:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [req-2a8e37e5-2704-4b44-be3b-a04f1833f2e8 req-7c90bfe5-1e9a-495e-be9f-3b8168e72fe2 tempest-TestShelveInstance-1943220238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-031d7a31-f8fa-4263-b59c-7878b17ae9ca {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:48:32 devstack sudo[99019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-031d7a31-f8fa-4263-b59c-7878b17ae9ca Sep 04 22:48:32 devstack sudo[99019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:48:32 devstack sudo[98942]: pam_unix(sudo:session): session closed for user root Sep 04 22:48:32 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3906069e-6d5f-4a4a-a3ae-64fef1fb6589 tempest-VolumesDeleteCascade-1845763094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f2a29295-b28c-42dc-8815-2ae5d215c267 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7b77b599-5cf8-4a22-87c1-50eee02e883d" returned: 0 in 9.425s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:48:32 devstack cinder-volume[87576]: DEBUG cinder.image.image_utils [None req-3906069e-6d5f-4a4a-a3ae-64fef1fb6589 tempest-VolumesDeleteCascade-1845763094 None] Image conversion details: src /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f2a29295-b28c-42dc-8815-2ae5d215c267, size 1024.00 MB, duration 9.43 sec, destination /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7b77b599-5cf8-4a22-87c1-50eee02e883d {{(pid=87576) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 22:48:32 devstack cinder-volume[87576]: INFO cinder.image.image_utils [None req-3906069e-6d5f-4a4a-a3ae-64fef1fb6589 tempest-VolumesDeleteCascade-1845763094 None] Converted 1024.00 MB image at 108.63 MB/s Sep 04 22:48:32 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-3906069e-6d5f-4a4a-a3ae-64fef1fb6589 tempest-VolumesDeleteCascade-1845763094 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7b77b599-5cf8-4a22-87c1-50eee02e883d is being set with open permissions: ugo+rw Sep 04 22:48:32 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3906069e-6d5f-4a4a-a3ae-64fef1fb6589 tempest-VolumesDeleteCascade-1845763094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7b77b599-5cf8-4a22-87c1-50eee02e883d {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:48:32 devstack sudo[99021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7b77b599-5cf8-4a22-87c1-50eee02e883d Sep 04 22:48:32 devstack sudo[99021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:48:32 devstack sudo[99019]: pam_unix(sudo:session): session closed for user root Sep 04 22:48:32 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [req-2a8e37e5-2704-4b44-be3b-a04f1833f2e8 req-7c90bfe5-1e9a-495e-be9f-3b8168e72fe2 tempest-TestShelveInstance-1943220238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-031d7a31-f8fa-4263-b59c-7878b17ae9ca" returned: 0 in 1.162s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:48:32 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [req-2a8e37e5-2704-4b44-be3b-a04f1833f2e8 req-7c90bfe5-1e9a-495e-be9f-3b8168e72fe2 tempest-TestShelveInstance-1943220238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-031d7a31-f8fa-4263-b59c-7878b17ae9ca {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:48:32 devstack sudo[99028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-031d7a31-f8fa-4263-b59c-7878b17ae9ca Sep 04 22:48:32 devstack sudo[99028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:48:33 devstack sudo[99021]: pam_unix(sudo:session): session closed for user root Sep 04 22:48:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3906069e-6d5f-4a4a-a3ae-64fef1fb6589 tempest-VolumesDeleteCascade-1845763094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7b77b599-5cf8-4a22-87c1-50eee02e883d" returned: 0 in 0.579s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:48:33 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-3906069e-6d5f-4a4a-a3ae-64fef1fb6589 tempest-VolumesDeleteCascade-1845763094 None] Lock "cinder-quobyte-7b77b599-5cf8-4a22-87c1-50eee02e883d" released by "_copy_volume_from_snapshot" :: held 11.510s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:48:33 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-3906069e-6d5f-4a4a-a3ae-64fef1fb6589 tempest-VolumesDeleteCascade-1845763094 None] Lock "cinder-quobyte-368fec65-49bc-49f4-9ebe-bdef01959fc1-7b77b599-5cf8-4a22-87c1-50eee02e883d" released by "_create_volume_from_snapshot" :: held 11.673s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:48:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-3906069e-6d5f-4a4a-a3ae-64fef1fb6589 tempest-VolumesDeleteCascade-1845763094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.716s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:48:33 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3906069e-6d5f-4a4a-a3ae-64fef1fb6589 tempest-VolumesDeleteCascade-1845763094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dedddeb-a0c9-48fd-a31c-848c9244ac67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b77b599-5cf8-4a22-87c1-50eee02e883d', 'volume_size': 1, 'snapshot_id': '368fec65-49bc-49f4-9ebe-bdef01959fc1'}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:48:33 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3906069e-6d5f-4a4a-a3ae-64fef1fb6589 tempest-VolumesDeleteCascade-1845763094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2ff2765-1bb3-4f83-8c1f-6e17cd71ca7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:48:33 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-40e6a238-9e1e-4a8a-ac09-879a94ad31f7 tempest-TestServerVolumeAttachmentScenario-573049963 None] Acquiring lock "cinder-72ffad8d-6e1b-4310-a8fd-1040d396228d-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:48:33 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-3906069e-6d5f-4a4a-a3ae-64fef1fb6589 tempest-VolumesDeleteCascade-1845763094 None] Volume volume-7b77b599-5cf8-4a22-87c1-50eee02e883d (7b77b599-5cf8-4a22-87c1-50eee02e883d): created successfully Sep 04 22:48:33 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3906069e-6d5f-4a4a-a3ae-64fef1fb6589 tempest-VolumesDeleteCascade-1845763094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2ff2765-1bb3-4f83-8c1f-6e17cd71ca7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:48:33 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3906069e-6d5f-4a4a-a3ae-64fef1fb6589 tempest-VolumesDeleteCascade-1845763094 None] Flow 'volume_create_manager' (2ba7a707-57b5-4123-9324-751055b4e968) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:48:33 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-40e6a238-9e1e-4a8a-ac09-879a94ad31f7 tempest-TestServerVolumeAttachmentScenario-573049963 None] Lock "cinder-72ffad8d-6e1b-4310-a8fd-1040d396228d-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:48:33 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-3906069e-6d5f-4a4a-a3ae-64fef1fb6589 tempest-VolumesDeleteCascade-1845763094 None] Created volume successfully. Sep 04 22:48:33 devstack sudo[99028]: pam_unix(sudo:session): session closed for user root Sep 04 22:48:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [req-2a8e37e5-2704-4b44-be3b-a04f1833f2e8 req-7c90bfe5-1e9a-495e-be9f-3b8168e72fe2 tempest-TestShelveInstance-1943220238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-031d7a31-f8fa-4263-b59c-7878b17ae9ca" returned: 0 in 0.551s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:48:33 devstack cinder-volume[87576]: DEBUG cinder.coordination [req-2a8e37e5-2704-4b44-be3b-a04f1833f2e8 req-7c90bfe5-1e9a-495e-be9f-3b8168e72fe2 tempest-TestShelveInstance-1943220238 None] Lock "cinder-quobyte-031d7a31-f8fa-4263-b59c-7878b17ae9ca" released by "delete_volume" :: held 1.884s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:48:33 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-40e6a238-9e1e-4a8a-ac09-879a94ad31f7 tempest-TestServerVolumeAttachmentScenario-573049963 None] Acquiring lock "cinder-quobyte-72ffad8d-6e1b-4310-a8fd-1040d396228d" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:48:33 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-40e6a238-9e1e-4a8a-ac09-879a94ad31f7 tempest-TestServerVolumeAttachmentScenario-573049963 None] Lock "cinder-quobyte-72ffad8d-6e1b-4310-a8fd-1040d396228d" acquired by "delete_volume" :: waited 0.034s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:48:33 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b57dc6e-86b9-429b-871b-349a4a7470a1]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:48:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-40e6a238-9e1e-4a8a-ac09-879a94ad31f7 tempest-TestServerVolumeAttachmentScenario-573049963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-72ffad8d-6e1b-4310-a8fd-1040d396228d {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:48:33 devstack cinder-volume[87576]: DEBUG cinder.quota [req-2a8e37e5-2704-4b44-be3b-a04f1833f2e8 req-7c90bfe5-1e9a-495e-be9f-3b8168e72fe2 tempest-TestShelveInstance-1943220238 None] Created reservations ['5196d159-1233-4697-831e-d78a541c310c', '0484b002-e06a-4a00-ac40-80c2be0abe22', 'caff019a-11d7-49f0-b3d6-3e8d02b91a40', 'ec7b54ef-d65b-403f-b3eb-b6c8047669b5'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:48:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-2a8e37e5-2704-4b44-be3b-a04f1833f2e8 req-7c90bfe5-1e9a-495e-be9f-3b8168e72fe2 tempest-TestShelveInstance-1943220238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:48:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-2a8e37e5-2704-4b44-be3b-a04f1833f2e8 req-7c90bfe5-1e9a-495e-be9f-3b8168e72fe2 tempest-TestShelveInstance-1943220238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:48:33 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [req-2a8e37e5-2704-4b44-be3b-a04f1833f2e8 req-7c90bfe5-1e9a-495e-be9f-3b8168e72fe2 tempest-TestShelveInstance-1943220238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:48:33 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [req-2a8e37e5-2704-4b44-be3b-a04f1833f2e8 req-7c90bfe5-1e9a-495e-be9f-3b8168e72fe2 tempest-TestShelveInstance-1943220238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:48:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-2a8e37e5-2704-4b44-be3b-a04f1833f2e8 req-7c90bfe5-1e9a-495e-be9f-3b8168e72fe2 tempest-TestShelveInstance-1943220238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:48:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [req-2a8e37e5-2704-4b44-be3b-a04f1833f2e8 req-7c90bfe5-1e9a-495e-be9f-3b8168e72fe2 tempest-TestShelveInstance-1943220238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:48:33 devstack sudo[99032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-72ffad8d-6e1b-4310-a8fd-1040d396228d Sep 04 22:48:33 devstack sudo[99032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:48:33 devstack sudo[99033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:48:33 devstack sudo[99033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:48:33 devstack sudo[99033]: pam_unix(sudo:session): session closed for user root Sep 04 22:48:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [req-2a8e37e5-2704-4b44-be3b-a04f1833f2e8 req-7c90bfe5-1e9a-495e-be9f-3b8168e72fe2 tempest-TestShelveInstance-1943220238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.320s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:48:33 devstack cinder-volume[87576]: DEBUG cinder.manager [req-2a8e37e5-2704-4b44-be3b-a04f1833f2e8 req-7c90bfe5-1e9a-495e-be9f-3b8168e72fe2 tempest-TestShelveInstance-1943220238 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:48:33 devstack sudo[99032]: pam_unix(sudo:session): session closed for user root Sep 04 22:48:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-40e6a238-9e1e-4a8a-ac09-879a94ad31f7 tempest-TestServerVolumeAttachmentScenario-573049963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-72ffad8d-6e1b-4310-a8fd-1040d396228d" returned: 0 in 0.498s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:48:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-40e6a238-9e1e-4a8a-ac09-879a94ad31f7 tempest-TestServerVolumeAttachmentScenario-573049963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-72ffad8d-6e1b-4310-a8fd-1040d396228d {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:48:33 devstack cinder-volume[87576]: INFO cinder.volume.manager [req-2a8e37e5-2704-4b44-be3b-a04f1833f2e8 req-7c90bfe5-1e9a-495e-be9f-3b8168e72fe2 tempest-TestShelveInstance-1943220238 None] Deleted volume successfully. Sep 04 22:48:33 devstack sudo[99040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-72ffad8d-6e1b-4310-a8fd-1040d396228d Sep 04 22:48:33 devstack sudo[99040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:48:34 devstack cinder-volume[87576]: DEBUG cinder.coordination [req-2a8e37e5-2704-4b44-be3b-a04f1833f2e8 req-7c90bfe5-1e9a-495e-be9f-3b8168e72fe2 tempest-TestShelveInstance-1943220238 None] Lock "cinder-031d7a31-f8fa-4263-b59c-7878b17ae9ca-delete_volume" released by "delete_volume" :: held 2.849s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:48:34 devstack sudo[99040]: pam_unix(sudo:session): session closed for user root Sep 04 22:48:34 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-40e6a238-9e1e-4a8a-ac09-879a94ad31f7 tempest-TestServerVolumeAttachmentScenario-573049963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-72ffad8d-6e1b-4310-a8fd-1040d396228d" returned: 0 in 0.411s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:48:34 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-40e6a238-9e1e-4a8a-ac09-879a94ad31f7 tempest-TestServerVolumeAttachmentScenario-573049963 None] Lock "cinder-quobyte-72ffad8d-6e1b-4310-a8fd-1040d396228d" released by "delete_volume" :: held 1.000s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:48:34 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-65198ec5-5236-4d17-adc6-b02b1076552e tempest-VolumesDeleteCascade-1845763094 None] Acquiring lock "cinder-f2a29295-b28c-42dc-8815-2ae5d215c267-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:48:34 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-65198ec5-5236-4d17-adc6-b02b1076552e tempest-VolumesDeleteCascade-1845763094 None] Lock "cinder-f2a29295-b28c-42dc-8815-2ae5d215c267-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:48:34 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-40e6a238-9e1e-4a8a-ac09-879a94ad31f7 tempest-TestServerVolumeAttachmentScenario-573049963 None] Created reservations ['5b45c668-86be-4cad-b867-f0644f659e5e', 'f55420c0-cf19-4ea3-9ccd-0b5d76c3348d', 'f45aa9ac-1bac-45a9-a7ed-11b40dc5a0a1', '7807013c-3bce-4f74-acf1-1f8ea57a34c5'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:48:34 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-65198ec5-5236-4d17-adc6-b02b1076552e tempest-VolumesDeleteCascade-1845763094 None] Performing cascade delete. {{(pid=87576) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 04 22:48:34 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-65198ec5-5236-4d17-adc6-b02b1076552e tempest-VolumesDeleteCascade-1845763094 None] Acquiring lock "cinder-368fec65-49bc-49f4-9ebe-bdef01959fc1-delete_snapshot" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:48:34 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-65198ec5-5236-4d17-adc6-b02b1076552e tempest-VolumesDeleteCascade-1845763094 None] Lock "cinder-368fec65-49bc-49f4-9ebe-bdef01959fc1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:48:34 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-65198ec5-5236-4d17-adc6-b02b1076552e tempest-VolumesDeleteCascade-1845763094 None] Acquiring lock "cinder-quobyte-f2a29295-b28c-42dc-8815-2ae5d215c267" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:48:34 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-65198ec5-5236-4d17-adc6-b02b1076552e tempest-VolumesDeleteCascade-1845763094 None] Lock "cinder-quobyte-f2a29295-b28c-42dc-8815-2ae5d215c267" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:48:34 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-65198ec5-5236-4d17-adc6-b02b1076552e tempest-VolumesDeleteCascade-1845763094 None] Acquiring lock "cinder-quobyte-368fec65-49bc-49f4-9ebe-bdef01959fc1" by "_delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:48:34 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-40e6a238-9e1e-4a8a-ac09-879a94ad31f7 tempest-TestServerVolumeAttachmentScenario-573049963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:48:34 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-40e6a238-9e1e-4a8a-ac09-879a94ad31f7 tempest-TestServerVolumeAttachmentScenario-573049963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:48:34 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-40e6a238-9e1e-4a8a-ac09-879a94ad31f7 tempest-TestServerVolumeAttachmentScenario-573049963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:48:34 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-40e6a238-9e1e-4a8a-ac09-879a94ad31f7 tempest-TestServerVolumeAttachmentScenario-573049963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:48:34 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-40e6a238-9e1e-4a8a-ac09-879a94ad31f7 tempest-TestServerVolumeAttachmentScenario-573049963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:48:34 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-40e6a238-9e1e-4a8a-ac09-879a94ad31f7 tempest-TestServerVolumeAttachmentScenario-573049963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:48:34 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-65198ec5-5236-4d17-adc6-b02b1076552e tempest-VolumesDeleteCascade-1845763094 None] Lock "cinder-quobyte-368fec65-49bc-49f4-9ebe-bdef01959fc1" acquired by "_delete_snapshot" :: waited 0.052s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:48:34 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-65198ec5-5236-4d17-adc6-b02b1076552e tempest-VolumesDeleteCascade-1845763094 None] Deleting offline snapshot 368fec65-49bc-49f4-9ebe-bdef01959fc1 of volume f2a29295-b28c-42dc-8815-2ae5d215c267 {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 22:48:34 devstack sudo[99061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:48:34 devstack sudo[99061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:48:34 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-65198ec5-5236-4d17-adc6-b02b1076552e tempest-VolumesDeleteCascade-1845763094 None] snapshot_file for this snap is: volume-f2a29295-b28c-42dc-8815-2ae5d215c267.368fec65-49bc-49f4-9ebe-bdef01959fc1 {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 22:48:34 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[47df5ebd-9a36-467a-8d19-dc03dc71efc8]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:48:34 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-65198ec5-5236-4d17-adc6-b02b1076552e tempest-VolumesDeleteCascade-1845763094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f2a29295-b28c-42dc-8815-2ae5d215c267.368fec65-49bc-49f4-9ebe-bdef01959fc1 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:48:34 devstack sudo[99063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f2a29295-b28c-42dc-8815-2ae5d215c267.368fec65-49bc-49f4-9ebe-bdef01959fc1 Sep 04 22:48:34 devstack sudo[99063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:48:34 devstack sudo[99061]: pam_unix(sudo:session): session closed for user root Sep 04 22:48:34 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-40e6a238-9e1e-4a8a-ac09-879a94ad31f7 tempest-TestServerVolumeAttachmentScenario-573049963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.274s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:48:34 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-40e6a238-9e1e-4a8a-ac09-879a94ad31f7 tempest-TestServerVolumeAttachmentScenario-573049963 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:48:34 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-40e6a238-9e1e-4a8a-ac09-879a94ad31f7 tempest-TestServerVolumeAttachmentScenario-573049963 None] Deleted volume successfully. Sep 04 22:48:35 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-40e6a238-9e1e-4a8a-ac09-879a94ad31f7 tempest-TestServerVolumeAttachmentScenario-573049963 None] Lock "cinder-72ffad8d-6e1b-4310-a8fd-1040d396228d-delete_volume" released by "delete_volume" :: held 1.750s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:48:35 devstack sudo[99063]: pam_unix(sudo:session): session closed for user root Sep 04 22:48:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-65198ec5-5236-4d17-adc6-b02b1076552e tempest-VolumesDeleteCascade-1845763094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f2a29295-b28c-42dc-8815-2ae5d215c267.368fec65-49bc-49f4-9ebe-bdef01959fc1" returned: 0 in 0.418s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:48:35 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-65198ec5-5236-4d17-adc6-b02b1076552e tempest-VolumesDeleteCascade-1845763094 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2a29295-b28c-42dc-8815-2ae5d215c267(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 22:48:35 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[a441f641-541e-454c-93cd-e9e57dd0dbf0]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:48:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-65198ec5-5236-4d17-adc6-b02b1076552e tempest-VolumesDeleteCascade-1845763094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f2a29295-b28c-42dc-8815-2ae5d215c267 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:48:35 devstack sudo[99069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f2a29295-b28c-42dc-8815-2ae5d215c267 Sep 04 22:48:35 devstack sudo[99069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:48:35 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-448e468e-8f98-4bca-b656-900cfc8c3596 tempest-TestServerVolumeAttachmentScenario-573049963 None] Acquiring lock "cinder-c7a9b6df-c632-4576-90f6-3da9ae63fadf-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:48:35 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-448e468e-8f98-4bca-b656-900cfc8c3596 tempest-TestServerVolumeAttachmentScenario-573049963 None] Lock "cinder-c7a9b6df-c632-4576-90f6-3da9ae63fadf-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:48:35 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-448e468e-8f98-4bca-b656-900cfc8c3596 tempest-TestServerVolumeAttachmentScenario-573049963 None] Acquiring lock "cinder-quobyte-c7a9b6df-c632-4576-90f6-3da9ae63fadf" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:48:35 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-448e468e-8f98-4bca-b656-900cfc8c3596 tempest-TestServerVolumeAttachmentScenario-573049963 None] Lock "cinder-quobyte-c7a9b6df-c632-4576-90f6-3da9ae63fadf" acquired by "delete_volume" :: waited 0.017s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:48:35 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45233c1-9469-4c47-b790-5fedfc91d59d]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:48:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-448e468e-8f98-4bca-b656-900cfc8c3596 tempest-TestServerVolumeAttachmentScenario-573049963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c7a9b6df-c632-4576-90f6-3da9ae63fadf {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:48:35 devstack sudo[99069]: pam_unix(sudo:session): session closed for user root Sep 04 22:48:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-65198ec5-5236-4d17-adc6-b02b1076552e tempest-VolumesDeleteCascade-1845763094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f2a29295-b28c-42dc-8815-2ae5d215c267" returned: 0 in 0.569s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:48:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-65198ec5-5236-4d17-adc6-b02b1076552e tempest-VolumesDeleteCascade-1845763094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f2a29295-b28c-42dc-8815-2ae5d215c267.368fec65-49bc-49f4-9ebe-bdef01959fc1 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:48:35 devstack sudo[99075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f2a29295-b28c-42dc-8815-2ae5d215c267.368fec65-49bc-49f4-9ebe-bdef01959fc1 Sep 04 22:48:35 devstack sudo[99075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:48:35 devstack sudo[99074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c7a9b6df-c632-4576-90f6-3da9ae63fadf Sep 04 22:48:35 devstack sudo[99074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:48:36 devstack sudo[99074]: pam_unix(sudo:session): session closed for user root Sep 04 22:48:36 devstack sudo[99075]: pam_unix(sudo:session): session closed for user root Sep 04 22:48:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-448e468e-8f98-4bca-b656-900cfc8c3596 tempest-TestServerVolumeAttachmentScenario-573049963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c7a9b6df-c632-4576-90f6-3da9ae63fadf" returned: 0 in 0.440s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:48:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-448e468e-8f98-4bca-b656-900cfc8c3596 tempest-TestServerVolumeAttachmentScenario-573049963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c7a9b6df-c632-4576-90f6-3da9ae63fadf {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:48:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-65198ec5-5236-4d17-adc6-b02b1076552e tempest-VolumesDeleteCascade-1845763094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f2a29295-b28c-42dc-8815-2ae5d215c267.368fec65-49bc-49f4-9ebe-bdef01959fc1" returned: 0 in 0.414s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:48:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-65198ec5-5236-4d17-adc6-b02b1076552e tempest-VolumesDeleteCascade-1845763094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f2a29295-b28c-42dc-8815-2ae5d215c267.368fec65-49bc-49f4-9ebe-bdef01959fc1 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:48:36 devstack sudo[99085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c7a9b6df-c632-4576-90f6-3da9ae63fadf Sep 04 22:48:36 devstack sudo[99085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:48:36 devstack sudo[99086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f2a29295-b28c-42dc-8815-2ae5d215c267.368fec65-49bc-49f4-9ebe-bdef01959fc1 Sep 04 22:48:36 devstack sudo[99086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:48:36 devstack sudo[99085]: pam_unix(sudo:session): session closed for user root Sep 04 22:48:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-448e468e-8f98-4bca-b656-900cfc8c3596 tempest-TestServerVolumeAttachmentScenario-573049963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c7a9b6df-c632-4576-90f6-3da9ae63fadf" returned: 0 in 0.262s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:48:36 devstack sudo[99086]: pam_unix(sudo:session): session closed for user root Sep 04 22:48:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-65198ec5-5236-4d17-adc6-b02b1076552e tempest-VolumesDeleteCascade-1845763094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f2a29295-b28c-42dc-8815-2ae5d215c267.368fec65-49bc-49f4-9ebe-bdef01959fc1" returned: 0 in 0.262s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:48:36 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-448e468e-8f98-4bca-b656-900cfc8c3596 tempest-TestServerVolumeAttachmentScenario-573049963 None] Lock "cinder-quobyte-c7a9b6df-c632-4576-90f6-3da9ae63fadf" released by "delete_volume" :: held 0.767s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:48:36 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-65198ec5-5236-4d17-adc6-b02b1076552e tempest-VolumesDeleteCascade-1845763094 None] Lock "cinder-quobyte-368fec65-49bc-49f4-9ebe-bdef01959fc1" released by "_delete_snapshot" :: held 1.779s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:48:36 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-65198ec5-5236-4d17-adc6-b02b1076552e tempest-VolumesDeleteCascade-1845763094 None] Lock "cinder-quobyte-f2a29295-b28c-42dc-8815-2ae5d215c267" released by "delete_snapshot" :: held 1.839s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:48:36 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-448e468e-8f98-4bca-b656-900cfc8c3596 tempest-TestServerVolumeAttachmentScenario-573049963 None] Created reservations ['a6e99435-1882-4d9f-914b-a25163653927', '9cbe1ca5-339e-4b12-87f9-31a6833f272c', 'd96d5d4b-3dc6-43e2-bcd4-531689c03e2b', '0d9a793e-775a-4977-b587-78710330eaa5'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:48:36 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-65198ec5-5236-4d17-adc6-b02b1076552e tempest-VolumesDeleteCascade-1845763094 None] Created reservations ['4f0d12b3-460b-4824-974e-28cd62ac20ea', '7d79aaf4-20f7-4b7d-a39b-874af1e8644f', '4165ff56-1226-446c-bafb-b7d020c8e734', 'b4866500-6a9d-4bda-b68f-788fdc9605a9'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:48:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-448e468e-8f98-4bca-b656-900cfc8c3596 tempest-TestServerVolumeAttachmentScenario-573049963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:48:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-448e468e-8f98-4bca-b656-900cfc8c3596 tempest-TestServerVolumeAttachmentScenario-573049963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:48:36 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-448e468e-8f98-4bca-b656-900cfc8c3596 tempest-TestServerVolumeAttachmentScenario-573049963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:48:36 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-448e468e-8f98-4bca-b656-900cfc8c3596 tempest-TestServerVolumeAttachmentScenario-573049963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:48:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-448e468e-8f98-4bca-b656-900cfc8c3596 tempest-TestServerVolumeAttachmentScenario-573049963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:48:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-448e468e-8f98-4bca-b656-900cfc8c3596 tempest-TestServerVolumeAttachmentScenario-573049963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:48:36 devstack sudo[99091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:48:36 devstack sudo[99091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:48:36 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-65198ec5-5236-4d17-adc6-b02b1076552e tempest-VolumesDeleteCascade-1845763094 None] Delete snapshot completed successfully. Sep 04 22:48:36 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-65198ec5-5236-4d17-adc6-b02b1076552e tempest-VolumesDeleteCascade-1845763094 None] Lock "cinder-368fec65-49bc-49f4-9ebe-bdef01959fc1-delete_snapshot" released by "delete_snapshot" :: held 2.102s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:48:36 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-65198ec5-5236-4d17-adc6-b02b1076552e tempest-VolumesDeleteCascade-1845763094 None] Snapshots deleted, issuing volume delete {{(pid=87576) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 04 22:48:36 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-65198ec5-5236-4d17-adc6-b02b1076552e tempest-VolumesDeleteCascade-1845763094 None] Acquiring lock "cinder-quobyte-f2a29295-b28c-42dc-8815-2ae5d215c267" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:48:36 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-65198ec5-5236-4d17-adc6-b02b1076552e tempest-VolumesDeleteCascade-1845763094 None] Lock "cinder-quobyte-f2a29295-b28c-42dc-8815-2ae5d215c267" acquired by "delete_volume" :: waited 0.019s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:48:36 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[c744ad9a-a153-4b44-9ec3-68066d8e1304]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:48:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-65198ec5-5236-4d17-adc6-b02b1076552e tempest-VolumesDeleteCascade-1845763094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f2a29295-b28c-42dc-8815-2ae5d215c267 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:48:36 devstack sudo[99091]: pam_unix(sudo:session): session closed for user root Sep 04 22:48:36 devstack sudo[99093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f2a29295-b28c-42dc-8815-2ae5d215c267 Sep 04 22:48:36 devstack sudo[99093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:48:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-448e468e-8f98-4bca-b656-900cfc8c3596 tempest-TestServerVolumeAttachmentScenario-573049963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.288s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:48:36 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-448e468e-8f98-4bca-b656-900cfc8c3596 tempest-TestServerVolumeAttachmentScenario-573049963 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:48:36 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-448e468e-8f98-4bca-b656-900cfc8c3596 tempest-TestServerVolumeAttachmentScenario-573049963 None] Deleted volume successfully. Sep 04 22:48:36 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-448e468e-8f98-4bca-b656-900cfc8c3596 tempest-TestServerVolumeAttachmentScenario-573049963 None] Lock "cinder-c7a9b6df-c632-4576-90f6-3da9ae63fadf-delete_volume" released by "delete_volume" :: held 1.345s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:48:37 devstack sudo[99093]: pam_unix(sudo:session): session closed for user root Sep 04 22:48:37 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-65198ec5-5236-4d17-adc6-b02b1076552e tempest-VolumesDeleteCascade-1845763094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f2a29295-b28c-42dc-8815-2ae5d215c267" returned: 0 in 0.480s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:48:37 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-65198ec5-5236-4d17-adc6-b02b1076552e tempest-VolumesDeleteCascade-1845763094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f2a29295-b28c-42dc-8815-2ae5d215c267 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:48:37 devstack sudo[99099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f2a29295-b28c-42dc-8815-2ae5d215c267 Sep 04 22:48:37 devstack sudo[99099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:48:37 devstack sudo[99099]: pam_unix(sudo:session): session closed for user root Sep 04 22:48:37 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-65198ec5-5236-4d17-adc6-b02b1076552e tempest-VolumesDeleteCascade-1845763094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-f2a29295-b28c-42dc-8815-2ae5d215c267" returned: 0 in 0.275s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:48:37 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-65198ec5-5236-4d17-adc6-b02b1076552e tempest-VolumesDeleteCascade-1845763094 None] Lock "cinder-quobyte-f2a29295-b28c-42dc-8815-2ae5d215c267" released by "delete_volume" :: held 0.858s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:48:37 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-65198ec5-5236-4d17-adc6-b02b1076552e tempest-VolumesDeleteCascade-1845763094 None] Created reservations ['2065deba-ee99-4fe4-8cb9-172021e233d0', 'e1db5bef-8d61-40a8-b1f6-aec6d201b352', '57643983-fe58-4b9f-beb3-f698f5c5855d', 'fdc05a43-5cac-420f-898d-e0ab050bc5a9'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:48:37 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-65198ec5-5236-4d17-adc6-b02b1076552e tempest-VolumesDeleteCascade-1845763094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:48:37 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-65198ec5-5236-4d17-adc6-b02b1076552e tempest-VolumesDeleteCascade-1845763094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:48:37 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-65198ec5-5236-4d17-adc6-b02b1076552e tempest-VolumesDeleteCascade-1845763094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:48:37 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-65198ec5-5236-4d17-adc6-b02b1076552e tempest-VolumesDeleteCascade-1845763094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:48:37 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-65198ec5-5236-4d17-adc6-b02b1076552e tempest-VolumesDeleteCascade-1845763094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:48:37 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-65198ec5-5236-4d17-adc6-b02b1076552e tempest-VolumesDeleteCascade-1845763094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:48:37 devstack sudo[99102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:48:37 devstack sudo[99102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:48:37 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f9befdb0-4fb4-4435-ab15-fffc5965796c tempest-VolumesDeleteCascade-1845763094 None] Acquiring lock "cinder-7b77b599-5cf8-4a22-87c1-50eee02e883d-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:48:37 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f9befdb0-4fb4-4435-ab15-fffc5965796c tempest-VolumesDeleteCascade-1845763094 None] Lock "cinder-7b77b599-5cf8-4a22-87c1-50eee02e883d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:48:37 devstack cinder-volume[87576]: DEBUG dbcounter [-] [87576] Writing DB stats cinder:SELECT=120,cinder:INSERT=30,cinder:UPDATE=107,cinder:DELETE=9 {{(pid=87576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 22:48:37 devstack cinder-volume[87576]: DEBUG dbcounter [-] [87576] Writing DB stats cinder:SELECT=103,cinder:UPDATE=115,cinder:INSERT=37,cinder:DELETE=6 {{(pid=87576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 22:48:37 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f9befdb0-4fb4-4435-ab15-fffc5965796c tempest-VolumesDeleteCascade-1845763094 None] Acquiring lock "cinder-quobyte-7b77b599-5cf8-4a22-87c1-50eee02e883d" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:48:38 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f9befdb0-4fb4-4435-ab15-fffc5965796c tempest-VolumesDeleteCascade-1845763094 None] Lock "cinder-quobyte-7b77b599-5cf8-4a22-87c1-50eee02e883d" acquired by "delete_volume" :: waited 0.020s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:48:38 devstack sudo[99102]: pam_unix(sudo:session): session closed for user root Sep 04 22:48:38 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-65198ec5-5236-4d17-adc6-b02b1076552e tempest-VolumesDeleteCascade-1845763094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.323s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:48:38 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-65198ec5-5236-4d17-adc6-b02b1076552e tempest-VolumesDeleteCascade-1845763094 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:48:38 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd1fe159-7ab3-481c-a049-20c8396c99a2]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:48:38 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f9befdb0-4fb4-4435-ab15-fffc5965796c tempest-VolumesDeleteCascade-1845763094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7b77b599-5cf8-4a22-87c1-50eee02e883d {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:48:38 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-65198ec5-5236-4d17-adc6-b02b1076552e tempest-VolumesDeleteCascade-1845763094 None] Deleted volume successfully. Sep 04 22:48:38 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-65198ec5-5236-4d17-adc6-b02b1076552e tempest-VolumesDeleteCascade-1845763094 None] Lock "cinder-f2a29295-b28c-42dc-8815-2ae5d215c267-delete_volume" released by "delete_volume" :: held 3.641s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:48:38 devstack sudo[99105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7b77b599-5cf8-4a22-87c1-50eee02e883d Sep 04 22:48:38 devstack sudo[99105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:48:38 devstack sudo[99105]: pam_unix(sudo:session): session closed for user root Sep 04 22:48:38 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f9befdb0-4fb4-4435-ab15-fffc5965796c tempest-VolumesDeleteCascade-1845763094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7b77b599-5cf8-4a22-87c1-50eee02e883d" returned: 0 in 0.423s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:48:38 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f9befdb0-4fb4-4435-ab15-fffc5965796c tempest-VolumesDeleteCascade-1845763094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7b77b599-5cf8-4a22-87c1-50eee02e883d {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:48:38 devstack sudo[99111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7b77b599-5cf8-4a22-87c1-50eee02e883d Sep 04 22:48:38 devstack sudo[99111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:48:38 devstack sudo[99111]: pam_unix(sudo:session): session closed for user root Sep 04 22:48:38 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f9befdb0-4fb4-4435-ab15-fffc5965796c tempest-VolumesDeleteCascade-1845763094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7b77b599-5cf8-4a22-87c1-50eee02e883d" returned: 0 in 0.269s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:48:38 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f9befdb0-4fb4-4435-ab15-fffc5965796c tempest-VolumesDeleteCascade-1845763094 None] Lock "cinder-quobyte-7b77b599-5cf8-4a22-87c1-50eee02e883d" released by "delete_volume" :: held 0.746s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:48:38 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-f9befdb0-4fb4-4435-ab15-fffc5965796c tempest-VolumesDeleteCascade-1845763094 None] Created reservations ['292f1ab9-2dbf-4278-b7af-aeb281aa6c63', '308241d2-17ff-492c-bf18-cf3083ebed4f', '883ddd74-8cf4-4c2a-84d6-82b89dab28c3', 'b3176e24-67a8-47da-b3bf-c8a839003d89'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:48:38 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f9befdb0-4fb4-4435-ab15-fffc5965796c tempest-VolumesDeleteCascade-1845763094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:48:38 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f9befdb0-4fb4-4435-ab15-fffc5965796c tempest-VolumesDeleteCascade-1845763094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:48:38 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-f9befdb0-4fb4-4435-ab15-fffc5965796c tempest-VolumesDeleteCascade-1845763094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:48:38 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-f9befdb0-4fb4-4435-ab15-fffc5965796c tempest-VolumesDeleteCascade-1845763094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:48:38 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f9befdb0-4fb4-4435-ab15-fffc5965796c tempest-VolumesDeleteCascade-1845763094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:48:38 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f9befdb0-4fb4-4435-ab15-fffc5965796c tempest-VolumesDeleteCascade-1845763094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:48:38 devstack sudo[99114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:48:38 devstack sudo[99114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:48:39 devstack sudo[99114]: pam_unix(sudo:session): session closed for user root Sep 04 22:48:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f9befdb0-4fb4-4435-ab15-fffc5965796c tempest-VolumesDeleteCascade-1845763094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.332s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:48:39 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-f9befdb0-4fb4-4435-ab15-fffc5965796c tempest-VolumesDeleteCascade-1845763094 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:48:39 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-f9befdb0-4fb4-4435-ab15-fffc5965796c tempest-VolumesDeleteCascade-1845763094 None] Deleted volume successfully. Sep 04 22:48:39 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f9befdb0-4fb4-4435-ab15-fffc5965796c tempest-VolumesDeleteCascade-1845763094 None] Lock "cinder-7b77b599-5cf8-4a22-87c1-50eee02e883d-delete_volume" released by "delete_volume" :: held 1.345s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:48:45 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-497f87e7-44a0-4eb0-8a10-19fd794dd414 tempest-AttachVolumeNegativeTest-2019172075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:48:45 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-497f87e7-44a0-4eb0-8a10-19fd794dd414 tempest-AttachVolumeNegativeTest-2019172075 None] Flow 'volume_create_manager' (b43fa73b-3456-4608-a923-4847901eb61d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:48:45 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-497f87e7-44a0-4eb0-8a10-19fd794dd414 tempest-AttachVolumeNegativeTest-2019172075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc665e00-3638-4544-ada8-405a188f6ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:48:45 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-497f87e7-44a0-4eb0-8a10-19fd794dd414 tempest-AttachVolumeNegativeTest-2019172075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc665e00-3638-4544-ada8-405a188f6ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:48:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-823342241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4658efb-31d0-45d7-9e39-16fb47aeb69b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e80e6c251404ba9b9947664ac5836f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:48:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:48:45Z,use_quota=True,user_id='047f7ffdca4c45cdb2cc83f5261484c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:48:45 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-497f87e7-44a0-4eb0-8a10-19fd794dd414 tempest-AttachVolumeNegativeTest-2019172075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45442e0c-dcc7-44e4-9040-792a8ebef62a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:48:45 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-497f87e7-44a0-4eb0-8a10-19fd794dd414 tempest-AttachVolumeNegativeTest-2019172075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45442e0c-dcc7-44e4-9040-792a8ebef62a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:48:45 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-497f87e7-44a0-4eb0-8a10-19fd794dd414 tempest-AttachVolumeNegativeTest-2019172075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f83df8fb-ea72-45eb-ae13-954f8ecf3975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:48:45 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-497f87e7-44a0-4eb0-8a10-19fd794dd414 tempest-AttachVolumeNegativeTest-2019172075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f83df8fb-ea72-45eb-ae13-954f8ecf3975) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4658efb-31d0-45d7-9e39-16fb47aeb69b', 'volume_name': 'volume-d4658efb-31d0-45d7-9e39-16fb47aeb69b', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:48:45 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-497f87e7-44a0-4eb0-8a10-19fd794dd414 tempest-AttachVolumeNegativeTest-2019172075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76e0348e-3e6c-4374-a4cf-3a5f3d8cc453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:48:45 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-497f87e7-44a0-4eb0-8a10-19fd794dd414 tempest-AttachVolumeNegativeTest-2019172075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76e0348e-3e6c-4374-a4cf-3a5f3d8cc453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:48:45 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-497f87e7-44a0-4eb0-8a10-19fd794dd414 tempest-AttachVolumeNegativeTest-2019172075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feb1cd15-1081-4dbb-9a99-a90b67f571b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:48:45 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-497f87e7-44a0-4eb0-8a10-19fd794dd414 tempest-AttachVolumeNegativeTest-2019172075 None] Volume d4658efb-31d0-45d7-9e39-16fb47aeb69b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4658efb-31d0-45d7-9e39-16fb47aeb69b', 'volume_size': 1} Sep 04 22:48:45 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-497f87e7-44a0-4eb0-8a10-19fd794dd414 tempest-AttachVolumeNegativeTest-2019172075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:48:45 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-497f87e7-44a0-4eb0-8a10-19fd794dd414 tempest-AttachVolumeNegativeTest-2019172075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:48:45 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-497f87e7-44a0-4eb0-8a10-19fd794dd414 tempest-AttachVolumeNegativeTest-2019172075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:48:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-823342241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4658efb-31d0-45d7-9e39-16fb47aeb69b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e80e6c251404ba9b9947664ac5836f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:48:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:48:45Z,use_quota=True,user_id='047f7ffdca4c45cdb2cc83f5261484c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:48:45 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-497f87e7-44a0-4eb0-8a10-19fd794dd414 tempest-AttachVolumeNegativeTest-2019172075 None] Creating volume d4658efb-31d0-45d7-9e39-16fb47aeb69b {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:48:45 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-497f87e7-44a0-4eb0-8a10-19fd794dd414 tempest-AttachVolumeNegativeTest-2019172075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:48:45 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-497f87e7-44a0-4eb0-8a10-19fd794dd414 tempest-AttachVolumeNegativeTest-2019172075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:48:45 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-497f87e7-44a0-4eb0-8a10-19fd794dd414 tempest-AttachVolumeNegativeTest-2019172075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:48:45 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-497f87e7-44a0-4eb0-8a10-19fd794dd414 tempest-AttachVolumeNegativeTest-2019172075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:48:45 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-497f87e7-44a0-4eb0-8a10-19fd794dd414 tempest-AttachVolumeNegativeTest-2019172075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:48:45 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-497f87e7-44a0-4eb0-8a10-19fd794dd414 tempest-AttachVolumeNegativeTest-2019172075 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:48:45 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-497f87e7-44a0-4eb0-8a10-19fd794dd414 tempest-AttachVolumeNegativeTest-2019172075 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:48:45 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-497f87e7-44a0-4eb0-8a10-19fd794dd414 tempest-AttachVolumeNegativeTest-2019172075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d4658efb-31d0-45d7-9e39-16fb47aeb69b 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:48:45 devstack sudo[99125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d4658efb-31d0-45d7-9e39-16fb47aeb69b 1073741824 Sep 04 22:48:45 devstack sudo[99125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:48:45 devstack sudo[99125]: pam_unix(sudo:session): session closed for user root Sep 04 22:48:45 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-497f87e7-44a0-4eb0-8a10-19fd794dd414 tempest-AttachVolumeNegativeTest-2019172075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d4658efb-31d0-45d7-9e39-16fb47aeb69b 1073741824" returned: 0 in 0.589s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:48:45 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-497f87e7-44a0-4eb0-8a10-19fd794dd414 tempest-AttachVolumeNegativeTest-2019172075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d4658efb-31d0-45d7-9e39-16fb47aeb69b {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:48:45 devstack sudo[99132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d4658efb-31d0-45d7-9e39-16fb47aeb69b Sep 04 22:48:45 devstack sudo[99132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:48:46 devstack sudo[99132]: pam_unix(sudo:session): session closed for user root Sep 04 22:48:46 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-497f87e7-44a0-4eb0-8a10-19fd794dd414 tempest-AttachVolumeNegativeTest-2019172075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d4658efb-31d0-45d7-9e39-16fb47aeb69b" returned: 0 in 0.341s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:48:46 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-497f87e7-44a0-4eb0-8a10-19fd794dd414 tempest-AttachVolumeNegativeTest-2019172075 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:48:46 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-497f87e7-44a0-4eb0-8a10-19fd794dd414 tempest-AttachVolumeNegativeTest-2019172075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:48:46 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-497f87e7-44a0-4eb0-8a10-19fd794dd414 tempest-AttachVolumeNegativeTest-2019172075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feb1cd15-1081-4dbb-9a99-a90b67f571b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4658efb-31d0-45d7-9e39-16fb47aeb69b', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:48:46 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-497f87e7-44a0-4eb0-8a10-19fd794dd414 tempest-AttachVolumeNegativeTest-2019172075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f78370a3-4754-460a-9630-581f6fcfe244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:48:46 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-497f87e7-44a0-4eb0-8a10-19fd794dd414 tempest-AttachVolumeNegativeTest-2019172075 None] Volume volume-d4658efb-31d0-45d7-9e39-16fb47aeb69b (d4658efb-31d0-45d7-9e39-16fb47aeb69b): created successfully Sep 04 22:48:46 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-497f87e7-44a0-4eb0-8a10-19fd794dd414 tempest-AttachVolumeNegativeTest-2019172075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f78370a3-4754-460a-9630-581f6fcfe244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:48:46 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-497f87e7-44a0-4eb0-8a10-19fd794dd414 tempest-AttachVolumeNegativeTest-2019172075 None] Flow 'volume_create_manager' (b43fa73b-3456-4608-a923-4847901eb61d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:48:46 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-497f87e7-44a0-4eb0-8a10-19fd794dd414 tempest-AttachVolumeNegativeTest-2019172075 None] Created volume successfully. Sep 04 22:48:48 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-c49e9242-78ab-4196-9923-0af02bdfffb7 req-21a18611-cf4e-4208-9a1c-6d24b9a03469 tempest-AttachVolumeNegativeTest-2019172075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:48:48 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-c49e9242-78ab-4196-9923-0af02bdfffb7 req-21a18611-cf4e-4208-9a1c-6d24b9a03469 tempest-AttachVolumeNegativeTest-2019172075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:48:48 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-c49e9242-78ab-4196-9923-0af02bdfffb7 req-21a18611-cf4e-4208-9a1c-6d24b9a03469 tempest-AttachVolumeNegativeTest-2019172075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:48:48 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-c49e9242-78ab-4196-9923-0af02bdfffb7 req-21a18611-cf4e-4208-9a1c-6d24b9a03469 tempest-AttachVolumeNegativeTest-2019172075 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4', 'name': 'volume-d4658efb-31d0-45d7-9e39-16fb47aeb69b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2f80532a-af68-4bda-9735-4b0304cfb51d', 'enforce_multipath': True} {{(pid=87576) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 22:48:48 devstack cinder-volume[87576]: INFO cinder.volume.manager [req-c49e9242-78ab-4196-9923-0af02bdfffb7 req-21a18611-cf4e-4208-9a1c-6d24b9a03469 tempest-AttachVolumeNegativeTest-2019172075 None] attachment_update completed successfully. Sep 04 22:48:54 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-b297463b-f617-40d9-a34f-30fd3da97139 tempest-ProjectReaderTests-298502250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:48:54 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-b297463b-f617-40d9-a34f-30fd3da97139 tempest-ProjectReaderTests-298502250 None] Flow 'volume_create_manager' (2ae24935-1b82-4078-9291-ad24dd6452be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:48:54 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-b297463b-f617-40d9-a34f-30fd3da97139 tempest-ProjectReaderTests-298502250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (488d1596-70b9-4de8-9917-bc4d012de86c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:48:54 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-b297463b-f617-40d9-a34f-30fd3da97139 tempest-ProjectReaderTests-298502250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (488d1596-70b9-4de8-9917-bc4d012de86c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:48:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-720812453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28b6a901-2d5a-4020-ae1a-11fd3d3596a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef6d8bc8717f4b0dacd3ce5d51286c46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:48:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:48:54Z,use_quota=True,user_id='165348feea3a4639b68bb99d634180ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:48:54 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-b297463b-f617-40d9-a34f-30fd3da97139 tempest-ProjectReaderTests-298502250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19e0fcef-871f-40f7-beec-fcb56c7b85e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:48:54 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-b297463b-f617-40d9-a34f-30fd3da97139 tempest-ProjectReaderTests-298502250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19e0fcef-871f-40f7-beec-fcb56c7b85e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:48:54 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-b297463b-f617-40d9-a34f-30fd3da97139 tempest-ProjectReaderTests-298502250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (765cb597-a540-4f90-b39b-fd6d38fbea61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:48:54 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-b297463b-f617-40d9-a34f-30fd3da97139 tempest-ProjectReaderTests-298502250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (765cb597-a540-4f90-b39b-fd6d38fbea61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28b6a901-2d5a-4020-ae1a-11fd3d3596a4', 'volume_name': 'volume-28b6a901-2d5a-4020-ae1a-11fd3d3596a4', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:48:54 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-b297463b-f617-40d9-a34f-30fd3da97139 tempest-ProjectReaderTests-298502250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7292b72d-fabe-4d19-a660-12007ef18f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:48:54 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-b297463b-f617-40d9-a34f-30fd3da97139 tempest-ProjectReaderTests-298502250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7292b72d-fabe-4d19-a660-12007ef18f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:48:54 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-b297463b-f617-40d9-a34f-30fd3da97139 tempest-ProjectReaderTests-298502250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37971710-75ec-466f-ba0d-0e836c9301ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:48:54 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-b297463b-f617-40d9-a34f-30fd3da97139 tempest-ProjectReaderTests-298502250 None] Volume 28b6a901-2d5a-4020-ae1a-11fd3d3596a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28b6a901-2d5a-4020-ae1a-11fd3d3596a4', 'volume_size': 1} Sep 04 22:48:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-b297463b-f617-40d9-a34f-30fd3da97139 tempest-ProjectReaderTests-298502250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:48:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-b297463b-f617-40d9-a34f-30fd3da97139 tempest-ProjectReaderTests-298502250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:48:54 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-b297463b-f617-40d9-a34f-30fd3da97139 tempest-ProjectReaderTests-298502250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:48:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-720812453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28b6a901-2d5a-4020-ae1a-11fd3d3596a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef6d8bc8717f4b0dacd3ce5d51286c46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:48:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:48:54Z,use_quota=True,user_id='165348feea3a4639b68bb99d634180ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:48:54 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-b297463b-f617-40d9-a34f-30fd3da97139 tempest-ProjectReaderTests-298502250 None] Creating volume 28b6a901-2d5a-4020-ae1a-11fd3d3596a4 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:48:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-b297463b-f617-40d9-a34f-30fd3da97139 tempest-ProjectReaderTests-298502250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:48:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-b297463b-f617-40d9-a34f-30fd3da97139 tempest-ProjectReaderTests-298502250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:48:54 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-b297463b-f617-40d9-a34f-30fd3da97139 tempest-ProjectReaderTests-298502250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:48:54 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-b297463b-f617-40d9-a34f-30fd3da97139 tempest-ProjectReaderTests-298502250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:48:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-b297463b-f617-40d9-a34f-30fd3da97139 tempest-ProjectReaderTests-298502250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:48:54 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-b297463b-f617-40d9-a34f-30fd3da97139 tempest-ProjectReaderTests-298502250 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:48:54 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-b297463b-f617-40d9-a34f-30fd3da97139 tempest-ProjectReaderTests-298502250 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:48:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b297463b-f617-40d9-a34f-30fd3da97139 tempest-ProjectReaderTests-298502250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-28b6a901-2d5a-4020-ae1a-11fd3d3596a4 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:48:54 devstack sudo[99541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-28b6a901-2d5a-4020-ae1a-11fd3d3596a4 1073741824 Sep 04 22:48:54 devstack sudo[99541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:48:54 devstack sudo[99541]: pam_unix(sudo:session): session closed for user root Sep 04 22:48:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b297463b-f617-40d9-a34f-30fd3da97139 tempest-ProjectReaderTests-298502250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-28b6a901-2d5a-4020-ae1a-11fd3d3596a4 1073741824" returned: 0 in 0.579s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:48:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b297463b-f617-40d9-a34f-30fd3da97139 tempest-ProjectReaderTests-298502250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-28b6a901-2d5a-4020-ae1a-11fd3d3596a4 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:48:54 devstack sudo[99547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-28b6a901-2d5a-4020-ae1a-11fd3d3596a4 Sep 04 22:48:54 devstack sudo[99547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:48:55 devstack sudo[99547]: pam_unix(sudo:session): session closed for user root Sep 04 22:48:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b297463b-f617-40d9-a34f-30fd3da97139 tempest-ProjectReaderTests-298502250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-28b6a901-2d5a-4020-ae1a-11fd3d3596a4" returned: 0 in 0.324s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:48:55 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-b297463b-f617-40d9-a34f-30fd3da97139 tempest-ProjectReaderTests-298502250 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:48:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-b297463b-f617-40d9-a34f-30fd3da97139 tempest-ProjectReaderTests-298502250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:48:55 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-b297463b-f617-40d9-a34f-30fd3da97139 tempest-ProjectReaderTests-298502250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37971710-75ec-466f-ba0d-0e836c9301ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28b6a901-2d5a-4020-ae1a-11fd3d3596a4', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:48:55 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-b297463b-f617-40d9-a34f-30fd3da97139 tempest-ProjectReaderTests-298502250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92ee5cf2-a123-4262-9453-f0a83fd1f7e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:48:55 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-b297463b-f617-40d9-a34f-30fd3da97139 tempest-ProjectReaderTests-298502250 None] Volume volume-28b6a901-2d5a-4020-ae1a-11fd3d3596a4 (28b6a901-2d5a-4020-ae1a-11fd3d3596a4): created successfully Sep 04 22:48:55 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-b297463b-f617-40d9-a34f-30fd3da97139 tempest-ProjectReaderTests-298502250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92ee5cf2-a123-4262-9453-f0a83fd1f7e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:48:55 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-b297463b-f617-40d9-a34f-30fd3da97139 tempest-ProjectReaderTests-298502250 None] Flow 'volume_create_manager' (2ae24935-1b82-4078-9291-ad24dd6452be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:48:55 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-b297463b-f617-40d9-a34f-30fd3da97139 tempest-ProjectReaderTests-298502250 None] Created volume successfully. Sep 04 22:48:56 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-db90ac8b-6447-4bc1-a3a9-c29dfbfe9263 tempest-ProjectReaderTests-298502250 None] Acquiring lock "cinder-28b6a901-2d5a-4020-ae1a-11fd3d3596a4-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:48:56 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-db90ac8b-6447-4bc1-a3a9-c29dfbfe9263 tempest-ProjectReaderTests-298502250 None] Lock "cinder-28b6a901-2d5a-4020-ae1a-11fd3d3596a4-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:48:56 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-db90ac8b-6447-4bc1-a3a9-c29dfbfe9263 tempest-ProjectReaderTests-298502250 None] Acquiring lock "cinder-quobyte-28b6a901-2d5a-4020-ae1a-11fd3d3596a4" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:48:56 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-db90ac8b-6447-4bc1-a3a9-c29dfbfe9263 tempest-ProjectReaderTests-298502250 None] Lock "cinder-quobyte-28b6a901-2d5a-4020-ae1a-11fd3d3596a4" acquired by "delete_volume" :: waited 0.028s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:48:56 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[4093683e-7fcd-4a7d-a14c-f2cb1e046509]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:48:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-db90ac8b-6447-4bc1-a3a9-c29dfbfe9263 tempest-ProjectReaderTests-298502250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-28b6a901-2d5a-4020-ae1a-11fd3d3596a4 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:48:56 devstack sudo[99550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-28b6a901-2d5a-4020-ae1a-11fd3d3596a4 Sep 04 22:48:56 devstack sudo[99550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:48:57 devstack sudo[99550]: pam_unix(sudo:session): session closed for user root Sep 04 22:48:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-db90ac8b-6447-4bc1-a3a9-c29dfbfe9263 tempest-ProjectReaderTests-298502250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-28b6a901-2d5a-4020-ae1a-11fd3d3596a4" returned: 0 in 0.509s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:48:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-db90ac8b-6447-4bc1-a3a9-c29dfbfe9263 tempest-ProjectReaderTests-298502250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-28b6a901-2d5a-4020-ae1a-11fd3d3596a4 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:48:57 devstack sudo[99557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-28b6a901-2d5a-4020-ae1a-11fd3d3596a4 Sep 04 22:48:57 devstack sudo[99557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:48:57 devstack sudo[99557]: pam_unix(sudo:session): session closed for user root Sep 04 22:48:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-db90ac8b-6447-4bc1-a3a9-c29dfbfe9263 tempest-ProjectReaderTests-298502250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-28b6a901-2d5a-4020-ae1a-11fd3d3596a4" returned: 0 in 0.363s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:48:57 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-db90ac8b-6447-4bc1-a3a9-c29dfbfe9263 tempest-ProjectReaderTests-298502250 None] Lock "cinder-quobyte-28b6a901-2d5a-4020-ae1a-11fd3d3596a4" released by "delete_volume" :: held 0.931s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:48:57 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-db90ac8b-6447-4bc1-a3a9-c29dfbfe9263 tempest-ProjectReaderTests-298502250 None] Created reservations ['f468d8e9-c79e-469c-95c3-37b7ab942cb9', '709f99ac-51fc-405a-8e61-2571697dff26', '2ff94f7d-7161-482a-9699-d23158d712de', 'a2ef5869-b431-400e-94b6-4ecbc54a48cd'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:48:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-db90ac8b-6447-4bc1-a3a9-c29dfbfe9263 tempest-ProjectReaderTests-298502250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:48:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-db90ac8b-6447-4bc1-a3a9-c29dfbfe9263 tempest-ProjectReaderTests-298502250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:48:57 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-db90ac8b-6447-4bc1-a3a9-c29dfbfe9263 tempest-ProjectReaderTests-298502250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:48:57 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-db90ac8b-6447-4bc1-a3a9-c29dfbfe9263 tempest-ProjectReaderTests-298502250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:48:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-db90ac8b-6447-4bc1-a3a9-c29dfbfe9263 tempest-ProjectReaderTests-298502250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:48:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-db90ac8b-6447-4bc1-a3a9-c29dfbfe9263 tempest-ProjectReaderTests-298502250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:48:57 devstack sudo[99569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:48:57 devstack sudo[99569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:48:57 devstack sudo[99569]: pam_unix(sudo:session): session closed for user root Sep 04 22:48:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-db90ac8b-6447-4bc1-a3a9-c29dfbfe9263 tempest-ProjectReaderTests-298502250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.290s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:48:57 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-db90ac8b-6447-4bc1-a3a9-c29dfbfe9263 tempest-ProjectReaderTests-298502250 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:48:58 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-db90ac8b-6447-4bc1-a3a9-c29dfbfe9263 tempest-ProjectReaderTests-298502250 None] Deleted volume successfully. Sep 04 22:48:58 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-db90ac8b-6447-4bc1-a3a9-c29dfbfe9263 tempest-ProjectReaderTests-298502250 None] Lock "cinder-28b6a901-2d5a-4020-ae1a-11fd3d3596a4-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:48:59 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-faa881ca-57b3-47d9-9cca-41b00f31064b tempest-VolumesActionsTest-1053366409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:48:59 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-faa881ca-57b3-47d9-9cca-41b00f31064b tempest-VolumesActionsTest-1053366409 None] Flow 'volume_create_manager' (ab054948-6847-4f84-af73-1481f4cece44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:48:59 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-faa881ca-57b3-47d9-9cca-41b00f31064b tempest-VolumesActionsTest-1053366409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84e5bd48-bd76-40c0-a13c-8727a9976b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:48:59 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-faa881ca-57b3-47d9-9cca-41b00f31064b tempest-VolumesActionsTest-1053366409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84e5bd48-bd76-40c0-a13c-8727a9976b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:48:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-58324082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46da67d1-af60-4135-b585-6cc3e02fa5c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9203ccd134044aa9a72b3d8e3d704ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:48:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:48:59Z,use_quota=True,user_id='26056bbf42f14bb28ee132a53f9e2441',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:48:59 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-faa881ca-57b3-47d9-9cca-41b00f31064b tempest-VolumesActionsTest-1053366409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8127c266-fc85-4ab5-8276-34d4f6dad50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:48:59 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-faa881ca-57b3-47d9-9cca-41b00f31064b tempest-VolumesActionsTest-1053366409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8127c266-fc85-4ab5-8276-34d4f6dad50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:48:59 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-faa881ca-57b3-47d9-9cca-41b00f31064b tempest-VolumesActionsTest-1053366409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee6b7736-281d-4eb9-b3c8-079f62c25568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:48:59 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-faa881ca-57b3-47d9-9cca-41b00f31064b tempest-VolumesActionsTest-1053366409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee6b7736-281d-4eb9-b3c8-079f62c25568) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46da67d1-af60-4135-b585-6cc3e02fa5c3', 'volume_name': 'volume-46da67d1-af60-4135-b585-6cc3e02fa5c3', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:48:59 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-faa881ca-57b3-47d9-9cca-41b00f31064b tempest-VolumesActionsTest-1053366409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04839f49-01b7-4dd6-8861-d3431a107df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:48:59 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-faa881ca-57b3-47d9-9cca-41b00f31064b tempest-VolumesActionsTest-1053366409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04839f49-01b7-4dd6-8861-d3431a107df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:48:59 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-faa881ca-57b3-47d9-9cca-41b00f31064b tempest-VolumesActionsTest-1053366409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb7883b2-0334-46e9-b9f9-611f4b2d208b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:48:59 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-faa881ca-57b3-47d9-9cca-41b00f31064b tempest-VolumesActionsTest-1053366409 None] Volume 46da67d1-af60-4135-b585-6cc3e02fa5c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46da67d1-af60-4135-b585-6cc3e02fa5c3', 'volume_size': 1} Sep 04 22:48:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-faa881ca-57b3-47d9-9cca-41b00f31064b tempest-VolumesActionsTest-1053366409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:48:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-faa881ca-57b3-47d9-9cca-41b00f31064b tempest-VolumesActionsTest-1053366409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:48:59 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-faa881ca-57b3-47d9-9cca-41b00f31064b tempest-VolumesActionsTest-1053366409 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:48:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-58324082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46da67d1-af60-4135-b585-6cc3e02fa5c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9203ccd134044aa9a72b3d8e3d704ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:48:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:48:59Z,use_quota=True,user_id='26056bbf42f14bb28ee132a53f9e2441',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:48:59 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-faa881ca-57b3-47d9-9cca-41b00f31064b tempest-VolumesActionsTest-1053366409 None] Creating volume 46da67d1-af60-4135-b585-6cc3e02fa5c3 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:48:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-faa881ca-57b3-47d9-9cca-41b00f31064b tempest-VolumesActionsTest-1053366409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:48:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-faa881ca-57b3-47d9-9cca-41b00f31064b tempest-VolumesActionsTest-1053366409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:48:59 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-faa881ca-57b3-47d9-9cca-41b00f31064b tempest-VolumesActionsTest-1053366409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:48:59 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-faa881ca-57b3-47d9-9cca-41b00f31064b tempest-VolumesActionsTest-1053366409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:48:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-faa881ca-57b3-47d9-9cca-41b00f31064b tempest-VolumesActionsTest-1053366409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:48:59 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-faa881ca-57b3-47d9-9cca-41b00f31064b tempest-VolumesActionsTest-1053366409 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:48:59 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-faa881ca-57b3-47d9-9cca-41b00f31064b tempest-VolumesActionsTest-1053366409 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:48:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-faa881ca-57b3-47d9-9cca-41b00f31064b tempest-VolumesActionsTest-1053366409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-46da67d1-af60-4135-b585-6cc3e02fa5c3 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:48:59 devstack sudo[99575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-46da67d1-af60-4135-b585-6cc3e02fa5c3 1073741824 Sep 04 22:48:59 devstack sudo[99575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:48:59 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fd596c3-4a92-45cd-ba46-20044548f9e0 tempest-ProjectReaderTests-298502250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:48:59 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2fd596c3-4a92-45cd-ba46-20044548f9e0 tempest-ProjectReaderTests-298502250 None] Flow 'volume_create_manager' (d2d25dca-248d-4c41-a87b-7cc02a34c675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:48:59 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2fd596c3-4a92-45cd-ba46-20044548f9e0 tempest-ProjectReaderTests-298502250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20d92225-18cd-4006-821a-e0da1627e953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:48:59 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2fd596c3-4a92-45cd-ba46-20044548f9e0 tempest-ProjectReaderTests-298502250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20d92225-18cd-4006-821a-e0da1627e953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:48:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1738382928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19b9a323-1b80-4dd0-8465-e5b3399d1cfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef6d8bc8717f4b0dacd3ce5d51286c46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:48:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:48:59Z,use_quota=True,user_id='165348feea3a4639b68bb99d634180ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:48:59 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2fd596c3-4a92-45cd-ba46-20044548f9e0 tempest-ProjectReaderTests-298502250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (061db508-e800-4f5f-8286-2096a9898dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:48:59 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2fd596c3-4a92-45cd-ba46-20044548f9e0 tempest-ProjectReaderTests-298502250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (061db508-e800-4f5f-8286-2096a9898dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:48:59 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2fd596c3-4a92-45cd-ba46-20044548f9e0 tempest-ProjectReaderTests-298502250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (100eed2e-a167-46f1-8f78-6fd6c13ea3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:48:59 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2fd596c3-4a92-45cd-ba46-20044548f9e0 tempest-ProjectReaderTests-298502250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (100eed2e-a167-46f1-8f78-6fd6c13ea3cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19b9a323-1b80-4dd0-8465-e5b3399d1cfc', 'volume_name': 'volume-19b9a323-1b80-4dd0-8465-e5b3399d1cfc', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:48:59 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2fd596c3-4a92-45cd-ba46-20044548f9e0 tempest-ProjectReaderTests-298502250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80958560-e619-4711-adc8-6391a06fab08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:48:59 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2fd596c3-4a92-45cd-ba46-20044548f9e0 tempest-ProjectReaderTests-298502250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80958560-e619-4711-adc8-6391a06fab08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:48:59 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2fd596c3-4a92-45cd-ba46-20044548f9e0 tempest-ProjectReaderTests-298502250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (455f70fc-80a0-4576-8c6f-df082c3653de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:48:59 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-2fd596c3-4a92-45cd-ba46-20044548f9e0 tempest-ProjectReaderTests-298502250 None] Volume 19b9a323-1b80-4dd0-8465-e5b3399d1cfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19b9a323-1b80-4dd0-8465-e5b3399d1cfc', 'volume_size': 1} Sep 04 22:48:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-2fd596c3-4a92-45cd-ba46-20044548f9e0 tempest-ProjectReaderTests-298502250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:49:00 devstack sudo[99575]: pam_unix(sudo:session): session closed for user root Sep 04 22:49:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-faa881ca-57b3-47d9-9cca-41b00f31064b tempest-VolumesActionsTest-1053366409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-46da67d1-af60-4135-b585-6cc3e02fa5c3 1073741824" returned: 0 in 0.599s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:49:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-faa881ca-57b3-47d9-9cca-41b00f31064b tempest-VolumesActionsTest-1053366409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-46da67d1-af60-4135-b585-6cc3e02fa5c3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:49:00 devstack sudo[99581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-46da67d1-af60-4135-b585-6cc3e02fa5c3 Sep 04 22:49:00 devstack sudo[99581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:49:00 devstack sudo[99581]: pam_unix(sudo:session): session closed for user root Sep 04 22:49:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-faa881ca-57b3-47d9-9cca-41b00f31064b tempest-VolumesActionsTest-1053366409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-46da67d1-af60-4135-b585-6cc3e02fa5c3" returned: 0 in 0.380s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:49:00 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-faa881ca-57b3-47d9-9cca-41b00f31064b tempest-VolumesActionsTest-1053366409 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:49:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-faa881ca-57b3-47d9-9cca-41b00f31064b tempest-VolumesActionsTest-1053366409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:49:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-2fd596c3-4a92-45cd-ba46-20044548f9e0 tempest-ProjectReaderTests-298502250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.881s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:49:00 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-2fd596c3-4a92-45cd-ba46-20044548f9e0 tempest-ProjectReaderTests-298502250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:48:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1738382928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19b9a323-1b80-4dd0-8465-e5b3399d1cfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef6d8bc8717f4b0dacd3ce5d51286c46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:48:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:48:59Z,use_quota=True,user_id='165348feea3a4639b68bb99d634180ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:49:00 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-2fd596c3-4a92-45cd-ba46-20044548f9e0 tempest-ProjectReaderTests-298502250 None] Creating volume 19b9a323-1b80-4dd0-8465-e5b3399d1cfc {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:49:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-2fd596c3-4a92-45cd-ba46-20044548f9e0 tempest-ProjectReaderTests-298502250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:49:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-2fd596c3-4a92-45cd-ba46-20044548f9e0 tempest-ProjectReaderTests-298502250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:49:00 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-2fd596c3-4a92-45cd-ba46-20044548f9e0 tempest-ProjectReaderTests-298502250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:49:00 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-2fd596c3-4a92-45cd-ba46-20044548f9e0 tempest-ProjectReaderTests-298502250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:49:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-2fd596c3-4a92-45cd-ba46-20044548f9e0 tempest-ProjectReaderTests-298502250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:49:00 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-2fd596c3-4a92-45cd-ba46-20044548f9e0 tempest-ProjectReaderTests-298502250 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:49:00 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-2fd596c3-4a92-45cd-ba46-20044548f9e0 tempest-ProjectReaderTests-298502250 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:49:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2fd596c3-4a92-45cd-ba46-20044548f9e0 tempest-ProjectReaderTests-298502250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-19b9a323-1b80-4dd0-8465-e5b3399d1cfc 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:49:00 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-faa881ca-57b3-47d9-9cca-41b00f31064b tempest-VolumesActionsTest-1053366409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb7883b2-0334-46e9-b9f9-611f4b2d208b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46da67d1-af60-4135-b585-6cc3e02fa5c3', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:49:00 devstack sudo[99584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-19b9a323-1b80-4dd0-8465-e5b3399d1cfc 1073741824 Sep 04 22:49:00 devstack sudo[99584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:49:00 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-faa881ca-57b3-47d9-9cca-41b00f31064b tempest-VolumesActionsTest-1053366409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92ed6fc0-fc00-4676-8462-6cc142b0daa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:49:00 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-faa881ca-57b3-47d9-9cca-41b00f31064b tempest-VolumesActionsTest-1053366409 None] Volume volume-46da67d1-af60-4135-b585-6cc3e02fa5c3 (46da67d1-af60-4135-b585-6cc3e02fa5c3): created successfully Sep 04 22:49:00 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-faa881ca-57b3-47d9-9cca-41b00f31064b tempest-VolumesActionsTest-1053366409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92ed6fc0-fc00-4676-8462-6cc142b0daa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:49:00 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-faa881ca-57b3-47d9-9cca-41b00f31064b tempest-VolumesActionsTest-1053366409 None] Flow 'volume_create_manager' (ab054948-6847-4f84-af73-1481f4cece44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:49:00 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-faa881ca-57b3-47d9-9cca-41b00f31064b tempest-VolumesActionsTest-1053366409 None] Created volume successfully. Sep 04 22:49:01 devstack sudo[99584]: pam_unix(sudo:session): session closed for user root Sep 04 22:49:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2fd596c3-4a92-45cd-ba46-20044548f9e0 tempest-ProjectReaderTests-298502250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-19b9a323-1b80-4dd0-8465-e5b3399d1cfc 1073741824" returned: 0 in 0.563s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:49:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2fd596c3-4a92-45cd-ba46-20044548f9e0 tempest-ProjectReaderTests-298502250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-19b9a323-1b80-4dd0-8465-e5b3399d1cfc {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:49:01 devstack sudo[99590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-19b9a323-1b80-4dd0-8465-e5b3399d1cfc Sep 04 22:49:01 devstack sudo[99590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:49:01 devstack sudo[99590]: pam_unix(sudo:session): session closed for user root Sep 04 22:49:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2fd596c3-4a92-45cd-ba46-20044548f9e0 tempest-ProjectReaderTests-298502250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-19b9a323-1b80-4dd0-8465-e5b3399d1cfc" returned: 0 in 0.481s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:49:01 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-2fd596c3-4a92-45cd-ba46-20044548f9e0 tempest-ProjectReaderTests-298502250 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:49:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-2fd596c3-4a92-45cd-ba46-20044548f9e0 tempest-ProjectReaderTests-298502250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:49:01 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2fd596c3-4a92-45cd-ba46-20044548f9e0 tempest-ProjectReaderTests-298502250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (455f70fc-80a0-4576-8c6f-df082c3653de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19b9a323-1b80-4dd0-8465-e5b3399d1cfc', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:49:01 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2fd596c3-4a92-45cd-ba46-20044548f9e0 tempest-ProjectReaderTests-298502250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edfe204c-c3ee-4cc9-b779-b1bdf55b3254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:49:01 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-2fd596c3-4a92-45cd-ba46-20044548f9e0 tempest-ProjectReaderTests-298502250 None] Volume volume-19b9a323-1b80-4dd0-8465-e5b3399d1cfc (19b9a323-1b80-4dd0-8465-e5b3399d1cfc): created successfully Sep 04 22:49:01 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2fd596c3-4a92-45cd-ba46-20044548f9e0 tempest-ProjectReaderTests-298502250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edfe204c-c3ee-4cc9-b779-b1bdf55b3254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:49:01 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2fd596c3-4a92-45cd-ba46-20044548f9e0 tempest-ProjectReaderTests-298502250 None] Flow 'volume_create_manager' (d2d25dca-248d-4c41-a87b-7cc02a34c675) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:49:01 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-2fd596c3-4a92-45cd-ba46-20044548f9e0 tempest-ProjectReaderTests-298502250 None] Created volume successfully. Sep 04 22:49:02 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-ce973625-a205-41d5-8c2a-80e81a30e084 tempest-ProjectReaderTests-298502250 None] Acquiring lock "cinder-19b9a323-1b80-4dd0-8465-e5b3399d1cfc-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:49:02 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-ce973625-a205-41d5-8c2a-80e81a30e084 tempest-ProjectReaderTests-298502250 None] Lock "cinder-19b9a323-1b80-4dd0-8465-e5b3399d1cfc-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:49:02 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-ce973625-a205-41d5-8c2a-80e81a30e084 tempest-ProjectReaderTests-298502250 None] Acquiring lock "cinder-quobyte-19b9a323-1b80-4dd0-8465-e5b3399d1cfc" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:49:02 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-ce973625-a205-41d5-8c2a-80e81a30e084 tempest-ProjectReaderTests-298502250 None] Lock "cinder-quobyte-19b9a323-1b80-4dd0-8465-e5b3399d1cfc" acquired by "delete_volume" :: waited 0.028s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:49:02 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0dd316-7b7b-40fe-be7a-6bbee727b6af]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:49:02 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ce973625-a205-41d5-8c2a-80e81a30e084 tempest-ProjectReaderTests-298502250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-19b9a323-1b80-4dd0-8465-e5b3399d1cfc {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:49:02 devstack sudo[99611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-19b9a323-1b80-4dd0-8465-e5b3399d1cfc Sep 04 22:49:02 devstack sudo[99611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:49:03 devstack sudo[99611]: pam_unix(sudo:session): session closed for user root Sep 04 22:49:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ce973625-a205-41d5-8c2a-80e81a30e084 tempest-ProjectReaderTests-298502250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-19b9a323-1b80-4dd0-8465-e5b3399d1cfc" returned: 0 in 0.401s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:49:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ce973625-a205-41d5-8c2a-80e81a30e084 tempest-ProjectReaderTests-298502250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-19b9a323-1b80-4dd0-8465-e5b3399d1cfc {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:49:03 devstack sudo[99616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-19b9a323-1b80-4dd0-8465-e5b3399d1cfc Sep 04 22:49:03 devstack sudo[99616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:49:03 devstack sudo[99616]: pam_unix(sudo:session): session closed for user root Sep 04 22:49:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ce973625-a205-41d5-8c2a-80e81a30e084 tempest-ProjectReaderTests-298502250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-19b9a323-1b80-4dd0-8465-e5b3399d1cfc" returned: 0 in 0.287s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:49:03 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-ce973625-a205-41d5-8c2a-80e81a30e084 tempest-ProjectReaderTests-298502250 None] Lock "cinder-quobyte-19b9a323-1b80-4dd0-8465-e5b3399d1cfc" released by "delete_volume" :: held 0.767s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:49:03 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-ce973625-a205-41d5-8c2a-80e81a30e084 tempest-ProjectReaderTests-298502250 None] Created reservations ['726787db-ce86-4bf8-9fb2-c0ffa395f76a', '87af958d-3bce-4820-8bb3-ded4e32de03b', '26d2b9b3-89b5-45fc-b234-70c974d54b34', 'a148d086-dab6-425f-8f34-12ad13ec4210'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:49:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-ce973625-a205-41d5-8c2a-80e81a30e084 tempest-ProjectReaderTests-298502250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:49:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-ce973625-a205-41d5-8c2a-80e81a30e084 tempest-ProjectReaderTests-298502250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:49:03 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-ce973625-a205-41d5-8c2a-80e81a30e084 tempest-ProjectReaderTests-298502250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:49:03 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-ce973625-a205-41d5-8c2a-80e81a30e084 tempest-ProjectReaderTests-298502250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:49:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-ce973625-a205-41d5-8c2a-80e81a30e084 tempest-ProjectReaderTests-298502250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:49:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ce973625-a205-41d5-8c2a-80e81a30e084 tempest-ProjectReaderTests-298502250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:49:03 devstack sudo[99620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:49:03 devstack sudo[99620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:49:04 devstack sudo[99620]: pam_unix(sudo:session): session closed for user root Sep 04 22:49:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ce973625-a205-41d5-8c2a-80e81a30e084 tempest-ProjectReaderTests-298502250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.385s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:49:04 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-ce973625-a205-41d5-8c2a-80e81a30e084 tempest-ProjectReaderTests-298502250 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:49:04 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-ce973625-a205-41d5-8c2a-80e81a30e084 tempest-ProjectReaderTests-298502250 None] Deleted volume successfully. Sep 04 22:49:04 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-ce973625-a205-41d5-8c2a-80e81a30e084 tempest-ProjectReaderTests-298502250 None] Lock "cinder-19b9a323-1b80-4dd0-8465-e5b3399d1cfc-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:49:11 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6e743e2-f8f6-4330-aa0d-2930decc1545 tempest-ProjectReaderTests-183035627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:49:11 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-f6e743e2-f8f6-4330-aa0d-2930decc1545 tempest-ProjectReaderTests-183035627 None] Flow 'volume_create_manager' (b1370d87-24dc-44e5-91e9-af649af1f126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:49:11 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-f6e743e2-f8f6-4330-aa0d-2930decc1545 tempest-ProjectReaderTests-183035627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7b9f599-d9e1-4240-936e-858d3b4b89a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:49:11 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-f6e743e2-f8f6-4330-aa0d-2930decc1545 tempest-ProjectReaderTests-183035627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7b9f599-d9e1-4240-936e-858d3b4b89a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:49:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-890164815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a3bfca1-8961-4633-b365-a962e2bd3668,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11f232ee21914cf18a5f3ec306856d15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:49:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:49:11Z,use_quota=True,user_id='1d173231e2c0488c8cd4bfb56315f6d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:49:11 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-f6e743e2-f8f6-4330-aa0d-2930decc1545 tempest-ProjectReaderTests-183035627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58e8168b-f76b-48e3-b709-c6215b986f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:49:11 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-f6e743e2-f8f6-4330-aa0d-2930decc1545 tempest-ProjectReaderTests-183035627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58e8168b-f76b-48e3-b709-c6215b986f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:49:11 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-f6e743e2-f8f6-4330-aa0d-2930decc1545 tempest-ProjectReaderTests-183035627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66464800-9113-40e1-95a9-51e4c51cfa99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:49:11 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-f6e743e2-f8f6-4330-aa0d-2930decc1545 tempest-ProjectReaderTests-183035627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66464800-9113-40e1-95a9-51e4c51cfa99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a3bfca1-8961-4633-b365-a962e2bd3668', 'volume_name': 'volume-2a3bfca1-8961-4633-b365-a962e2bd3668', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:49:11 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-f6e743e2-f8f6-4330-aa0d-2930decc1545 tempest-ProjectReaderTests-183035627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (952bfc65-9c96-453f-a232-c54711a17805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:49:11 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-f6e743e2-f8f6-4330-aa0d-2930decc1545 tempest-ProjectReaderTests-183035627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (952bfc65-9c96-453f-a232-c54711a17805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:49:11 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-f6e743e2-f8f6-4330-aa0d-2930decc1545 tempest-ProjectReaderTests-183035627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (712ace27-3840-4aea-a34d-27a322ac44ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:49:11 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-f6e743e2-f8f6-4330-aa0d-2930decc1545 tempest-ProjectReaderTests-183035627 None] Volume 2a3bfca1-8961-4633-b365-a962e2bd3668: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a3bfca1-8961-4633-b365-a962e2bd3668', 'volume_size': 1} Sep 04 22:49:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f6e743e2-f8f6-4330-aa0d-2930decc1545 tempest-ProjectReaderTests-183035627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:49:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f6e743e2-f8f6-4330-aa0d-2930decc1545 tempest-ProjectReaderTests-183035627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:49:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-f6e743e2-f8f6-4330-aa0d-2930decc1545 tempest-ProjectReaderTests-183035627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:49:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-890164815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a3bfca1-8961-4633-b365-a962e2bd3668,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11f232ee21914cf18a5f3ec306856d15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:49:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:49:11Z,use_quota=True,user_id='1d173231e2c0488c8cd4bfb56315f6d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:49:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-f6e743e2-f8f6-4330-aa0d-2930decc1545 tempest-ProjectReaderTests-183035627 None] Creating volume 2a3bfca1-8961-4633-b365-a962e2bd3668 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:49:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f6e743e2-f8f6-4330-aa0d-2930decc1545 tempest-ProjectReaderTests-183035627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:49:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f6e743e2-f8f6-4330-aa0d-2930decc1545 tempest-ProjectReaderTests-183035627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:49:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-f6e743e2-f8f6-4330-aa0d-2930decc1545 tempest-ProjectReaderTests-183035627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:49:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-f6e743e2-f8f6-4330-aa0d-2930decc1545 tempest-ProjectReaderTests-183035627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:49:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f6e743e2-f8f6-4330-aa0d-2930decc1545 tempest-ProjectReaderTests-183035627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:49:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-f6e743e2-f8f6-4330-aa0d-2930decc1545 tempest-ProjectReaderTests-183035627 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:49:11 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-f6e743e2-f8f6-4330-aa0d-2930decc1545 tempest-ProjectReaderTests-183035627 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:49:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f6e743e2-f8f6-4330-aa0d-2930decc1545 tempest-ProjectReaderTests-183035627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-2a3bfca1-8961-4633-b365-a962e2bd3668 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:49:11 devstack sudo[99708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-2a3bfca1-8961-4633-b365-a962e2bd3668 1073741824 Sep 04 22:49:11 devstack sudo[99708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:49:11 devstack cinder-volume[87576]: DEBUG oslo_service.periodic_task [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87576) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 22:49:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:49:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:49:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:49:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:49:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:49:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:49:11 devstack sudo[99711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:49:11 devstack sudo[99711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:49:12 devstack sudo[99711]: pam_unix(sudo:session): session closed for user root Sep 04 22:49:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.577s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:49:12 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:49:12 devstack cinder-volume[87576]: DEBUG oslo_service.periodic_task [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Running periodic task VolumeManager._thread_info {{(pid=87576) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 22:49:12 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] thread count: 28 {{(pid=87576) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 22:49:12 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] thread info: [<_MainThread(MainThread, started 125730416963712)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87576) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 22:49:12 devstack sudo[99708]: pam_unix(sudo:session): session closed for user root Sep 04 22:49:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f6e743e2-f8f6-4330-aa0d-2930decc1545 tempest-ProjectReaderTests-183035627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-2a3bfca1-8961-4633-b365-a962e2bd3668 1073741824" returned: 0 in 0.997s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:49:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f6e743e2-f8f6-4330-aa0d-2930decc1545 tempest-ProjectReaderTests-183035627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-2a3bfca1-8961-4633-b365-a962e2bd3668 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:49:12 devstack sudo[99719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-2a3bfca1-8961-4633-b365-a962e2bd3668 Sep 04 22:49:12 devstack sudo[99719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:49:13 devstack sudo[99719]: pam_unix(sudo:session): session closed for user root Sep 04 22:49:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f6e743e2-f8f6-4330-aa0d-2930decc1545 tempest-ProjectReaderTests-183035627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-2a3bfca1-8961-4633-b365-a962e2bd3668" returned: 0 in 0.348s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:49:13 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-f6e743e2-f8f6-4330-aa0d-2930decc1545 tempest-ProjectReaderTests-183035627 None] <== create_volume: return (1424ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:49:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f6e743e2-f8f6-4330-aa0d-2930decc1545 tempest-ProjectReaderTests-183035627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.427s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:49:13 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-f6e743e2-f8f6-4330-aa0d-2930decc1545 tempest-ProjectReaderTests-183035627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (712ace27-3840-4aea-a34d-27a322ac44ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a3bfca1-8961-4633-b365-a962e2bd3668', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:49:13 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-f6e743e2-f8f6-4330-aa0d-2930decc1545 tempest-ProjectReaderTests-183035627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (114e696f-4ce6-47cb-99fd-173fcb73fa7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:49:13 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-f6e743e2-f8f6-4330-aa0d-2930decc1545 tempest-ProjectReaderTests-183035627 None] Volume volume-2a3bfca1-8961-4633-b365-a962e2bd3668 (2a3bfca1-8961-4633-b365-a962e2bd3668): created successfully Sep 04 22:49:13 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-f6e743e2-f8f6-4330-aa0d-2930decc1545 tempest-ProjectReaderTests-183035627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (114e696f-4ce6-47cb-99fd-173fcb73fa7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:49:13 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-f6e743e2-f8f6-4330-aa0d-2930decc1545 tempest-ProjectReaderTests-183035627 None] Flow 'volume_create_manager' (b1370d87-24dc-44e5-91e9-af649af1f126) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:49:13 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-f6e743e2-f8f6-4330-aa0d-2930decc1545 tempest-ProjectReaderTests-183035627 None] Created volume successfully. Sep 04 22:49:14 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d619ef88-103e-4612-819f-9491f758f2eb tempest-ProjectReaderTests-183035627 None] Acquiring lock "cinder-2a3bfca1-8961-4633-b365-a962e2bd3668-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:49:14 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d619ef88-103e-4612-819f-9491f758f2eb tempest-ProjectReaderTests-183035627 None] Lock "cinder-2a3bfca1-8961-4633-b365-a962e2bd3668-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:49:15 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d619ef88-103e-4612-819f-9491f758f2eb tempest-ProjectReaderTests-183035627 None] Acquiring lock "cinder-quobyte-2a3bfca1-8961-4633-b365-a962e2bd3668" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:49:15 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d619ef88-103e-4612-819f-9491f758f2eb tempest-ProjectReaderTests-183035627 None] Lock "cinder-quobyte-2a3bfca1-8961-4633-b365-a962e2bd3668" acquired by "delete_volume" :: waited 0.043s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:49:15 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c404f28-cbca-49c5-a1bd-32579750bea0]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:49:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d619ef88-103e-4612-819f-9491f758f2eb tempest-ProjectReaderTests-183035627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-2a3bfca1-8961-4633-b365-a962e2bd3668 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:49:15 devstack sudo[99786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-2a3bfca1-8961-4633-b365-a962e2bd3668 Sep 04 22:49:15 devstack sudo[99786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:49:15 devstack sudo[99786]: pam_unix(sudo:session): session closed for user root Sep 04 22:49:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d619ef88-103e-4612-819f-9491f758f2eb tempest-ProjectReaderTests-183035627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-2a3bfca1-8961-4633-b365-a962e2bd3668" returned: 0 in 0.661s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:49:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d619ef88-103e-4612-819f-9491f758f2eb tempest-ProjectReaderTests-183035627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-2a3bfca1-8961-4633-b365-a962e2bd3668 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:49:15 devstack sudo[99795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-2a3bfca1-8961-4633-b365-a962e2bd3668 Sep 04 22:49:15 devstack sudo[99795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:49:16 devstack sudo[99795]: pam_unix(sudo:session): session closed for user root Sep 04 22:49:16 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d619ef88-103e-4612-819f-9491f758f2eb tempest-ProjectReaderTests-183035627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-2a3bfca1-8961-4633-b365-a962e2bd3668" returned: 0 in 0.762s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:49:16 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d619ef88-103e-4612-819f-9491f758f2eb tempest-ProjectReaderTests-183035627 None] Lock "cinder-quobyte-2a3bfca1-8961-4633-b365-a962e2bd3668" released by "delete_volume" :: held 1.604s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:49:17 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-d619ef88-103e-4612-819f-9491f758f2eb tempest-ProjectReaderTests-183035627 None] Created reservations ['bf0ce05f-27b0-488c-aca2-939fec6fd4df', '2de4539e-39c6-4f43-998b-0d902a885259', 'a6bf602e-4dda-4bb7-baf2-69a5ab7a1608', '3c344b54-9325-4f44-8571-d2fd5c3ada84'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:49:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-d619ef88-103e-4612-819f-9491f758f2eb tempest-ProjectReaderTests-183035627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:49:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-d619ef88-103e-4612-819f-9491f758f2eb tempest-ProjectReaderTests-183035627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:49:17 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-d619ef88-103e-4612-819f-9491f758f2eb tempest-ProjectReaderTests-183035627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:49:17 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-d619ef88-103e-4612-819f-9491f758f2eb tempest-ProjectReaderTests-183035627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:49:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-d619ef88-103e-4612-819f-9491f758f2eb tempest-ProjectReaderTests-183035627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:49:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d619ef88-103e-4612-819f-9491f758f2eb tempest-ProjectReaderTests-183035627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:49:17 devstack sudo[99801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:49:17 devstack sudo[99801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:49:17 devstack sudo[99801]: pam_unix(sudo:session): session closed for user root Sep 04 22:49:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d619ef88-103e-4612-819f-9491f758f2eb tempest-ProjectReaderTests-183035627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.490s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:49:17 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-d619ef88-103e-4612-819f-9491f758f2eb tempest-ProjectReaderTests-183035627 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:49:17 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-d619ef88-103e-4612-819f-9491f758f2eb tempest-ProjectReaderTests-183035627 None] Deleted volume successfully. Sep 04 22:49:17 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d619ef88-103e-4612-819f-9491f758f2eb tempest-ProjectReaderTests-183035627 None] Lock "cinder-2a3bfca1-8961-4633-b365-a962e2bd3668-delete_volume" released by "delete_volume" :: held 2.809s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:49:18 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-085d4376-b29d-425c-afcc-999b036eff10 tempest-ProjectReaderTests-183035627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:49:18 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-085d4376-b29d-425c-afcc-999b036eff10 tempest-ProjectReaderTests-183035627 None] Flow 'volume_create_manager' (f803efcc-9a45-4de4-b75a-a76c49f4f8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:49:18 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-085d4376-b29d-425c-afcc-999b036eff10 tempest-ProjectReaderTests-183035627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97785c40-595e-400e-a578-d1ee69c65c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:49:18 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-085d4376-b29d-425c-afcc-999b036eff10 tempest-ProjectReaderTests-183035627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97785c40-595e-400e-a578-d1ee69c65c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:49:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-211662252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6545970-bafa-41dd-aee9-e1cf48045552,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11f232ee21914cf18a5f3ec306856d15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:49:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:49:18Z,use_quota=True,user_id='1d173231e2c0488c8cd4bfb56315f6d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:49:18 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-085d4376-b29d-425c-afcc-999b036eff10 tempest-ProjectReaderTests-183035627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a75ec466-506f-4bed-9b17-1446f9a435f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:49:18 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-085d4376-b29d-425c-afcc-999b036eff10 tempest-ProjectReaderTests-183035627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a75ec466-506f-4bed-9b17-1446f9a435f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:49:18 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-085d4376-b29d-425c-afcc-999b036eff10 tempest-ProjectReaderTests-183035627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b6d0120-a7b5-4526-a91a-503f576b8857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:49:18 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-085d4376-b29d-425c-afcc-999b036eff10 tempest-ProjectReaderTests-183035627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b6d0120-a7b5-4526-a91a-503f576b8857) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6545970-bafa-41dd-aee9-e1cf48045552', 'volume_name': 'volume-d6545970-bafa-41dd-aee9-e1cf48045552', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:49:18 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-085d4376-b29d-425c-afcc-999b036eff10 tempest-ProjectReaderTests-183035627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f722a0e-7176-42ac-819b-dc6833ed4722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:49:18 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-085d4376-b29d-425c-afcc-999b036eff10 tempest-ProjectReaderTests-183035627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f722a0e-7176-42ac-819b-dc6833ed4722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:49:18 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-085d4376-b29d-425c-afcc-999b036eff10 tempest-ProjectReaderTests-183035627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5c4f3df-5a66-4276-b3df-442dd05f8752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:49:18 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-085d4376-b29d-425c-afcc-999b036eff10 tempest-ProjectReaderTests-183035627 None] Volume d6545970-bafa-41dd-aee9-e1cf48045552: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6545970-bafa-41dd-aee9-e1cf48045552', 'volume_size': 1} Sep 04 22:49:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-085d4376-b29d-425c-afcc-999b036eff10 tempest-ProjectReaderTests-183035627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:49:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-085d4376-b29d-425c-afcc-999b036eff10 tempest-ProjectReaderTests-183035627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:49:18 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-085d4376-b29d-425c-afcc-999b036eff10 tempest-ProjectReaderTests-183035627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:49:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-211662252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6545970-bafa-41dd-aee9-e1cf48045552,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11f232ee21914cf18a5f3ec306856d15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:49:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:49:18Z,use_quota=True,user_id='1d173231e2c0488c8cd4bfb56315f6d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:49:18 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-085d4376-b29d-425c-afcc-999b036eff10 tempest-ProjectReaderTests-183035627 None] Creating volume d6545970-bafa-41dd-aee9-e1cf48045552 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:49:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-085d4376-b29d-425c-afcc-999b036eff10 tempest-ProjectReaderTests-183035627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:49:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-085d4376-b29d-425c-afcc-999b036eff10 tempest-ProjectReaderTests-183035627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:49:18 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-085d4376-b29d-425c-afcc-999b036eff10 tempest-ProjectReaderTests-183035627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:49:18 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-085d4376-b29d-425c-afcc-999b036eff10 tempest-ProjectReaderTests-183035627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:49:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-085d4376-b29d-425c-afcc-999b036eff10 tempest-ProjectReaderTests-183035627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:49:18 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-085d4376-b29d-425c-afcc-999b036eff10 tempest-ProjectReaderTests-183035627 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:49:18 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-085d4376-b29d-425c-afcc-999b036eff10 tempest-ProjectReaderTests-183035627 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:49:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-085d4376-b29d-425c-afcc-999b036eff10 tempest-ProjectReaderTests-183035627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d6545970-bafa-41dd-aee9-e1cf48045552 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:49:18 devstack sudo[99806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d6545970-bafa-41dd-aee9-e1cf48045552 1073741824 Sep 04 22:49:18 devstack sudo[99806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:49:19 devstack sudo[99806]: pam_unix(sudo:session): session closed for user root Sep 04 22:49:19 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-085d4376-b29d-425c-afcc-999b036eff10 tempest-ProjectReaderTests-183035627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d6545970-bafa-41dd-aee9-e1cf48045552 1073741824" returned: 0 in 0.869s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:49:19 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-085d4376-b29d-425c-afcc-999b036eff10 tempest-ProjectReaderTests-183035627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d6545970-bafa-41dd-aee9-e1cf48045552 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:49:19 devstack sudo[99812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d6545970-bafa-41dd-aee9-e1cf48045552 Sep 04 22:49:19 devstack sudo[99812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:49:20 devstack sudo[99812]: pam_unix(sudo:session): session closed for user root Sep 04 22:49:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-085d4376-b29d-425c-afcc-999b036eff10 tempest-ProjectReaderTests-183035627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d6545970-bafa-41dd-aee9-e1cf48045552" returned: 0 in 0.476s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:49:20 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-085d4376-b29d-425c-afcc-999b036eff10 tempest-ProjectReaderTests-183035627 None] <== create_volume: return (1425ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:49:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-085d4376-b29d-425c-afcc-999b036eff10 tempest-ProjectReaderTests-183035627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.428s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:49:20 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-085d4376-b29d-425c-afcc-999b036eff10 tempest-ProjectReaderTests-183035627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5c4f3df-5a66-4276-b3df-442dd05f8752) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6545970-bafa-41dd-aee9-e1cf48045552', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:49:20 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-085d4376-b29d-425c-afcc-999b036eff10 tempest-ProjectReaderTests-183035627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ef7a989-8988-44a4-ae44-c4b57b166473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:49:20 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-085d4376-b29d-425c-afcc-999b036eff10 tempest-ProjectReaderTests-183035627 None] Volume volume-d6545970-bafa-41dd-aee9-e1cf48045552 (d6545970-bafa-41dd-aee9-e1cf48045552): created successfully Sep 04 22:49:20 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-085d4376-b29d-425c-afcc-999b036eff10 tempest-ProjectReaderTests-183035627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ef7a989-8988-44a4-ae44-c4b57b166473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:49:20 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-085d4376-b29d-425c-afcc-999b036eff10 tempest-ProjectReaderTests-183035627 None] Flow 'volume_create_manager' (f803efcc-9a45-4de4-b75a-a76c49f4f8b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:49:20 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-085d4376-b29d-425c-afcc-999b036eff10 tempest-ProjectReaderTests-183035627 None] Created volume successfully. Sep 04 22:49:20 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-5fbf0dd6-7fc9-4415-b4d1-109d4fb840c3 tempest-VolumesActionsTest-1053366409 None] Acquiring lock "cinder-46da67d1-af60-4135-b585-6cc3e02fa5c3" by "attach_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:49:20 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-5fbf0dd6-7fc9-4415-b4d1-109d4fb840c3 tempest-VolumesActionsTest-1053366409 None] Lock "cinder-46da67d1-af60-4135-b585-6cc3e02fa5c3" acquired by "attach_volume" :: waited 0.044s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:49:20 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-5fbf0dd6-7fc9-4415-b4d1-109d4fb840c3 tempest-VolumesActionsTest-1053366409 None] Attaching volume 46da67d1-af60-4135-b585-6cc3e02fa5c3 to instance 3c7ed513-eda1-467a-b97f-854b060ec3bc at mountpoint /dev/vdb on host None. Sep 04 22:49:20 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-5fbf0dd6-7fc9-4415-b4d1-109d4fb840c3 tempest-VolumesActionsTest-1053366409 None] Attach volume completed successfully. Sep 04 22:49:20 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-858aec43-10e1-4af3-95d8-2691c479c0b7 tempest-ProjectReaderTests-183035627 None] Acquiring lock "cinder-d6545970-bafa-41dd-aee9-e1cf48045552-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:49:20 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-5fbf0dd6-7fc9-4415-b4d1-109d4fb840c3 tempest-VolumesActionsTest-1053366409 None] Lock "cinder-46da67d1-af60-4135-b585-6cc3e02fa5c3" released by "attach_volume" :: held 0.240s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:49:20 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-858aec43-10e1-4af3-95d8-2691c479c0b7 tempest-ProjectReaderTests-183035627 None] Lock "cinder-d6545970-bafa-41dd-aee9-e1cf48045552-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:49:20 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-858aec43-10e1-4af3-95d8-2691c479c0b7 tempest-ProjectReaderTests-183035627 None] Acquiring lock "cinder-quobyte-d6545970-bafa-41dd-aee9-e1cf48045552" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:49:20 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-858aec43-10e1-4af3-95d8-2691c479c0b7 tempest-ProjectReaderTests-183035627 None] Lock "cinder-quobyte-d6545970-bafa-41dd-aee9-e1cf48045552" acquired by "delete_volume" :: waited 0.026s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:49:20 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd336b1-55ef-4de6-aa24-495fad64a4dc]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:49:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-858aec43-10e1-4af3-95d8-2691c479c0b7 tempest-ProjectReaderTests-183035627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d6545970-bafa-41dd-aee9-e1cf48045552 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:49:21 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-bf8d6693-7180-4d77-8bd8-4582328d8223 tempest-VolumesActionsTest-1053366409 None] Acquiring lock "cinder-46da67d1-af60-4135-b585-6cc3e02fa5c3-detach_volume" by "detach_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:49:21 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-bf8d6693-7180-4d77-8bd8-4582328d8223 tempest-VolumesActionsTest-1053366409 None] Lock "cinder-46da67d1-af60-4135-b585-6cc3e02fa5c3-detach_volume" acquired by "detach_volume" :: waited 0.034s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:49:21 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-bf8d6693-7180-4d77-8bd8-4582328d8223 tempest-VolumesActionsTest-1053366409 None] Detaching volume 46da67d1-af60-4135-b585-6cc3e02fa5c3 from instance 3c7ed513-eda1-467a-b97f-854b060ec3bc. Sep 04 22:49:21 devstack sudo[99815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d6545970-bafa-41dd-aee9-e1cf48045552 Sep 04 22:49:21 devstack sudo[99815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:49:21 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-bf8d6693-7180-4d77-8bd8-4582328d8223 tempest-VolumesActionsTest-1053366409 None] Detach volume completed successfully. Sep 04 22:49:21 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-bf8d6693-7180-4d77-8bd8-4582328d8223 tempest-VolumesActionsTest-1053366409 None] Lock "cinder-46da67d1-af60-4135-b585-6cc3e02fa5c3-detach_volume" released by "detach_volume" :: held 0.262s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:49:21 devstack sudo[99815]: pam_unix(sudo:session): session closed for user root Sep 04 22:49:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-858aec43-10e1-4af3-95d8-2691c479c0b7 tempest-ProjectReaderTests-183035627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d6545970-bafa-41dd-aee9-e1cf48045552" returned: 0 in 0.770s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:49:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-858aec43-10e1-4af3-95d8-2691c479c0b7 tempest-ProjectReaderTests-183035627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d6545970-bafa-41dd-aee9-e1cf48045552 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:49:21 devstack sudo[99820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d6545970-bafa-41dd-aee9-e1cf48045552 Sep 04 22:49:21 devstack sudo[99820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:49:22 devstack sudo[99820]: pam_unix(sudo:session): session closed for user root Sep 04 22:49:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-858aec43-10e1-4af3-95d8-2691c479c0b7 tempest-ProjectReaderTests-183035627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d6545970-bafa-41dd-aee9-e1cf48045552" returned: 0 in 0.527s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:49:22 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-858aec43-10e1-4af3-95d8-2691c479c0b7 tempest-ProjectReaderTests-183035627 None] Lock "cinder-quobyte-d6545970-bafa-41dd-aee9-e1cf48045552" released by "delete_volume" :: held 1.430s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:49:22 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-858aec43-10e1-4af3-95d8-2691c479c0b7 tempest-ProjectReaderTests-183035627 None] Created reservations ['3c6b3207-f7af-48d1-be08-6d05747a28d4', '2d855cf3-6f07-43a6-af21-9eefe0bcbcf8', '456bdc24-d471-418f-a33a-fa9948442659', '6becee61-c8f4-4389-889e-45d51e4aafbd'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:49:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-858aec43-10e1-4af3-95d8-2691c479c0b7 tempest-ProjectReaderTests-183035627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:49:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-858aec43-10e1-4af3-95d8-2691c479c0b7 tempest-ProjectReaderTests-183035627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:49:22 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-858aec43-10e1-4af3-95d8-2691c479c0b7 tempest-ProjectReaderTests-183035627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:49:22 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-858aec43-10e1-4af3-95d8-2691c479c0b7 tempest-ProjectReaderTests-183035627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:49:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-858aec43-10e1-4af3-95d8-2691c479c0b7 tempest-ProjectReaderTests-183035627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:49:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-858aec43-10e1-4af3-95d8-2691c479c0b7 tempest-ProjectReaderTests-183035627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:49:22 devstack sudo[99882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:49:22 devstack sudo[99882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:49:23 devstack sudo[99882]: pam_unix(sudo:session): session closed for user root Sep 04 22:49:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-858aec43-10e1-4af3-95d8-2691c479c0b7 tempest-ProjectReaderTests-183035627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.308s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:49:23 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-858aec43-10e1-4af3-95d8-2691c479c0b7 tempest-ProjectReaderTests-183035627 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:49:23 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-858aec43-10e1-4af3-95d8-2691c479c0b7 tempest-ProjectReaderTests-183035627 None] Deleted volume successfully. Sep 04 22:49:23 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-858aec43-10e1-4af3-95d8-2691c479c0b7 tempest-ProjectReaderTests-183035627 None] Lock "cinder-d6545970-bafa-41dd-aee9-e1cf48045552-delete_volume" released by "delete_volume" :: held 2.370s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:49:23 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-03384abf-2d75-49ef-ad64-05d45ec34420 tempest-ProjectReaderTests-183035627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:49:23 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-03384abf-2d75-49ef-ad64-05d45ec34420 tempest-ProjectReaderTests-183035627 None] Flow 'volume_create_manager' (6e5733d1-b9ee-451a-967c-5307dd27f98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:49:23 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-03384abf-2d75-49ef-ad64-05d45ec34420 tempest-ProjectReaderTests-183035627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b8c1e3c-7ee8-463a-a907-9cd625d82823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:49:23 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-03384abf-2d75-49ef-ad64-05d45ec34420 tempest-ProjectReaderTests-183035627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b8c1e3c-7ee8-463a-a907-9cd625d82823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:49:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1851528988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8beeb74a-bcd7-4ee8-ba40-b1763e95b670,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11f232ee21914cf18a5f3ec306856d15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:49:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:49:24Z,use_quota=True,user_id='1d173231e2c0488c8cd4bfb56315f6d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:49:23 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-03384abf-2d75-49ef-ad64-05d45ec34420 tempest-ProjectReaderTests-183035627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a964a56f-3882-494d-b167-612fc0661bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:49:23 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-03384abf-2d75-49ef-ad64-05d45ec34420 tempest-ProjectReaderTests-183035627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a964a56f-3882-494d-b167-612fc0661bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:49:23 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-03384abf-2d75-49ef-ad64-05d45ec34420 tempest-ProjectReaderTests-183035627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0681b813-1b4f-4753-b716-89e5f2772c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:49:23 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-03384abf-2d75-49ef-ad64-05d45ec34420 tempest-ProjectReaderTests-183035627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0681b813-1b4f-4753-b716-89e5f2772c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8beeb74a-bcd7-4ee8-ba40-b1763e95b670', 'volume_name': 'volume-8beeb74a-bcd7-4ee8-ba40-b1763e95b670', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:49:23 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-03384abf-2d75-49ef-ad64-05d45ec34420 tempest-ProjectReaderTests-183035627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0048f50-811e-4c26-8a86-7bdff8c95593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:49:23 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-03384abf-2d75-49ef-ad64-05d45ec34420 tempest-ProjectReaderTests-183035627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0048f50-811e-4c26-8a86-7bdff8c95593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:49:23 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-03384abf-2d75-49ef-ad64-05d45ec34420 tempest-ProjectReaderTests-183035627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c0a1909-5373-4372-9164-8e632902a661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:49:23 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-03384abf-2d75-49ef-ad64-05d45ec34420 tempest-ProjectReaderTests-183035627 None] Volume 8beeb74a-bcd7-4ee8-ba40-b1763e95b670: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8beeb74a-bcd7-4ee8-ba40-b1763e95b670', 'volume_size': 1} Sep 04 22:49:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-03384abf-2d75-49ef-ad64-05d45ec34420 tempest-ProjectReaderTests-183035627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:49:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-03384abf-2d75-49ef-ad64-05d45ec34420 tempest-ProjectReaderTests-183035627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:49:23 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-03384abf-2d75-49ef-ad64-05d45ec34420 tempest-ProjectReaderTests-183035627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:49:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1851528988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8beeb74a-bcd7-4ee8-ba40-b1763e95b670,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11f232ee21914cf18a5f3ec306856d15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:49:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:49:24Z,use_quota=True,user_id='1d173231e2c0488c8cd4bfb56315f6d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:49:23 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-03384abf-2d75-49ef-ad64-05d45ec34420 tempest-ProjectReaderTests-183035627 None] Creating volume 8beeb74a-bcd7-4ee8-ba40-b1763e95b670 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:49:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-03384abf-2d75-49ef-ad64-05d45ec34420 tempest-ProjectReaderTests-183035627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:49:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-03384abf-2d75-49ef-ad64-05d45ec34420 tempest-ProjectReaderTests-183035627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:49:23 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-03384abf-2d75-49ef-ad64-05d45ec34420 tempest-ProjectReaderTests-183035627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:49:23 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-03384abf-2d75-49ef-ad64-05d45ec34420 tempest-ProjectReaderTests-183035627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:49:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-03384abf-2d75-49ef-ad64-05d45ec34420 tempest-ProjectReaderTests-183035627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:49:23 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-03384abf-2d75-49ef-ad64-05d45ec34420 tempest-ProjectReaderTests-183035627 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:49:23 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-03384abf-2d75-49ef-ad64-05d45ec34420 tempest-ProjectReaderTests-183035627 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:49:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-03384abf-2d75-49ef-ad64-05d45ec34420 tempest-ProjectReaderTests-183035627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-8beeb74a-bcd7-4ee8-ba40-b1763e95b670 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:49:23 devstack sudo[99887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-8beeb74a-bcd7-4ee8-ba40-b1763e95b670 1073741824 Sep 04 22:49:23 devstack sudo[99887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:49:24 devstack sudo[99887]: pam_unix(sudo:session): session closed for user root Sep 04 22:49:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-03384abf-2d75-49ef-ad64-05d45ec34420 tempest-ProjectReaderTests-183035627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-8beeb74a-bcd7-4ee8-ba40-b1763e95b670 1073741824" returned: 0 in 0.636s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:49:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-03384abf-2d75-49ef-ad64-05d45ec34420 tempest-ProjectReaderTests-183035627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-8beeb74a-bcd7-4ee8-ba40-b1763e95b670 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:49:24 devstack sudo[99894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-8beeb74a-bcd7-4ee8-ba40-b1763e95b670 Sep 04 22:49:24 devstack sudo[99894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:49:24 devstack sudo[99894]: pam_unix(sudo:session): session closed for user root Sep 04 22:49:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-03384abf-2d75-49ef-ad64-05d45ec34420 tempest-ProjectReaderTests-183035627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-8beeb74a-bcd7-4ee8-ba40-b1763e95b670" returned: 0 in 0.398s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:49:24 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-03384abf-2d75-49ef-ad64-05d45ec34420 tempest-ProjectReaderTests-183035627 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:49:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-03384abf-2d75-49ef-ad64-05d45ec34420 tempest-ProjectReaderTests-183035627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:49:25 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-03384abf-2d75-49ef-ad64-05d45ec34420 tempest-ProjectReaderTests-183035627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c0a1909-5373-4372-9164-8e632902a661) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8beeb74a-bcd7-4ee8-ba40-b1763e95b670', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:49:25 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-03384abf-2d75-49ef-ad64-05d45ec34420 tempest-ProjectReaderTests-183035627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5940df9e-5152-46a9-8c61-e567e20305a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:49:25 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-03384abf-2d75-49ef-ad64-05d45ec34420 tempest-ProjectReaderTests-183035627 None] Volume volume-8beeb74a-bcd7-4ee8-ba40-b1763e95b670 (8beeb74a-bcd7-4ee8-ba40-b1763e95b670): created successfully Sep 04 22:49:25 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-03384abf-2d75-49ef-ad64-05d45ec34420 tempest-ProjectReaderTests-183035627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5940df9e-5152-46a9-8c61-e567e20305a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:49:25 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-03384abf-2d75-49ef-ad64-05d45ec34420 tempest-ProjectReaderTests-183035627 None] Flow 'volume_create_manager' (6e5733d1-b9ee-451a-967c-5307dd27f98b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:49:25 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-03384abf-2d75-49ef-ad64-05d45ec34420 tempest-ProjectReaderTests-183035627 None] Created volume successfully. Sep 04 22:49:25 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-ed0f1a14-8752-4bd2-a565-5fdcc075ec09 tempest-ProjectReaderTests-183035627 None] Acquiring lock "cinder-8beeb74a-bcd7-4ee8-ba40-b1763e95b670-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:49:26 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-ed0f1a14-8752-4bd2-a565-5fdcc075ec09 tempest-ProjectReaderTests-183035627 None] Lock "cinder-8beeb74a-bcd7-4ee8-ba40-b1763e95b670-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:49:26 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-ed0f1a14-8752-4bd2-a565-5fdcc075ec09 tempest-ProjectReaderTests-183035627 None] Acquiring lock "cinder-quobyte-8beeb74a-bcd7-4ee8-ba40-b1763e95b670" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:49:26 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-ed0f1a14-8752-4bd2-a565-5fdcc075ec09 tempest-ProjectReaderTests-183035627 None] Lock "cinder-quobyte-8beeb74a-bcd7-4ee8-ba40-b1763e95b670" acquired by "delete_volume" :: waited 0.018s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:49:26 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ce463c-5fdd-4d0f-9e5e-ade8d0ba32e7]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:49:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ed0f1a14-8752-4bd2-a565-5fdcc075ec09 tempest-ProjectReaderTests-183035627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-8beeb74a-bcd7-4ee8-ba40-b1763e95b670 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:49:26 devstack sudo[99898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-8beeb74a-bcd7-4ee8-ba40-b1763e95b670 Sep 04 22:49:26 devstack sudo[99898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:49:26 devstack sudo[99898]: pam_unix(sudo:session): session closed for user root Sep 04 22:49:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ed0f1a14-8752-4bd2-a565-5fdcc075ec09 tempest-ProjectReaderTests-183035627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-8beeb74a-bcd7-4ee8-ba40-b1763e95b670" returned: 0 in 0.438s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:49:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ed0f1a14-8752-4bd2-a565-5fdcc075ec09 tempest-ProjectReaderTests-183035627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-8beeb74a-bcd7-4ee8-ba40-b1763e95b670 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:49:26 devstack sudo[99903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-8beeb74a-bcd7-4ee8-ba40-b1763e95b670 Sep 04 22:49:26 devstack sudo[99903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:49:26 devstack sudo[99903]: pam_unix(sudo:session): session closed for user root Sep 04 22:49:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ed0f1a14-8752-4bd2-a565-5fdcc075ec09 tempest-ProjectReaderTests-183035627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-8beeb74a-bcd7-4ee8-ba40-b1763e95b670" returned: 0 in 0.286s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:49:26 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-ed0f1a14-8752-4bd2-a565-5fdcc075ec09 tempest-ProjectReaderTests-183035627 None] Lock "cinder-quobyte-8beeb74a-bcd7-4ee8-ba40-b1763e95b670" released by "delete_volume" :: held 0.791s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:49:26 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-ed0f1a14-8752-4bd2-a565-5fdcc075ec09 tempest-ProjectReaderTests-183035627 None] Created reservations ['c2fffd78-173f-4986-98a0-6f7691fb5d72', 'e3e38ea5-b769-4a0b-a042-f779896ced88', 'a56865b4-0faf-4f6a-b097-44e983574b0d', 'bbde1608-0634-40bb-bd27-b987e952c49f'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:49:27 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-ed0f1a14-8752-4bd2-a565-5fdcc075ec09 tempest-ProjectReaderTests-183035627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:49:27 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-ed0f1a14-8752-4bd2-a565-5fdcc075ec09 tempest-ProjectReaderTests-183035627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:49:27 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-ed0f1a14-8752-4bd2-a565-5fdcc075ec09 tempest-ProjectReaderTests-183035627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:49:27 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-ed0f1a14-8752-4bd2-a565-5fdcc075ec09 tempest-ProjectReaderTests-183035627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:49:27 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-ed0f1a14-8752-4bd2-a565-5fdcc075ec09 tempest-ProjectReaderTests-183035627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:49:27 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ed0f1a14-8752-4bd2-a565-5fdcc075ec09 tempest-ProjectReaderTests-183035627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:49:27 devstack sudo[99906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:49:27 devstack sudo[99906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:49:27 devstack sudo[99906]: pam_unix(sudo:session): session closed for user root Sep 04 22:49:27 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ed0f1a14-8752-4bd2-a565-5fdcc075ec09 tempest-ProjectReaderTests-183035627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.471s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:49:27 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-ed0f1a14-8752-4bd2-a565-5fdcc075ec09 tempest-ProjectReaderTests-183035627 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:49:27 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-ed0f1a14-8752-4bd2-a565-5fdcc075ec09 tempest-ProjectReaderTests-183035627 None] Deleted volume successfully. Sep 04 22:49:27 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-ed0f1a14-8752-4bd2-a565-5fdcc075ec09 tempest-ProjectReaderTests-183035627 None] Lock "cinder-8beeb74a-bcd7-4ee8-ba40-b1763e95b670-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:49:28 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0429de2-a1b9-4e49-8f7d-7c7e9c1ffea5 tempest-ProjectReaderTests-183035627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:49:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-a0429de2-a1b9-4e49-8f7d-7c7e9c1ffea5 tempest-ProjectReaderTests-183035627 None] Flow 'volume_create_manager' (7f3be46b-dd81-4a67-a1d5-c0e4544fca18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:49:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-a0429de2-a1b9-4e49-8f7d-7c7e9c1ffea5 tempest-ProjectReaderTests-183035627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9356b194-af34-4239-8a08-14a7b54f867f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:49:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-a0429de2-a1b9-4e49-8f7d-7c7e9c1ffea5 tempest-ProjectReaderTests-183035627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9356b194-af34-4239-8a08-14a7b54f867f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:49:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-695384330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdf50b86-7dd3-4d66-916a-62d24775c9ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11f232ee21914cf18a5f3ec306856d15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:49:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:49:28Z,use_quota=True,user_id='1d173231e2c0488c8cd4bfb56315f6d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:49:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-a0429de2-a1b9-4e49-8f7d-7c7e9c1ffea5 tempest-ProjectReaderTests-183035627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbdcae74-d275-44c8-91b0-67cbcda5690e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:49:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-a0429de2-a1b9-4e49-8f7d-7c7e9c1ffea5 tempest-ProjectReaderTests-183035627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbdcae74-d275-44c8-91b0-67cbcda5690e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:49:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-a0429de2-a1b9-4e49-8f7d-7c7e9c1ffea5 tempest-ProjectReaderTests-183035627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f10ecce-25dd-45e6-9882-4f74a9ecec01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:49:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-a0429de2-a1b9-4e49-8f7d-7c7e9c1ffea5 tempest-ProjectReaderTests-183035627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f10ecce-25dd-45e6-9882-4f74a9ecec01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdf50b86-7dd3-4d66-916a-62d24775c9ff', 'volume_name': 'volume-fdf50b86-7dd3-4d66-916a-62d24775c9ff', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:49:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-a0429de2-a1b9-4e49-8f7d-7c7e9c1ffea5 tempest-ProjectReaderTests-183035627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (527a0631-2931-425d-aedf-329a712a3f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:49:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-a0429de2-a1b9-4e49-8f7d-7c7e9c1ffea5 tempest-ProjectReaderTests-183035627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (527a0631-2931-425d-aedf-329a712a3f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:49:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-a0429de2-a1b9-4e49-8f7d-7c7e9c1ffea5 tempest-ProjectReaderTests-183035627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eea980ec-014c-4bc6-98d7-9324ad1b3dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:49:28 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-a0429de2-a1b9-4e49-8f7d-7c7e9c1ffea5 tempest-ProjectReaderTests-183035627 None] Volume fdf50b86-7dd3-4d66-916a-62d24775c9ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdf50b86-7dd3-4d66-916a-62d24775c9ff', 'volume_size': 1} Sep 04 22:49:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-a0429de2-a1b9-4e49-8f7d-7c7e9c1ffea5 tempest-ProjectReaderTests-183035627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:49:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-a0429de2-a1b9-4e49-8f7d-7c7e9c1ffea5 tempest-ProjectReaderTests-183035627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:49:28 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-a0429de2-a1b9-4e49-8f7d-7c7e9c1ffea5 tempest-ProjectReaderTests-183035627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:49:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-695384330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdf50b86-7dd3-4d66-916a-62d24775c9ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11f232ee21914cf18a5f3ec306856d15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:49:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:49:28Z,use_quota=True,user_id='1d173231e2c0488c8cd4bfb56315f6d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:49:28 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-a0429de2-a1b9-4e49-8f7d-7c7e9c1ffea5 tempest-ProjectReaderTests-183035627 None] Creating volume fdf50b86-7dd3-4d66-916a-62d24775c9ff {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:49:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-a0429de2-a1b9-4e49-8f7d-7c7e9c1ffea5 tempest-ProjectReaderTests-183035627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:49:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-a0429de2-a1b9-4e49-8f7d-7c7e9c1ffea5 tempest-ProjectReaderTests-183035627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:49:28 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-a0429de2-a1b9-4e49-8f7d-7c7e9c1ffea5 tempest-ProjectReaderTests-183035627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:49:28 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-a0429de2-a1b9-4e49-8f7d-7c7e9c1ffea5 tempest-ProjectReaderTests-183035627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:49:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-a0429de2-a1b9-4e49-8f7d-7c7e9c1ffea5 tempest-ProjectReaderTests-183035627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:49:28 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-a0429de2-a1b9-4e49-8f7d-7c7e9c1ffea5 tempest-ProjectReaderTests-183035627 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:49:28 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-a0429de2-a1b9-4e49-8f7d-7c7e9c1ffea5 tempest-ProjectReaderTests-183035627 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:49:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a0429de2-a1b9-4e49-8f7d-7c7e9c1ffea5 tempest-ProjectReaderTests-183035627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fdf50b86-7dd3-4d66-916a-62d24775c9ff 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:49:28 devstack sudo[99912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fdf50b86-7dd3-4d66-916a-62d24775c9ff 1073741824 Sep 04 22:49:28 devstack sudo[99912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:49:28 devstack sudo[99912]: pam_unix(sudo:session): session closed for user root Sep 04 22:49:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a0429de2-a1b9-4e49-8f7d-7c7e9c1ffea5 tempest-ProjectReaderTests-183035627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fdf50b86-7dd3-4d66-916a-62d24775c9ff 1073741824" returned: 0 in 0.522s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:49:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a0429de2-a1b9-4e49-8f7d-7c7e9c1ffea5 tempest-ProjectReaderTests-183035627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fdf50b86-7dd3-4d66-916a-62d24775c9ff {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:49:28 devstack sudo[99917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fdf50b86-7dd3-4d66-916a-62d24775c9ff Sep 04 22:49:28 devstack sudo[99917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:49:29 devstack sudo[99917]: pam_unix(sudo:session): session closed for user root Sep 04 22:49:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a0429de2-a1b9-4e49-8f7d-7c7e9c1ffea5 tempest-ProjectReaderTests-183035627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fdf50b86-7dd3-4d66-916a-62d24775c9ff" returned: 0 in 0.297s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:49:29 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-a0429de2-a1b9-4e49-8f7d-7c7e9c1ffea5 tempest-ProjectReaderTests-183035627 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:49:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-a0429de2-a1b9-4e49-8f7d-7c7e9c1ffea5 tempest-ProjectReaderTests-183035627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:49:29 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-a0429de2-a1b9-4e49-8f7d-7c7e9c1ffea5 tempest-ProjectReaderTests-183035627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eea980ec-014c-4bc6-98d7-9324ad1b3dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdf50b86-7dd3-4d66-916a-62d24775c9ff', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:49:29 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-a0429de2-a1b9-4e49-8f7d-7c7e9c1ffea5 tempest-ProjectReaderTests-183035627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b1a95b0-0b3a-42fc-b2fb-b21adf92e842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:49:29 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-a0429de2-a1b9-4e49-8f7d-7c7e9c1ffea5 tempest-ProjectReaderTests-183035627 None] Volume volume-fdf50b86-7dd3-4d66-916a-62d24775c9ff (fdf50b86-7dd3-4d66-916a-62d24775c9ff): created successfully Sep 04 22:49:29 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-a0429de2-a1b9-4e49-8f7d-7c7e9c1ffea5 tempest-ProjectReaderTests-183035627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b1a95b0-0b3a-42fc-b2fb-b21adf92e842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:49:29 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-a0429de2-a1b9-4e49-8f7d-7c7e9c1ffea5 tempest-ProjectReaderTests-183035627 None] Flow 'volume_create_manager' (7f3be46b-dd81-4a67-a1d5-c0e4544fca18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:49:29 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-a0429de2-a1b9-4e49-8f7d-7c7e9c1ffea5 tempest-ProjectReaderTests-183035627 None] Created volume successfully. Sep 04 22:49:30 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-4b5f98d8-61ad-4676-96f1-ca00cdaf1f43 tempest-ProjectReaderTests-183035627 None] Acquiring lock "cinder-fdf50b86-7dd3-4d66-916a-62d24775c9ff-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:49:30 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-4b5f98d8-61ad-4676-96f1-ca00cdaf1f43 tempest-ProjectReaderTests-183035627 None] Lock "cinder-fdf50b86-7dd3-4d66-916a-62d24775c9ff-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:49:30 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-4b5f98d8-61ad-4676-96f1-ca00cdaf1f43 tempest-ProjectReaderTests-183035627 None] Acquiring lock "cinder-quobyte-fdf50b86-7dd3-4d66-916a-62d24775c9ff" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:49:30 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-4b5f98d8-61ad-4676-96f1-ca00cdaf1f43 tempest-ProjectReaderTests-183035627 None] Lock "cinder-quobyte-fdf50b86-7dd3-4d66-916a-62d24775c9ff" acquired by "delete_volume" :: waited 0.049s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:49:30 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[828e151a-b00b-41bc-a765-2c829aafb185]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:49:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4b5f98d8-61ad-4676-96f1-ca00cdaf1f43 tempest-ProjectReaderTests-183035627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fdf50b86-7dd3-4d66-916a-62d24775c9ff {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:49:30 devstack sudo[99934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fdf50b86-7dd3-4d66-916a-62d24775c9ff Sep 04 22:49:30 devstack sudo[99934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:49:31 devstack sudo[99934]: pam_unix(sudo:session): session closed for user root Sep 04 22:49:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4b5f98d8-61ad-4676-96f1-ca00cdaf1f43 tempest-ProjectReaderTests-183035627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fdf50b86-7dd3-4d66-916a-62d24775c9ff" returned: 0 in 0.612s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:49:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4b5f98d8-61ad-4676-96f1-ca00cdaf1f43 tempest-ProjectReaderTests-183035627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fdf50b86-7dd3-4d66-916a-62d24775c9ff {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:49:31 devstack sudo[99942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fdf50b86-7dd3-4d66-916a-62d24775c9ff Sep 04 22:49:31 devstack sudo[99942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:49:31 devstack sudo[99942]: pam_unix(sudo:session): session closed for user root Sep 04 22:49:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4b5f98d8-61ad-4676-96f1-ca00cdaf1f43 tempest-ProjectReaderTests-183035627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fdf50b86-7dd3-4d66-916a-62d24775c9ff" returned: 0 in 0.331s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:49:31 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-4b5f98d8-61ad-4676-96f1-ca00cdaf1f43 tempest-ProjectReaderTests-183035627 None] Lock "cinder-quobyte-fdf50b86-7dd3-4d66-916a-62d24775c9ff" released by "delete_volume" :: held 1.050s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:49:31 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-4b5f98d8-61ad-4676-96f1-ca00cdaf1f43 tempest-ProjectReaderTests-183035627 None] Created reservations ['8d0e3fae-df31-4a91-aa38-55f19ab62526', 'c760a331-ba1e-459f-842e-35d0f3dce1bc', '8b035ace-ca9b-4b56-b466-22c55a110603', 'a5150602-cbd0-4d04-815b-ddddd63ebe9c'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:49:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-4b5f98d8-61ad-4676-96f1-ca00cdaf1f43 tempest-ProjectReaderTests-183035627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:49:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-4b5f98d8-61ad-4676-96f1-ca00cdaf1f43 tempest-ProjectReaderTests-183035627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:49:31 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-4b5f98d8-61ad-4676-96f1-ca00cdaf1f43 tempest-ProjectReaderTests-183035627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:49:31 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-4b5f98d8-61ad-4676-96f1-ca00cdaf1f43 tempest-ProjectReaderTests-183035627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:49:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-4b5f98d8-61ad-4676-96f1-ca00cdaf1f43 tempest-ProjectReaderTests-183035627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:49:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4b5f98d8-61ad-4676-96f1-ca00cdaf1f43 tempest-ProjectReaderTests-183035627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:49:31 devstack sudo[99956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:49:31 devstack sudo[99956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:49:32 devstack sudo[99956]: pam_unix(sudo:session): session closed for user root Sep 04 22:49:32 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4b5f98d8-61ad-4676-96f1-ca00cdaf1f43 tempest-ProjectReaderTests-183035627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.418s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:49:32 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-4b5f98d8-61ad-4676-96f1-ca00cdaf1f43 tempest-ProjectReaderTests-183035627 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:49:32 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-4b5f98d8-61ad-4676-96f1-ca00cdaf1f43 tempest-ProjectReaderTests-183035627 None] Deleted volume successfully. Sep 04 22:49:32 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-4b5f98d8-61ad-4676-96f1-ca00cdaf1f43 tempest-ProjectReaderTests-183035627 None] Lock "cinder-fdf50b86-7dd3-4d66-916a-62d24775c9ff-delete_volume" released by "delete_volume" :: held 1.895s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:49:32 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-21eee430-6988-4945-bd2d-3b31d8cc7bb3 tempest-TestStampPattern-1034473821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:49:32 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-21eee430-6988-4945-bd2d-3b31d8cc7bb3 tempest-TestStampPattern-1034473821 None] Flow 'volume_create_manager' (426f7d84-767d-4f21-ad85-719ab85093bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:49:32 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-21eee430-6988-4945-bd2d-3b31d8cc7bb3 tempest-TestStampPattern-1034473821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b382de93-fc11-4262-8522-1be5f42904bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:49:32 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-21eee430-6988-4945-bd2d-3b31d8cc7bb3 tempest-TestStampPattern-1034473821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b382de93-fc11-4262-8522-1be5f42904bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:49:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1718403028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=313d1bd3-92d3-4f1e-808c-876c31543218,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb437b5a70d243aca90c7b7b2488325c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:49:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:49:33Z,use_quota=True,user_id='f6db4786e04547bbb16cb877e40caf57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:49:32 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-21eee430-6988-4945-bd2d-3b31d8cc7bb3 tempest-TestStampPattern-1034473821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (559d99ba-5d88-4f47-9765-0bf2d866f7da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:49:32 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-21eee430-6988-4945-bd2d-3b31d8cc7bb3 tempest-TestStampPattern-1034473821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (559d99ba-5d88-4f47-9765-0bf2d866f7da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:49:32 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-21eee430-6988-4945-bd2d-3b31d8cc7bb3 tempest-TestStampPattern-1034473821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57fa52d9-3e0f-4e82-a888-f5b963002346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:49:32 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-21eee430-6988-4945-bd2d-3b31d8cc7bb3 tempest-TestStampPattern-1034473821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57fa52d9-3e0f-4e82-a888-f5b963002346) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '313d1bd3-92d3-4f1e-808c-876c31543218', 'volume_name': 'volume-313d1bd3-92d3-4f1e-808c-876c31543218', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:49:32 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-21eee430-6988-4945-bd2d-3b31d8cc7bb3 tempest-TestStampPattern-1034473821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e70e4fc2-95cf-4254-99a7-59ee7da131f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:49:32 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-21eee430-6988-4945-bd2d-3b31d8cc7bb3 tempest-TestStampPattern-1034473821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e70e4fc2-95cf-4254-99a7-59ee7da131f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:49:32 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-21eee430-6988-4945-bd2d-3b31d8cc7bb3 tempest-TestStampPattern-1034473821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (625afaff-3606-4fe6-9d1b-c1bc640d5600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:49:32 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-21eee430-6988-4945-bd2d-3b31d8cc7bb3 tempest-TestStampPattern-1034473821 None] Volume 313d1bd3-92d3-4f1e-808c-876c31543218: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-313d1bd3-92d3-4f1e-808c-876c31543218', 'volume_size': 1} Sep 04 22:49:32 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-21eee430-6988-4945-bd2d-3b31d8cc7bb3 tempest-TestStampPattern-1034473821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:49:32 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-21eee430-6988-4945-bd2d-3b31d8cc7bb3 tempest-TestStampPattern-1034473821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:49:32 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-21eee430-6988-4945-bd2d-3b31d8cc7bb3 tempest-TestStampPattern-1034473821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:49:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1718403028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=313d1bd3-92d3-4f1e-808c-876c31543218,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb437b5a70d243aca90c7b7b2488325c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:49:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:49:33Z,use_quota=True,user_id='f6db4786e04547bbb16cb877e40caf57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:49:32 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-21eee430-6988-4945-bd2d-3b31d8cc7bb3 tempest-TestStampPattern-1034473821 None] Creating volume 313d1bd3-92d3-4f1e-808c-876c31543218 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:49:32 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-21eee430-6988-4945-bd2d-3b31d8cc7bb3 tempest-TestStampPattern-1034473821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:49:32 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-21eee430-6988-4945-bd2d-3b31d8cc7bb3 tempest-TestStampPattern-1034473821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:49:32 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-21eee430-6988-4945-bd2d-3b31d8cc7bb3 tempest-TestStampPattern-1034473821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:49:32 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-21eee430-6988-4945-bd2d-3b31d8cc7bb3 tempest-TestStampPattern-1034473821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:49:32 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-21eee430-6988-4945-bd2d-3b31d8cc7bb3 tempest-TestStampPattern-1034473821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:49:32 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-21eee430-6988-4945-bd2d-3b31d8cc7bb3 tempest-TestStampPattern-1034473821 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:49:32 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-21eee430-6988-4945-bd2d-3b31d8cc7bb3 tempest-TestStampPattern-1034473821 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:49:32 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-21eee430-6988-4945-bd2d-3b31d8cc7bb3 tempest-TestStampPattern-1034473821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-313d1bd3-92d3-4f1e-808c-876c31543218 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:49:32 devstack sudo[99988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-313d1bd3-92d3-4f1e-808c-876c31543218 1073741824 Sep 04 22:49:32 devstack sudo[99988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:49:33 devstack sudo[99988]: pam_unix(sudo:session): session closed for user root Sep 04 22:49:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-21eee430-6988-4945-bd2d-3b31d8cc7bb3 tempest-TestStampPattern-1034473821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-313d1bd3-92d3-4f1e-808c-876c31543218 1073741824" returned: 0 in 1.059s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:49:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-21eee430-6988-4945-bd2d-3b31d8cc7bb3 tempest-TestStampPattern-1034473821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-313d1bd3-92d3-4f1e-808c-876c31543218 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:49:33 devstack sudo[100036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-313d1bd3-92d3-4f1e-808c-876c31543218 Sep 04 22:49:33 devstack sudo[100036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:49:34 devstack sudo[100036]: pam_unix(sudo:session): session closed for user root Sep 04 22:49:34 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-21eee430-6988-4945-bd2d-3b31d8cc7bb3 tempest-TestStampPattern-1034473821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-313d1bd3-92d3-4f1e-808c-876c31543218" returned: 0 in 0.637s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:49:34 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-21eee430-6988-4945-bd2d-3b31d8cc7bb3 tempest-TestStampPattern-1034473821 None] <== create_volume: return (1811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:49:34 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-21eee430-6988-4945-bd2d-3b31d8cc7bb3 tempest-TestStampPattern-1034473821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.815s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:49:34 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-21eee430-6988-4945-bd2d-3b31d8cc7bb3 tempest-TestStampPattern-1034473821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (625afaff-3606-4fe6-9d1b-c1bc640d5600) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-313d1bd3-92d3-4f1e-808c-876c31543218', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:49:34 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-21eee430-6988-4945-bd2d-3b31d8cc7bb3 tempest-TestStampPattern-1034473821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4576538a-9b05-4640-978f-98eee26be4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:49:34 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-21eee430-6988-4945-bd2d-3b31d8cc7bb3 tempest-TestStampPattern-1034473821 None] Volume volume-313d1bd3-92d3-4f1e-808c-876c31543218 (313d1bd3-92d3-4f1e-808c-876c31543218): created successfully Sep 04 22:49:34 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-21eee430-6988-4945-bd2d-3b31d8cc7bb3 tempest-TestStampPattern-1034473821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4576538a-9b05-4640-978f-98eee26be4fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:49:34 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-21eee430-6988-4945-bd2d-3b31d8cc7bb3 tempest-TestStampPattern-1034473821 None] Flow 'volume_create_manager' (426f7d84-767d-4f21-ad85-719ab85093bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:49:34 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-21eee430-6988-4945-bd2d-3b31d8cc7bb3 tempest-TestStampPattern-1034473821 None] Created volume successfully. Sep 04 22:49:38 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-807a62b7-1f2a-450e-b916-1909771ad004 tempest-VolumesActionsTest-1053366409 None] Acquiring lock "cinder-46da67d1-af60-4135-b585-6cc3e02fa5c3" by "attach_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:49:38 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-807a62b7-1f2a-450e-b916-1909771ad004 tempest-VolumesActionsTest-1053366409 None] Lock "cinder-46da67d1-af60-4135-b585-6cc3e02fa5c3" acquired by "attach_volume" :: waited 0.026s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:49:38 devstack cinder-volume[87576]: DEBUG dbcounter [-] [87576] Writing DB stats cinder:SELECT=64,cinder:INSERT=20,cinder:UPDATE=90,cinder:DELETE=8 {{(pid=87576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 22:49:39 devstack cinder-volume[87576]: DEBUG dbcounter [-] [87576] Writing DB stats cinder:SELECT=68,cinder:DELETE=9,cinder:INSERT=20,cinder:UPDATE=84 {{(pid=87576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 22:49:39 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-807a62b7-1f2a-450e-b916-1909771ad004 tempest-VolumesActionsTest-1053366409 None] Attaching volume 46da67d1-af60-4135-b585-6cc3e02fa5c3 to instance 164cab41-1473-448c-9f09-5987e0bd0998 at mountpoint /dev/vdb on host None. Sep 04 22:49:39 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-807a62b7-1f2a-450e-b916-1909771ad004 tempest-VolumesActionsTest-1053366409 None] Attach volume completed successfully. Sep 04 22:49:39 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-807a62b7-1f2a-450e-b916-1909771ad004 tempest-VolumesActionsTest-1053366409 None] Lock "cinder-46da67d1-af60-4135-b585-6cc3e02fa5c3" released by "attach_volume" :: held 0.145s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:49:39 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-e8d490e8-4d72-4c6c-8f36-bac8b204df95 tempest-VolumesActionsTest-1053366409 None] Acquiring lock "cinder-46da67d1-af60-4135-b585-6cc3e02fa5c3-detach_volume" by "detach_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:49:39 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-e8d490e8-4d72-4c6c-8f36-bac8b204df95 tempest-VolumesActionsTest-1053366409 None] Lock "cinder-46da67d1-af60-4135-b585-6cc3e02fa5c3-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:49:39 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-e8d490e8-4d72-4c6c-8f36-bac8b204df95 tempest-VolumesActionsTest-1053366409 None] Detaching volume 46da67d1-af60-4135-b585-6cc3e02fa5c3 from instance 164cab41-1473-448c-9f09-5987e0bd0998. Sep 04 22:49:39 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-e8d490e8-4d72-4c6c-8f36-bac8b204df95 tempest-VolumesActionsTest-1053366409 None] Detach volume completed successfully. Sep 04 22:49:39 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-e8d490e8-4d72-4c6c-8f36-bac8b204df95 tempest-VolumesActionsTest-1053366409 None] Lock "cinder-46da67d1-af60-4135-b585-6cc3e02fa5c3-detach_volume" released by "detach_volume" :: held 0.063s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:49:42 devstack cinder-volume[87576]: INFO cinder.volume.manager [req-8c8d4064-6d53-4b7c-8d6e-10ebec5c1d2f req-5e584c3e-90e9-4db2-be21-edf031e53a40 tempest-AttachVolumeNegativeTest-2019172075 None] Terminate volume connection completed successfully. Sep 04 22:49:42 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-8c8d4064-6d53-4b7c-8d6e-10ebec5c1d2f req-5e584c3e-90e9-4db2-be21-edf031e53a40 tempest-AttachVolumeNegativeTest-2019172075 None] Deleting attachment 2f80532a-af68-4bda-9735-4b0304cfb51d. {{(pid=87576) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 22:49:46 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-31b18919-d6bb-4e6d-b364-f716cdb11e1c tempest-VolumesActionsTest-1053366409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:49:46 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-31b18919-d6bb-4e6d-b364-f716cdb11e1c tempest-VolumesActionsTest-1053366409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:49:46 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[2201adf8-531f-44a5-bdb0-c80fbfcbddbd]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:49:46 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-31b18919-d6bb-4e6d-b364-f716cdb11e1c tempest-VolumesActionsTest-1053366409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-46da67d1-af60-4135-b585-6cc3e02fa5c3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:49:47 devstack sudo[100234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-46da67d1-af60-4135-b585-6cc3e02fa5c3 Sep 04 22:49:47 devstack sudo[100234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:49:47 devstack sudo[100234]: pam_unix(sudo:session): session closed for user root Sep 04 22:49:47 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-31b18919-d6bb-4e6d-b364-f716cdb11e1c tempest-VolumesActionsTest-1053366409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-46da67d1-af60-4135-b585-6cc3e02fa5c3" returned: 0 in 0.527s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:49:47 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ea7e83-4758-45f4-8d4d-40b0e1d31dbc]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:49:47 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-31b18919-d6bb-4e6d-b364-f716cdb11e1c tempest-VolumesActionsTest-1053366409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-46da67d1-af60-4135-b585-6cc3e02fa5c3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:49:47 devstack sudo[100240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-46da67d1-af60-4135-b585-6cc3e02fa5c3 Sep 04 22:49:47 devstack sudo[100240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:49:47 devstack sudo[100240]: pam_unix(sudo:session): session closed for user root Sep 04 22:49:48 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-31b18919-d6bb-4e6d-b364-f716cdb11e1c tempest-VolumesActionsTest-1053366409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-46da67d1-af60-4135-b585-6cc3e02fa5c3" returned: 0 in 0.472s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:49:48 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-31b18919-d6bb-4e6d-b364-f716cdb11e1c tempest-VolumesActionsTest-1053366409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-46da67d1-af60-4135-b585-6cc3e02fa5c3 /opt/stack/data/cinder/conversion/46da67d1-af60-4135-b585-6cc3e02fa5c3.temp_image.a6b3363e-7ee4-48e1-aa67-e2b9e104a62dh3a71bxe.img {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:49:48 devstack sudo[100245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-46da67d1-af60-4135-b585-6cc3e02fa5c3 /opt/stack/data/cinder/conversion/46da67d1-af60-4135-b585-6cc3e02fa5c3.temp_image.a6b3363e-7ee4-48e1-aa67-e2b9e104a62dh3a71bxe.img Sep 04 22:49:48 devstack sudo[100245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:49:52 devstack cinder-volume[87576]: DEBUG dbcounter [-] [87576] Writing DB stats cinder:UPDATE=2,cinder:SELECT=5 {{(pid=87576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 22:49:55 devstack sudo[100245]: pam_unix(sudo:session): session closed for user root Sep 04 22:49:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-31b18919-d6bb-4e6d-b364-f716cdb11e1c tempest-VolumesActionsTest-1053366409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-46da67d1-af60-4135-b585-6cc3e02fa5c3 /opt/stack/data/cinder/conversion/46da67d1-af60-4135-b585-6cc3e02fa5c3.temp_image.a6b3363e-7ee4-48e1-aa67-e2b9e104a62dh3a71bxe.img" returned: 0 in 6.998s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:49:55 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[d02648dd-d0fa-46bb-95ec-9644bc4fc3ea]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:49:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-31b18919-d6bb-4e6d-b364-f716cdb11e1c tempest-VolumesActionsTest-1053366409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-46da67d1-af60-4135-b585-6cc3e02fa5c3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:49:55 devstack sudo[100261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-46da67d1-af60-4135-b585-6cc3e02fa5c3 Sep 04 22:49:55 devstack sudo[100261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:49:55 devstack sudo[100261]: pam_unix(sudo:session): session closed for user root Sep 04 22:49:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-31b18919-d6bb-4e6d-b364-f716cdb11e1c tempest-VolumesActionsTest-1053366409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-46da67d1-af60-4135-b585-6cc3e02fa5c3" returned: 0 in 0.636s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:49:55 devstack cinder-volume[87576]: DEBUG cinder.image.image_utils [None req-31b18919-d6bb-4e6d-b364-f716cdb11e1c tempest-VolumesActionsTest-1053366409 None] Image conversion details: src /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-46da67d1-af60-4135-b585-6cc3e02fa5c3, size 1024.00 MB, duration 7.00 sec, destination /opt/stack/data/cinder/conversion/46da67d1-af60-4135-b585-6cc3e02fa5c3.temp_image.a6b3363e-7ee4-48e1-aa67-e2b9e104a62dh3a71bxe.img {{(pid=87576) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 22:49:55 devstack cinder-volume[87576]: INFO cinder.image.image_utils [None req-31b18919-d6bb-4e6d-b364-f716cdb11e1c tempest-VolumesActionsTest-1053366409 None] Converted 1024.00 MB image at 146.31 MB/s Sep 04 22:49:55 devstack cinder-volume[87576]: DEBUG cinder.image.image_utils [None req-31b18919-d6bb-4e6d-b364-f716cdb11e1c tempest-VolumesActionsTest-1053366409 None] a6b3363e-7ee4-48e1-aa67-e2b9e104a62d was raw, no need to convert to raw {{(pid=87576) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 04 22:50:05 devstack cinder-volume[87576]: DEBUG dbcounter [-] [87576] Writing DB stats cinder:SELECT=12,cinder:UPDATE=5,cinder:INSERT=1 {{(pid=87576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 22:50:05 devstack cinder-volume[87576]: DEBUG dbcounter [-] [87576] Writing DB stats cinder:SELECT=1 {{(pid=87576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 22:50:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-0e908fed-017c-4614-8a9a-82194c384dc7 req-1c9093f1-a557-4e52-8913-bdb5ff077a44 tempest-TestStampPattern-1034473821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:50:11 devstack cinder-volume[87576]: DEBUG oslo_service.periodic_task [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87576) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 22:50:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:50:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:50:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:50:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:50:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:50:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:50:11 devstack sudo[100411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:50:11 devstack sudo[100411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:50:12 devstack sudo[100411]: pam_unix(sudo:session): session closed for user root Sep 04 22:50:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.380s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:50:12 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:50:12 devstack cinder-volume[87576]: DEBUG oslo_service.periodic_task [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Running periodic task VolumeManager._thread_info {{(pid=87576) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 22:50:12 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] thread count: 28 {{(pid=87576) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 22:50:12 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] thread info: [<_MainThread(MainThread, started 125730416963712)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87576) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 22:50:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-31b18919-d6bb-4e6d-b364-f716cdb11e1c tempest-VolumesActionsTest-1053366409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 31.662s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:50:18 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-31b18919-d6bb-4e6d-b364-f716cdb11e1c tempest-VolumesActionsTest-1053366409 None] Uploaded volume to glance image-id: a6b3363e-7ee4-48e1-aa67-e2b9e104a62d. {{(pid=87576) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 04 22:50:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-0e908fed-017c-4614-8a9a-82194c384dc7 req-1c9093f1-a557-4e52-8913-bdb5ff077a44 tempest-TestStampPattern-1034473821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 9.557s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:50:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-0e908fed-017c-4614-8a9a-82194c384dc7 req-1c9093f1-a557-4e52-8913-bdb5ff077a44 tempest-TestStampPattern-1034473821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:50:18 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-31b18919-d6bb-4e6d-b364-f716cdb11e1c tempest-VolumesActionsTest-1053366409 None] Copy volume to image completed successfully. Sep 04 22:50:18 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-0e908fed-017c-4614-8a9a-82194c384dc7 req-1c9093f1-a557-4e52-8913-bdb5ff077a44 tempest-TestStampPattern-1034473821 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4', 'name': 'volume-313d1bd3-92d3-4f1e-808c-876c31543218', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cb34c231-11d9-429b-bf7e-312f205f9eab', 'enforce_multipath': True} {{(pid=87576) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 22:50:18 devstack cinder-volume[87576]: INFO cinder.volume.manager [req-0e908fed-017c-4614-8a9a-82194c384dc7 req-1c9093f1-a557-4e52-8913-bdb5ff077a44 tempest-TestStampPattern-1034473821 None] attachment_update completed successfully. Sep 04 22:50:19 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-d38bdc97-b9fb-4c28-b979-b88f9d8e8532 tempest-VolumesActionsTest-1053366409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:50:19 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-d38bdc97-b9fb-4c28-b979-b88f9d8e8532 tempest-VolumesActionsTest-1053366409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:50:19 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[150d55a2-a360-4365-86a5-2e68c7058ef8]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:50:19 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d38bdc97-b9fb-4c28-b979-b88f9d8e8532 tempest-VolumesActionsTest-1053366409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-46da67d1-af60-4135-b585-6cc3e02fa5c3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:50:19 devstack sudo[100827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-46da67d1-af60-4135-b585-6cc3e02fa5c3 Sep 04 22:50:19 devstack sudo[100827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:50:20 devstack sudo[100827]: pam_unix(sudo:session): session closed for user root Sep 04 22:50:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d38bdc97-b9fb-4c28-b979-b88f9d8e8532 tempest-VolumesActionsTest-1053366409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-46da67d1-af60-4135-b585-6cc3e02fa5c3" returned: 0 in 0.367s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:50:20 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74086a6-33c7-4875-9384-14479c55436a]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:50:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d38bdc97-b9fb-4c28-b979-b88f9d8e8532 tempest-VolumesActionsTest-1053366409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-46da67d1-af60-4135-b585-6cc3e02fa5c3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:50:20 devstack sudo[100838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-46da67d1-af60-4135-b585-6cc3e02fa5c3 Sep 04 22:50:20 devstack sudo[100838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:50:20 devstack sudo[100838]: pam_unix(sudo:session): session closed for user root Sep 04 22:50:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d38bdc97-b9fb-4c28-b979-b88f9d8e8532 tempest-VolumesActionsTest-1053366409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-46da67d1-af60-4135-b585-6cc3e02fa5c3" returned: 0 in 0.394s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:50:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d38bdc97-b9fb-4c28-b979-b88f9d8e8532 tempest-VolumesActionsTest-1053366409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-46da67d1-af60-4135-b585-6cc3e02fa5c3 /opt/stack/data/cinder/conversion/46da67d1-af60-4135-b585-6cc3e02fa5c3.temp_image.e243ebf3-2f72-40e6-99bc-57cd44be25d098ki7i0v.img {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:50:20 devstack sudo[100844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-46da67d1-af60-4135-b585-6cc3e02fa5c3 /opt/stack/data/cinder/conversion/46da67d1-af60-4135-b585-6cc3e02fa5c3.temp_image.e243ebf3-2f72-40e6-99bc-57cd44be25d098ki7i0v.img Sep 04 22:50:20 devstack sudo[100844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:50:25 devstack cinder-volume[87576]: INFO cinder.volume.manager [req-586ba40c-f3e5-451a-ac13-9e2d3d2bb157 req-f109fffe-241a-4224-98dd-c70f5bde67f5 tempest-TestStampPattern-1034473821 None] Terminate volume connection completed successfully. Sep 04 22:50:25 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-586ba40c-f3e5-451a-ac13-9e2d3d2bb157 req-f109fffe-241a-4224-98dd-c70f5bde67f5 tempest-TestStampPattern-1034473821 None] Deleting attachment cb34c231-11d9-429b-bf7e-312f205f9eab. {{(pid=87576) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 22:50:26 devstack sudo[100844]: pam_unix(sudo:session): session closed for user root Sep 04 22:50:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d38bdc97-b9fb-4c28-b979-b88f9d8e8532 tempest-VolumesActionsTest-1053366409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-46da67d1-af60-4135-b585-6cc3e02fa5c3 /opt/stack/data/cinder/conversion/46da67d1-af60-4135-b585-6cc3e02fa5c3.temp_image.e243ebf3-2f72-40e6-99bc-57cd44be25d098ki7i0v.img" returned: 0 in 5.715s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:50:26 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[625d251f-1271-4a32-a915-060b30f9dec1]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:50:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d38bdc97-b9fb-4c28-b979-b88f9d8e8532 tempest-VolumesActionsTest-1053366409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-46da67d1-af60-4135-b585-6cc3e02fa5c3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:50:26 devstack sudo[100899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-46da67d1-af60-4135-b585-6cc3e02fa5c3 Sep 04 22:50:26 devstack sudo[100899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:50:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-4668563f-af4b-4846-8355-66976be549ec tempest-TestStampPattern-1034473821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:50:26 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-fad6c1ec-d73c-4e35-82b0-f15331eecf43 tempest-AttachVolumeNegativeTest-2019172075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:50:26 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-fad6c1ec-d73c-4e35-82b0-f15331eecf43 tempest-AttachVolumeNegativeTest-2019172075 None] Flow 'volume_create_manager' (ba2ee97a-ae6b-4300-bb5e-d443bd32b541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:50:26 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-fad6c1ec-d73c-4e35-82b0-f15331eecf43 tempest-AttachVolumeNegativeTest-2019172075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec98cb26-f140-4298-b583-09a4f32f44b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:50:26 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-fad6c1ec-d73c-4e35-82b0-f15331eecf43 tempest-AttachVolumeNegativeTest-2019172075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec98cb26-f140-4298-b583-09a4f32f44b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:50:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1667184180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e6bccb7-98f0-40e3-a7a3-53760138abbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e80e6c251404ba9b9947664ac5836f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:50:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:50:26Z,use_quota=True,user_id='047f7ffdca4c45cdb2cc83f5261484c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:50:26 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-fad6c1ec-d73c-4e35-82b0-f15331eecf43 tempest-AttachVolumeNegativeTest-2019172075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4b2a718-bc6b-46e1-b2cd-f44faeb5d7e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:50:26 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-fad6c1ec-d73c-4e35-82b0-f15331eecf43 tempest-AttachVolumeNegativeTest-2019172075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4b2a718-bc6b-46e1-b2cd-f44faeb5d7e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:50:26 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-fad6c1ec-d73c-4e35-82b0-f15331eecf43 tempest-AttachVolumeNegativeTest-2019172075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7024a045-6143-4b40-8ae0-a592db296506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:50:26 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-fad6c1ec-d73c-4e35-82b0-f15331eecf43 tempest-AttachVolumeNegativeTest-2019172075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7024a045-6143-4b40-8ae0-a592db296506) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e6bccb7-98f0-40e3-a7a3-53760138abbd', 'volume_name': 'volume-0e6bccb7-98f0-40e3-a7a3-53760138abbd', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:50:26 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-fad6c1ec-d73c-4e35-82b0-f15331eecf43 tempest-AttachVolumeNegativeTest-2019172075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (586f996b-1e36-4a8e-a249-0c235bc4daa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:50:26 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-fad6c1ec-d73c-4e35-82b0-f15331eecf43 tempest-AttachVolumeNegativeTest-2019172075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (586f996b-1e36-4a8e-a249-0c235bc4daa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:50:26 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-fad6c1ec-d73c-4e35-82b0-f15331eecf43 tempest-AttachVolumeNegativeTest-2019172075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c40963de-e506-4694-982d-fae80874c55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:50:26 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-fad6c1ec-d73c-4e35-82b0-f15331eecf43 tempest-AttachVolumeNegativeTest-2019172075 None] Volume 0e6bccb7-98f0-40e3-a7a3-53760138abbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e6bccb7-98f0-40e3-a7a3-53760138abbd', 'volume_size': 1} Sep 04 22:50:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-fad6c1ec-d73c-4e35-82b0-f15331eecf43 tempest-AttachVolumeNegativeTest-2019172075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:50:26 devstack sudo[100899]: pam_unix(sudo:session): session closed for user root Sep 04 22:50:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d38bdc97-b9fb-4c28-b979-b88f9d8e8532 tempest-VolumesActionsTest-1053366409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-46da67d1-af60-4135-b585-6cc3e02fa5c3" returned: 0 in 0.534s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:50:26 devstack cinder-volume[87576]: DEBUG cinder.image.image_utils [None req-d38bdc97-b9fb-4c28-b979-b88f9d8e8532 tempest-VolumesActionsTest-1053366409 None] Image conversion details: src /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-46da67d1-af60-4135-b585-6cc3e02fa5c3, size 1024.00 MB, duration 5.72 sec, destination /opt/stack/data/cinder/conversion/46da67d1-af60-4135-b585-6cc3e02fa5c3.temp_image.e243ebf3-2f72-40e6-99bc-57cd44be25d098ki7i0v.img {{(pid=87576) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 22:50:26 devstack cinder-volume[87576]: INFO cinder.image.image_utils [None req-d38bdc97-b9fb-4c28-b979-b88f9d8e8532 tempest-VolumesActionsTest-1053366409 None] Converted 1024.00 MB image at 179.15 MB/s Sep 04 22:50:26 devstack cinder-volume[87576]: DEBUG cinder.image.image_utils [None req-d38bdc97-b9fb-4c28-b979-b88f9d8e8532 tempest-VolumesActionsTest-1053366409 None] e243ebf3-2f72-40e6-99bc-57cd44be25d0 was raw, converting to qcow2 {{(pid=87576) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Sep 04 22:50:26 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[576882e2-7dbc-42a6-8b06-d1d3302e5a28]: (4, 'raw') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:50:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d38bdc97-b9fb-4c28-b979-b88f9d8e8532 tempest-VolumesActionsTest-1053366409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/46da67d1-af60-4135-b585-6cc3e02fa5c3.temp_image.e243ebf3-2f72-40e6-99bc-57cd44be25d098ki7i0v.img {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:50:26 devstack sudo[100904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/46da67d1-af60-4135-b585-6cc3e02fa5c3.temp_image.e243ebf3-2f72-40e6-99bc-57cd44be25d098ki7i0v.img Sep 04 22:50:26 devstack sudo[100904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:50:27 devstack sudo[100904]: pam_unix(sudo:session): session closed for user root Sep 04 22:50:27 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d38bdc97-b9fb-4c28-b979-b88f9d8e8532 tempest-VolumesActionsTest-1053366409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/46da67d1-af60-4135-b585-6cc3e02fa5c3.temp_image.e243ebf3-2f72-40e6-99bc-57cd44be25d098ki7i0v.img" returned: 0 in 0.328s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:50:27 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d38bdc97-b9fb-4c28-b979-b88f9d8e8532 tempest-VolumesActionsTest-1053366409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/46da67d1-af60-4135-b585-6cc3e02fa5c3.temp_image.e243ebf3-2f72-40e6-99bc-57cd44be25d098ki7i0v.img {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:50:27 devstack sudo[100908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/46da67d1-af60-4135-b585-6cc3e02fa5c3.temp_image.e243ebf3-2f72-40e6-99bc-57cd44be25d098ki7i0v.img Sep 04 22:50:27 devstack sudo[100908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:50:27 devstack sudo[100908]: pam_unix(sudo:session): session closed for user root Sep 04 22:50:27 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d38bdc97-b9fb-4c28-b979-b88f9d8e8532 tempest-VolumesActionsTest-1053366409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/46da67d1-af60-4135-b585-6cc3e02fa5c3.temp_image.e243ebf3-2f72-40e6-99bc-57cd44be25d098ki7i0v.img" returned: 1 in 0.329s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:50:27 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d38bdc97-b9fb-4c28-b979-b88f9d8e8532 tempest-VolumesActionsTest-1053366409 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/46da67d1-af60-4135-b585-6cc3e02fa5c3.temp_image.e243ebf3-2f72-40e6-99bc-57cd44be25d098ki7i0v.img' failed. Not Retrying. {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 22:50:27 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d38bdc97-b9fb-4c28-b979-b88f9d8e8532 tempest-VolumesActionsTest-1053366409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/46da67d1-af60-4135-b585-6cc3e02fa5c3.temp_image.e243ebf3-2f72-40e6-99bc-57cd44be25d098ki7i0v.img /opt/stack/data/cinder/conversion/vol_upload_cqdm84cv {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:50:27 devstack sudo[100913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/46da67d1-af60-4135-b585-6cc3e02fa5c3.temp_image.e243ebf3-2f72-40e6-99bc-57cd44be25d098ki7i0v.img /opt/stack/data/cinder/conversion/vol_upload_cqdm84cv Sep 04 22:50:27 devstack sudo[100913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:50:27 devstack sudo[100913]: pam_unix(sudo:session): session closed for user root Sep 04 22:50:27 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d38bdc97-b9fb-4c28-b979-b88f9d8e8532 tempest-VolumesActionsTest-1053366409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/46da67d1-af60-4135-b585-6cc3e02fa5c3.temp_image.e243ebf3-2f72-40e6-99bc-57cd44be25d098ki7i0v.img /opt/stack/data/cinder/conversion/vol_upload_cqdm84cv" returned: 0 in 0.254s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:50:27 devstack cinder-volume[87576]: DEBUG cinder.image.image_utils [None req-d38bdc97-b9fb-4c28-b979-b88f9d8e8532 tempest-VolumesActionsTest-1053366409 None] Image conversion details: src /opt/stack/data/cinder/conversion/46da67d1-af60-4135-b585-6cc3e02fa5c3.temp_image.e243ebf3-2f72-40e6-99bc-57cd44be25d098ki7i0v.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_cqdm84cv {{(pid=87576) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 22:50:27 devstack cinder-volume[87576]: INFO cinder.image.image_utils [None req-d38bdc97-b9fb-4c28-b979-b88f9d8e8532 tempest-VolumesActionsTest-1053366409 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 04 22:50:27 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef8e69f-fbe1-40f4-a335-651390cfe01f]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:50:27 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d38bdc97-b9fb-4c28-b979-b88f9d8e8532 tempest-VolumesActionsTest-1053366409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_cqdm84cv {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:50:27 devstack sudo[100918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_cqdm84cv Sep 04 22:50:27 devstack sudo[100918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:50:28 devstack sudo[100918]: pam_unix(sudo:session): session closed for user root Sep 04 22:50:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d38bdc97-b9fb-4c28-b979-b88f9d8e8532 tempest-VolumesActionsTest-1053366409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_cqdm84cv" returned: 0 in 0.321s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:50:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-d38bdc97-b9fb-4c28-b979-b88f9d8e8532 tempest-VolumesActionsTest-1053366409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.531s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:50:29 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d38bdc97-b9fb-4c28-b979-b88f9d8e8532 tempest-VolumesActionsTest-1053366409 None] Uploaded volume to glance image-id: e243ebf3-2f72-40e6-99bc-57cd44be25d0. {{(pid=87576) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 04 22:50:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-4668563f-af4b-4846-8355-66976be549ec tempest-TestStampPattern-1034473821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.827s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:50:29 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-4668563f-af4b-4846-8355-66976be549ec tempest-TestStampPattern-1034473821 None] Creating offline snapshot 134381b4-62a3-4e8a-8a6f-bf9ff18c5f9c of volume 313d1bd3-92d3-4f1e-808c-876c31543218 {{(pid=87576) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 22:50:29 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-d38bdc97-b9fb-4c28-b979-b88f9d8e8532 tempest-VolumesActionsTest-1053366409 None] Copy volume to image completed successfully. Sep 04 22:50:29 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[7996d61e-6ceb-4e9d-81f2-6e7756246a0c]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:50:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4668563f-af4b-4846-8355-66976be549ec tempest-TestStampPattern-1034473821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-313d1bd3-92d3-4f1e-808c-876c31543218 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:50:29 devstack sudo[100923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-313d1bd3-92d3-4f1e-808c-876c31543218 Sep 04 22:50:29 devstack sudo[100923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:50:29 devstack sudo[100923]: pam_unix(sudo:session): session closed for user root Sep 04 22:50:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4668563f-af4b-4846-8355-66976be549ec tempest-TestStampPattern-1034473821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-313d1bd3-92d3-4f1e-808c-876c31543218" returned: 0 in 0.377s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:50:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4668563f-af4b-4846-8355-66976be549ec tempest-TestStampPattern-1034473821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-313d1bd3-92d3-4f1e-808c-876c31543218,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-313d1bd3-92d3-4f1e-808c-876c31543218.134381b4-62a3-4e8a-8a6f-bf9ff18c5f9c 1G {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:50:29 devstack sudo[100928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-313d1bd3-92d3-4f1e-808c-876c31543218,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-313d1bd3-92d3-4f1e-808c-876c31543218.134381b4-62a3-4e8a-8a6f-bf9ff18c5f9c 1G Sep 04 22:50:29 devstack sudo[100928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:50:30 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-54d22286-25dd-4bbf-92c5-b3bab9ea64ce tempest-VolumesActionsTest-1053366409 None] Acquiring lock "cinder-46da67d1-af60-4135-b585-6cc3e02fa5c3-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:50:30 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-54d22286-25dd-4bbf-92c5-b3bab9ea64ce tempest-VolumesActionsTest-1053366409 None] Lock "cinder-46da67d1-af60-4135-b585-6cc3e02fa5c3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:50:30 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-54d22286-25dd-4bbf-92c5-b3bab9ea64ce tempest-VolumesActionsTest-1053366409 None] Acquiring lock "cinder-quobyte-46da67d1-af60-4135-b585-6cc3e02fa5c3" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:50:30 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-54d22286-25dd-4bbf-92c5-b3bab9ea64ce tempest-VolumesActionsTest-1053366409 None] Lock "cinder-quobyte-46da67d1-af60-4135-b585-6cc3e02fa5c3" acquired by "delete_volume" :: waited 0.017s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:50:30 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd553aa0-83e5-4a9e-8c16-8c37e8bd216e]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:50:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-54d22286-25dd-4bbf-92c5-b3bab9ea64ce tempest-VolumesActionsTest-1053366409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-46da67d1-af60-4135-b585-6cc3e02fa5c3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:50:30 devstack sudo[100928]: pam_unix(sudo:session): session closed for user root Sep 04 22:50:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4668563f-af4b-4846-8355-66976be549ec tempest-TestStampPattern-1034473821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-313d1bd3-92d3-4f1e-808c-876c31543218,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-313d1bd3-92d3-4f1e-808c-876c31543218.134381b4-62a3-4e8a-8a6f-bf9ff18c5f9c 1G" returned: 0 in 0.451s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:50:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4668563f-af4b-4846-8355-66976be549ec tempest-TestStampPattern-1034473821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-313d1bd3-92d3-4f1e-808c-876c31543218 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-313d1bd3-92d3-4f1e-808c-876c31543218.134381b4-62a3-4e8a-8a6f-bf9ff18c5f9c {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:50:30 devstack sudo[100934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-313d1bd3-92d3-4f1e-808c-876c31543218 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-313d1bd3-92d3-4f1e-808c-876c31543218.134381b4-62a3-4e8a-8a6f-bf9ff18c5f9c Sep 04 22:50:30 devstack sudo[100934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:50:30 devstack sudo[100933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-46da67d1-af60-4135-b585-6cc3e02fa5c3 Sep 04 22:50:30 devstack sudo[100933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:50:30 devstack sudo[100933]: pam_unix(sudo:session): session closed for user root Sep 04 22:50:30 devstack sudo[100934]: pam_unix(sudo:session): session closed for user root Sep 04 22:50:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-54d22286-25dd-4bbf-92c5-b3bab9ea64ce tempest-VolumesActionsTest-1053366409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-46da67d1-af60-4135-b585-6cc3e02fa5c3" returned: 0 in 0.366s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:50:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-54d22286-25dd-4bbf-92c5-b3bab9ea64ce tempest-VolumesActionsTest-1053366409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-46da67d1-af60-4135-b585-6cc3e02fa5c3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:50:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4668563f-af4b-4846-8355-66976be549ec tempest-TestStampPattern-1034473821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-313d1bd3-92d3-4f1e-808c-876c31543218 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-313d1bd3-92d3-4f1e-808c-876c31543218.134381b4-62a3-4e8a-8a6f-bf9ff18c5f9c" returned: 0 in 0.304s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:50:30 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-4668563f-af4b-4846-8355-66976be549ec tempest-TestStampPattern-1034473821 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-313d1bd3-92d3-4f1e-808c-876c31543218.134381b4-62a3-4e8a-8a6f-bf9ff18c5f9c is being set with open permissions: ugo+rw Sep 04 22:50:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4668563f-af4b-4846-8355-66976be549ec tempest-TestStampPattern-1034473821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-313d1bd3-92d3-4f1e-808c-876c31543218.134381b4-62a3-4e8a-8a6f-bf9ff18c5f9c {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:50:30 devstack sudo[100943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-46da67d1-af60-4135-b585-6cc3e02fa5c3 Sep 04 22:50:30 devstack sudo[100943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:50:30 devstack sudo[100944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-313d1bd3-92d3-4f1e-808c-876c31543218.134381b4-62a3-4e8a-8a6f-bf9ff18c5f9c Sep 04 22:50:30 devstack sudo[100944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:50:30 devstack sudo[100943]: pam_unix(sudo:session): session closed for user root Sep 04 22:50:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-54d22286-25dd-4bbf-92c5-b3bab9ea64ce tempest-VolumesActionsTest-1053366409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-46da67d1-af60-4135-b585-6cc3e02fa5c3" returned: 0 in 0.264s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:50:30 devstack sudo[100944]: pam_unix(sudo:session): session closed for user root Sep 04 22:50:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4668563f-af4b-4846-8355-66976be549ec tempest-TestStampPattern-1034473821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-313d1bd3-92d3-4f1e-808c-876c31543218.134381b4-62a3-4e8a-8a6f-bf9ff18c5f9c" returned: 0 in 0.263s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:50:30 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-54d22286-25dd-4bbf-92c5-b3bab9ea64ce tempest-VolumesActionsTest-1053366409 None] Lock "cinder-quobyte-46da67d1-af60-4135-b585-6cc3e02fa5c3" released by "delete_volume" :: held 0.670s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:50:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4668563f-af4b-4846-8355-66976be549ec tempest-TestStampPattern-1034473821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-313d1bd3-92d3-4f1e-808c-876c31543218.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:50:30 devstack sudo[100949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-313d1bd3-92d3-4f1e-808c-876c31543218.info Sep 04 22:50:30 devstack sudo[100949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:50:30 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-54d22286-25dd-4bbf-92c5-b3bab9ea64ce tempest-VolumesActionsTest-1053366409 None] Created reservations ['9cab8685-12bc-4c37-8c0b-0b6dcc3ff421', '7103d403-fd59-482a-a8d1-37a78670a99e', 'c4a02a4d-7f9a-4bc7-8474-47fdb56ee5c0', '37c3f775-539c-41be-a1a2-6e262c578697'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:50:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-54d22286-25dd-4bbf-92c5-b3bab9ea64ce tempest-VolumesActionsTest-1053366409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:50:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-54d22286-25dd-4bbf-92c5-b3bab9ea64ce tempest-VolumesActionsTest-1053366409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:50:30 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-54d22286-25dd-4bbf-92c5-b3bab9ea64ce tempest-VolumesActionsTest-1053366409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:50:30 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-54d22286-25dd-4bbf-92c5-b3bab9ea64ce tempest-VolumesActionsTest-1053366409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:50:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-54d22286-25dd-4bbf-92c5-b3bab9ea64ce tempest-VolumesActionsTest-1053366409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:50:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-54d22286-25dd-4bbf-92c5-b3bab9ea64ce tempest-VolumesActionsTest-1053366409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:50:30 devstack sudo[100951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:50:30 devstack sudo[100951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:50:31 devstack sudo[100949]: pam_unix(sudo:session): session closed for user root Sep 04 22:50:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4668563f-af4b-4846-8355-66976be549ec tempest-TestStampPattern-1034473821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-313d1bd3-92d3-4f1e-808c-876c31543218.info" returned: 0 in 0.271s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:50:31 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-4668563f-af4b-4846-8355-66976be549ec tempest-TestStampPattern-1034473821 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-313d1bd3-92d3-4f1e-808c-876c31543218.info is being set with open permissions: ugo+rw Sep 04 22:50:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4668563f-af4b-4846-8355-66976be549ec tempest-TestStampPattern-1034473821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-313d1bd3-92d3-4f1e-808c-876c31543218.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:50:31 devstack sudo[100954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-313d1bd3-92d3-4f1e-808c-876c31543218.info Sep 04 22:50:31 devstack sudo[100954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:50:31 devstack sudo[100951]: pam_unix(sudo:session): session closed for user root Sep 04 22:50:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-54d22286-25dd-4bbf-92c5-b3bab9ea64ce tempest-VolumesActionsTest-1053366409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.250s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:50:31 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-54d22286-25dd-4bbf-92c5-b3bab9ea64ce tempest-VolumesActionsTest-1053366409 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:50:31 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-54d22286-25dd-4bbf-92c5-b3bab9ea64ce tempest-VolumesActionsTest-1053366409 None] Deleted volume successfully. Sep 04 22:50:31 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-54d22286-25dd-4bbf-92c5-b3bab9ea64ce tempest-VolumesActionsTest-1053366409 None] Lock "cinder-46da67d1-af60-4135-b585-6cc3e02fa5c3-delete_volume" released by "delete_volume" :: held 1.170s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:50:31 devstack sudo[100954]: pam_unix(sudo:session): session closed for user root Sep 04 22:50:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4668563f-af4b-4846-8355-66976be549ec tempest-TestStampPattern-1034473821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-313d1bd3-92d3-4f1e-808c-876c31543218.info" returned: 0 in 0.269s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:50:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-4668563f-af4b-4846-8355-66976be549ec tempest-TestStampPattern-1034473821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.036s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:50:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-fad6c1ec-d73c-4e35-82b0-f15331eecf43 tempest-AttachVolumeNegativeTest-2019172075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.774s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:50:31 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-fad6c1ec-d73c-4e35-82b0-f15331eecf43 tempest-AttachVolumeNegativeTest-2019172075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:50:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1667184180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e6bccb7-98f0-40e3-a7a3-53760138abbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e80e6c251404ba9b9947664ac5836f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:50:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:50:26Z,use_quota=True,user_id='047f7ffdca4c45cdb2cc83f5261484c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:50:31 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-fad6c1ec-d73c-4e35-82b0-f15331eecf43 tempest-AttachVolumeNegativeTest-2019172075 None] Creating volume 0e6bccb7-98f0-40e3-a7a3-53760138abbd {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:50:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-fad6c1ec-d73c-4e35-82b0-f15331eecf43 tempest-AttachVolumeNegativeTest-2019172075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:50:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-fad6c1ec-d73c-4e35-82b0-f15331eecf43 tempest-AttachVolumeNegativeTest-2019172075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:50:31 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-fad6c1ec-d73c-4e35-82b0-f15331eecf43 tempest-AttachVolumeNegativeTest-2019172075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:50:31 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-fad6c1ec-d73c-4e35-82b0-f15331eecf43 tempest-AttachVolumeNegativeTest-2019172075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:50:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-fad6c1ec-d73c-4e35-82b0-f15331eecf43 tempest-AttachVolumeNegativeTest-2019172075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:50:31 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-fad6c1ec-d73c-4e35-82b0-f15331eecf43 tempest-AttachVolumeNegativeTest-2019172075 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:50:31 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-fad6c1ec-d73c-4e35-82b0-f15331eecf43 tempest-AttachVolumeNegativeTest-2019172075 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:50:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-fad6c1ec-d73c-4e35-82b0-f15331eecf43 tempest-AttachVolumeNegativeTest-2019172075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-0e6bccb7-98f0-40e3-a7a3-53760138abbd 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:50:31 devstack sudo[100958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-0e6bccb7-98f0-40e3-a7a3-53760138abbd 1073741824 Sep 04 22:50:31 devstack sudo[100958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:50:31 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-4668563f-af4b-4846-8355-66976be549ec tempest-TestStampPattern-1034473821 None] Create snapshot completed successfully Sep 04 22:50:31 devstack sudo[100958]: pam_unix(sudo:session): session closed for user root Sep 04 22:50:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-fad6c1ec-d73c-4e35-82b0-f15331eecf43 tempest-AttachVolumeNegativeTest-2019172075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-0e6bccb7-98f0-40e3-a7a3-53760138abbd 1073741824" returned: 0 in 0.496s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:50:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-fad6c1ec-d73c-4e35-82b0-f15331eecf43 tempest-AttachVolumeNegativeTest-2019172075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-0e6bccb7-98f0-40e3-a7a3-53760138abbd {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:50:31 devstack sudo[100965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-0e6bccb7-98f0-40e3-a7a3-53760138abbd Sep 04 22:50:31 devstack sudo[100965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:50:32 devstack sudo[100965]: pam_unix(sudo:session): session closed for user root Sep 04 22:50:32 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-fad6c1ec-d73c-4e35-82b0-f15331eecf43 tempest-AttachVolumeNegativeTest-2019172075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-0e6bccb7-98f0-40e3-a7a3-53760138abbd" returned: 0 in 0.318s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:50:32 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-fad6c1ec-d73c-4e35-82b0-f15331eecf43 tempest-AttachVolumeNegativeTest-2019172075 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:50:32 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-fad6c1ec-d73c-4e35-82b0-f15331eecf43 tempest-AttachVolumeNegativeTest-2019172075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:50:32 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-fad6c1ec-d73c-4e35-82b0-f15331eecf43 tempest-AttachVolumeNegativeTest-2019172075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c40963de-e506-4694-982d-fae80874c55c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e6bccb7-98f0-40e3-a7a3-53760138abbd', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:50:32 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-fad6c1ec-d73c-4e35-82b0-f15331eecf43 tempest-AttachVolumeNegativeTest-2019172075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88959113-af67-49d6-8471-ef022d781c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:50:32 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-fad6c1ec-d73c-4e35-82b0-f15331eecf43 tempest-AttachVolumeNegativeTest-2019172075 None] Volume volume-0e6bccb7-98f0-40e3-a7a3-53760138abbd (0e6bccb7-98f0-40e3-a7a3-53760138abbd): created successfully Sep 04 22:50:32 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-fad6c1ec-d73c-4e35-82b0-f15331eecf43 tempest-AttachVolumeNegativeTest-2019172075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88959113-af67-49d6-8471-ef022d781c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:50:32 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-fad6c1ec-d73c-4e35-82b0-f15331eecf43 tempest-AttachVolumeNegativeTest-2019172075 None] Flow 'volume_create_manager' (ba2ee97a-ae6b-4300-bb5e-d443bd32b541) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:50:32 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-fad6c1ec-d73c-4e35-82b0-f15331eecf43 tempest-AttachVolumeNegativeTest-2019172075 None] Created volume successfully. Sep 04 22:50:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-d975d306-b4b3-422c-8713-78b09464ce79 req-93934302-3135-4c0c-b55d-e1fd13106996 tempest-AttachVolumeNegativeTest-2019172075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:50:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-d975d306-b4b3-422c-8713-78b09464ce79 req-93934302-3135-4c0c-b55d-e1fd13106996 tempest-AttachVolumeNegativeTest-2019172075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:50:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-d975d306-b4b3-422c-8713-78b09464ce79 req-93934302-3135-4c0c-b55d-e1fd13106996 tempest-AttachVolumeNegativeTest-2019172075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:50:33 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-d975d306-b4b3-422c-8713-78b09464ce79 req-93934302-3135-4c0c-b55d-e1fd13106996 tempest-AttachVolumeNegativeTest-2019172075 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4', 'name': 'volume-0e6bccb7-98f0-40e3-a7a3-53760138abbd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '88c37573-3a69-4f0a-9e9b-2172310c14c9', 'enforce_multipath': True} {{(pid=87576) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 22:50:33 devstack cinder-volume[87576]: INFO cinder.volume.manager [req-d975d306-b4b3-422c-8713-78b09464ce79 req-93934302-3135-4c0c-b55d-e1fd13106996 tempest-AttachVolumeNegativeTest-2019172075 None] attachment_update completed successfully. Sep 04 22:50:36 devstack cinder-volume[87576]: INFO cinder.volume.manager [req-11d42416-4adf-458f-9f6e-cb17e16eaffa req-a7dfacac-faed-4aef-bd92-0d78bf57c7b6 tempest-AttachVolumeNegativeTest-2019172075 None] Terminate volume connection completed successfully. Sep 04 22:50:36 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-11d42416-4adf-458f-9f6e-cb17e16eaffa req-a7dfacac-faed-4aef-bd92-0d78bf57c7b6 tempest-AttachVolumeNegativeTest-2019172075 None] Deleting attachment 88c37573-3a69-4f0a-9e9b-2172310c14c9. {{(pid=87576) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 22:50:39 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b02c024-adec-425d-9469-6ddbc5e64904 tempest-VolumesCloneNegativeTest-1554945316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:50:39 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-4b02c024-adec-425d-9469-6ddbc5e64904 tempest-VolumesCloneNegativeTest-1554945316 None] Flow 'volume_create_manager' (4efdea15-79b2-4284-a87f-e96b5a4ca8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:50:39 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-4b02c024-adec-425d-9469-6ddbc5e64904 tempest-VolumesCloneNegativeTest-1554945316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e14977e-df98-4f8c-8c10-fbe206eba71b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:50:39 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-4b02c024-adec-425d-9469-6ddbc5e64904 tempest-VolumesCloneNegativeTest-1554945316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e14977e-df98-4f8c-8c10-fbe206eba71b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:50:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-534909742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7420ff7-ad41-44f4-a989-a8a482eac9e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa04edb25e4243ddb221d8b1978f7235',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:50:39Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:50:39Z,use_quota=True,user_id='3ab073b479c347e6b64b5814d977dc47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:50:39 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-4b02c024-adec-425d-9469-6ddbc5e64904 tempest-VolumesCloneNegativeTest-1554945316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aaf85f8-2801-4eab-b9bf-c71c65a9aed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:50:39 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-4b02c024-adec-425d-9469-6ddbc5e64904 tempest-VolumesCloneNegativeTest-1554945316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aaf85f8-2801-4eab-b9bf-c71c65a9aed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:50:39 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-4b02c024-adec-425d-9469-6ddbc5e64904 tempest-VolumesCloneNegativeTest-1554945316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8e2c9af-09f8-4c1f-b8bc-93c25700a823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:50:39 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-4b02c024-adec-425d-9469-6ddbc5e64904 tempest-VolumesCloneNegativeTest-1554945316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8e2c9af-09f8-4c1f-b8bc-93c25700a823) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7420ff7-ad41-44f4-a989-a8a482eac9e3', 'volume_name': 'volume-a7420ff7-ad41-44f4-a989-a8a482eac9e3', 'volume_size': 2}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:50:39 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-4b02c024-adec-425d-9469-6ddbc5e64904 tempest-VolumesCloneNegativeTest-1554945316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7d7d429-920a-4f3f-9699-edaa81ab8db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:50:39 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-4b02c024-adec-425d-9469-6ddbc5e64904 tempest-VolumesCloneNegativeTest-1554945316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7d7d429-920a-4f3f-9699-edaa81ab8db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:50:39 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-4b02c024-adec-425d-9469-6ddbc5e64904 tempest-VolumesCloneNegativeTest-1554945316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c086a8bc-a32d-43af-8e5b-b01586fba67c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:50:39 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-4b02c024-adec-425d-9469-6ddbc5e64904 tempest-VolumesCloneNegativeTest-1554945316 None] Volume a7420ff7-ad41-44f4-a989-a8a482eac9e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7420ff7-ad41-44f4-a989-a8a482eac9e3', 'volume_size': 2} Sep 04 22:50:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-4b02c024-adec-425d-9469-6ddbc5e64904 tempest-VolumesCloneNegativeTest-1554945316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:50:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-4b02c024-adec-425d-9469-6ddbc5e64904 tempest-VolumesCloneNegativeTest-1554945316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:50:39 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-4b02c024-adec-425d-9469-6ddbc5e64904 tempest-VolumesCloneNegativeTest-1554945316 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:50:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-534909742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7420ff7-ad41-44f4-a989-a8a482eac9e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa04edb25e4243ddb221d8b1978f7235',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:50:39Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:50:39Z,use_quota=True,user_id='3ab073b479c347e6b64b5814d977dc47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:50:39 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-4b02c024-adec-425d-9469-6ddbc5e64904 tempest-VolumesCloneNegativeTest-1554945316 None] Creating volume a7420ff7-ad41-44f4-a989-a8a482eac9e3 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:50:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-4b02c024-adec-425d-9469-6ddbc5e64904 tempest-VolumesCloneNegativeTest-1554945316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:50:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-4b02c024-adec-425d-9469-6ddbc5e64904 tempest-VolumesCloneNegativeTest-1554945316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:50:39 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-4b02c024-adec-425d-9469-6ddbc5e64904 tempest-VolumesCloneNegativeTest-1554945316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:50:39 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-4b02c024-adec-425d-9469-6ddbc5e64904 tempest-VolumesCloneNegativeTest-1554945316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:50:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-4b02c024-adec-425d-9469-6ddbc5e64904 tempest-VolumesCloneNegativeTest-1554945316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:50:39 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-4b02c024-adec-425d-9469-6ddbc5e64904 tempest-VolumesCloneNegativeTest-1554945316 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:50:39 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-4b02c024-adec-425d-9469-6ddbc5e64904 tempest-VolumesCloneNegativeTest-1554945316 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:50:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4b02c024-adec-425d-9469-6ddbc5e64904 tempest-VolumesCloneNegativeTest-1554945316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-a7420ff7-ad41-44f4-a989-a8a482eac9e3 2147483648 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:50:39 devstack sudo[101482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-a7420ff7-ad41-44f4-a989-a8a482eac9e3 2147483648 Sep 04 22:50:39 devstack sudo[101482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:50:39 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-71e0b3ff-b868-4c6f-b401-967a2e042614 tempest-TestStampPattern-1034473821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:50:39 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-71e0b3ff-b868-4c6f-b401-967a2e042614 tempest-TestStampPattern-1034473821 None] Flow 'volume_create_manager' (33cf1fa2-8fce-44fd-8f02-f5e4bfe779da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:50:39 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-71e0b3ff-b868-4c6f-b401-967a2e042614 tempest-TestStampPattern-1034473821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8a0e6e6-7a78-4f87-ab30-e40448ffc4dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:50:39 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-71e0b3ff-b868-4c6f-b401-967a2e042614 tempest-TestStampPattern-1034473821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8a0e6e6-7a78-4f87-ab30-e40448ffc4dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:50:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-100885190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05c7519e-2464-4382-9ae8-a2eb99ef3db7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb437b5a70d243aca90c7b7b2488325c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:50:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=134381b4-62a3-4e8a-8a6f-bf9ff18c5f9c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:50:40Z,use_quota=True,user_id='f6db4786e04547bbb16cb877e40caf57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:50:39 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-71e0b3ff-b868-4c6f-b401-967a2e042614 tempest-TestStampPattern-1034473821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3048ca71-382d-41f8-a9ba-198fb9934e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:50:39 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-71e0b3ff-b868-4c6f-b401-967a2e042614 tempest-TestStampPattern-1034473821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3048ca71-382d-41f8-a9ba-198fb9934e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:50:39 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-71e0b3ff-b868-4c6f-b401-967a2e042614 tempest-TestStampPattern-1034473821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (765e83ce-a5da-4aa5-bd8c-581d6b58c937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:50:39 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-71e0b3ff-b868-4c6f-b401-967a2e042614 tempest-TestStampPattern-1034473821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (765e83ce-a5da-4aa5-bd8c-581d6b58c937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '05c7519e-2464-4382-9ae8-a2eb99ef3db7', 'volume_name': 'volume-05c7519e-2464-4382-9ae8-a2eb99ef3db7', 'volume_size': 1, 'snapshot_id': '134381b4-62a3-4e8a-8a6f-bf9ff18c5f9c'}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:50:39 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-71e0b3ff-b868-4c6f-b401-967a2e042614 tempest-TestStampPattern-1034473821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a811c0fc-2bc7-4d58-94bb-3dffe0f69e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:50:39 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-71e0b3ff-b868-4c6f-b401-967a2e042614 tempest-TestStampPattern-1034473821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a811c0fc-2bc7-4d58-94bb-3dffe0f69e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:50:39 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-71e0b3ff-b868-4c6f-b401-967a2e042614 tempest-TestStampPattern-1034473821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9efcd3c3-a524-4d69-a2f5-45340e367d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:50:39 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-71e0b3ff-b868-4c6f-b401-967a2e042614 tempest-TestStampPattern-1034473821 None] Volume 05c7519e-2464-4382-9ae8-a2eb99ef3db7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-05c7519e-2464-4382-9ae8-a2eb99ef3db7', 'volume_size': 1, 'snapshot_id': '134381b4-62a3-4e8a-8a6f-bf9ff18c5f9c'} Sep 04 22:50:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-71e0b3ff-b868-4c6f-b401-967a2e042614 tempest-TestStampPattern-1034473821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:50:40 devstack sudo[101482]: pam_unix(sudo:session): session closed for user root Sep 04 22:50:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4b02c024-adec-425d-9469-6ddbc5e64904 tempest-VolumesCloneNegativeTest-1554945316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-a7420ff7-ad41-44f4-a989-a8a482eac9e3 2147483648" returned: 0 in 0.667s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:50:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4b02c024-adec-425d-9469-6ddbc5e64904 tempest-VolumesCloneNegativeTest-1554945316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-a7420ff7-ad41-44f4-a989-a8a482eac9e3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:50:40 devstack sudo[101490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-a7420ff7-ad41-44f4-a989-a8a482eac9e3 Sep 04 22:50:40 devstack sudo[101490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:50:40 devstack sudo[101490]: pam_unix(sudo:session): session closed for user root Sep 04 22:50:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4b02c024-adec-425d-9469-6ddbc5e64904 tempest-VolumesCloneNegativeTest-1554945316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-a7420ff7-ad41-44f4-a989-a8a482eac9e3" returned: 0 in 0.329s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:50:40 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-4b02c024-adec-425d-9469-6ddbc5e64904 tempest-VolumesCloneNegativeTest-1554945316 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:50:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-4b02c024-adec-425d-9469-6ddbc5e64904 tempest-VolumesCloneNegativeTest-1554945316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:50:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-71e0b3ff-b868-4c6f-b401-967a2e042614 tempest-TestStampPattern-1034473821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.446s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:50:40 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-71e0b3ff-b868-4c6f-b401-967a2e042614 tempest-TestStampPattern-1034473821 None] Acquiring lock "cinder-quobyte-134381b4-62a3-4e8a-8a6f-bf9ff18c5f9c-05c7519e-2464-4382-9ae8-a2eb99ef3db7" by "_create_volume_from_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:50:40 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-4b02c024-adec-425d-9469-6ddbc5e64904 tempest-VolumesCloneNegativeTest-1554945316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c086a8bc-a32d-43af-8e5b-b01586fba67c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7420ff7-ad41-44f4-a989-a8a482eac9e3', 'volume_size': 2}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:50:40 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-4b02c024-adec-425d-9469-6ddbc5e64904 tempest-VolumesCloneNegativeTest-1554945316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3965fd78-6061-4d3d-8012-ab4df263ed3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:50:40 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-71e0b3ff-b868-4c6f-b401-967a2e042614 tempest-TestStampPattern-1034473821 None] Lock "cinder-quobyte-134381b4-62a3-4e8a-8a6f-bf9ff18c5f9c-05c7519e-2464-4382-9ae8-a2eb99ef3db7" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:50:40 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-71e0b3ff-b868-4c6f-b401-967a2e042614 tempest-TestStampPattern-1034473821 None] Creating volume 05c7519e-2464-4382-9ae8-a2eb99ef3db7 from snapshot 134381b4-62a3-4e8a-8a6f-bf9ff18c5f9c {{(pid=87576) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 04 22:50:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-71e0b3ff-b868-4c6f-b401-967a2e042614 tempest-TestStampPattern-1034473821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:50:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-71e0b3ff-b868-4c6f-b401-967a2e042614 tempest-TestStampPattern-1034473821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:50:40 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-71e0b3ff-b868-4c6f-b401-967a2e042614 tempest-TestStampPattern-1034473821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:50:40 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-71e0b3ff-b868-4c6f-b401-967a2e042614 tempest-TestStampPattern-1034473821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:50:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-71e0b3ff-b868-4c6f-b401-967a2e042614 tempest-TestStampPattern-1034473821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:50:40 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-71e0b3ff-b868-4c6f-b401-967a2e042614 tempest-TestStampPattern-1034473821 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:50:40 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-71e0b3ff-b868-4c6f-b401-967a2e042614 tempest-TestStampPattern-1034473821 None] Acquiring lock "cinder-quobyte-05c7519e-2464-4382-9ae8-a2eb99ef3db7" by "_copy_volume_from_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:50:40 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-4b02c024-adec-425d-9469-6ddbc5e64904 tempest-VolumesCloneNegativeTest-1554945316 None] Volume volume-a7420ff7-ad41-44f4-a989-a8a482eac9e3 (a7420ff7-ad41-44f4-a989-a8a482eac9e3): created successfully Sep 04 22:50:40 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-4b02c024-adec-425d-9469-6ddbc5e64904 tempest-VolumesCloneNegativeTest-1554945316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3965fd78-6061-4d3d-8012-ab4df263ed3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:50:40 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-4b02c024-adec-425d-9469-6ddbc5e64904 tempest-VolumesCloneNegativeTest-1554945316 None] Flow 'volume_create_manager' (4efdea15-79b2-4284-a87f-e96b5a4ca8c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:50:40 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-71e0b3ff-b868-4c6f-b401-967a2e042614 tempest-TestStampPattern-1034473821 None] Lock "cinder-quobyte-05c7519e-2464-4382-9ae8-a2eb99ef3db7" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:50:40 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-71e0b3ff-b868-4c6f-b401-967a2e042614 tempest-TestStampPattern-1034473821 None] snapshot: 134381b4-62a3-4e8a-8a6f-bf9ff18c5f9c, volume: 05c7519e-2464-4382-9ae8-a2eb99ef3db7, {{(pid=87576) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 04 22:50:40 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-4b02c024-adec-425d-9469-6ddbc5e64904 tempest-VolumesCloneNegativeTest-1554945316 None] Created volume successfully. Sep 04 22:50:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-71e0b3ff-b868-4c6f-b401-967a2e042614 tempest-TestStampPattern-1034473821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:50:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-71e0b3ff-b868-4c6f-b401-967a2e042614 tempest-TestStampPattern-1034473821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:50:40 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-71e0b3ff-b868-4c6f-b401-967a2e042614 tempest-TestStampPattern-1034473821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:50:40 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-71e0b3ff-b868-4c6f-b401-967a2e042614 tempest-TestStampPattern-1034473821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:50:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-71e0b3ff-b868-4c6f-b401-967a2e042614 tempest-TestStampPattern-1034473821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:50:40 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ee9880-93ce-4b26-ab9d-152830ab64ea]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:50:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-71e0b3ff-b868-4c6f-b401-967a2e042614 tempest-TestStampPattern-1034473821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-313d1bd3-92d3-4f1e-808c-876c31543218.134381b4-62a3-4e8a-8a6f-bf9ff18c5f9c {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:50:40 devstack sudo[101493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-313d1bd3-92d3-4f1e-808c-876c31543218.134381b4-62a3-4e8a-8a6f-bf9ff18c5f9c Sep 04 22:50:40 devstack sudo[101493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:50:41 devstack sudo[101493]: pam_unix(sudo:session): session closed for user root Sep 04 22:50:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-71e0b3ff-b868-4c6f-b401-967a2e042614 tempest-TestStampPattern-1034473821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-313d1bd3-92d3-4f1e-808c-876c31543218.134381b4-62a3-4e8a-8a6f-bf9ff18c5f9c" returned: 0 in 0.477s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:50:41 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-71e0b3ff-b868-4c6f-b401-967a2e042614 tempest-TestStampPattern-1034473821 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-313d1bd3-92d3-4f1e-808c-876c31543218(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 22:50:41 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[a396a1dc-4c30-4fa4-a848-e9dad5287151]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:50:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-71e0b3ff-b868-4c6f-b401-967a2e042614 tempest-TestStampPattern-1034473821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-313d1bd3-92d3-4f1e-808c-876c31543218 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:50:41 devstack sudo[101501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-313d1bd3-92d3-4f1e-808c-876c31543218 Sep 04 22:50:41 devstack sudo[101501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:50:41 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-32e01778-d13b-4851-9173-2f66666e7e02 tempest-VolumesCloneNegativeTest-1554945316 None] Acquiring lock "cinder-a7420ff7-ad41-44f4-a989-a8a482eac9e3-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:50:41 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-32e01778-d13b-4851-9173-2f66666e7e02 tempest-VolumesCloneNegativeTest-1554945316 None] Lock "cinder-a7420ff7-ad41-44f4-a989-a8a482eac9e3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:50:41 devstack sudo[101501]: pam_unix(sudo:session): session closed for user root Sep 04 22:50:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-71e0b3ff-b868-4c6f-b401-967a2e042614 tempest-TestStampPattern-1034473821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-313d1bd3-92d3-4f1e-808c-876c31543218" returned: 0 in 0.526s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:50:41 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-71e0b3ff-b868-4c6f-b401-967a2e042614 tempest-TestStampPattern-1034473821 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-313d1bd3-92d3-4f1e-808c-876c31543218 {{(pid=87576) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 04 22:50:41 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-71e0b3ff-b868-4c6f-b401-967a2e042614 tempest-TestStampPattern-1034473821 None] Creating direct copy from snapshot {{(pid=87576) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 04 22:50:41 devstack cinder-volume[87576]: DEBUG cinder.utils [None req-71e0b3ff-b868-4c6f-b401-967a2e042614 tempest-TestStampPattern-1034473821 None] Path /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-05c7519e-2464-4382-9ae8-a2eb99ef3db7 not found in is_blk_device check {{(pid=87576) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 04 22:50:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-71e0b3ff-b868-4c6f-b401-967a2e042614 tempest-TestStampPattern-1034473821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-313d1bd3-92d3-4f1e-808c-876c31543218 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-05c7519e-2464-4382-9ae8-a2eb99ef3db7 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:50:41 devstack sudo[101506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-313d1bd3-92d3-4f1e-808c-876c31543218 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-05c7519e-2464-4382-9ae8-a2eb99ef3db7 Sep 04 22:50:41 devstack sudo[101506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:50:41 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-32e01778-d13b-4851-9173-2f66666e7e02 tempest-VolumesCloneNegativeTest-1554945316 None] Acquiring lock "cinder-quobyte-a7420ff7-ad41-44f4-a989-a8a482eac9e3" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:50:41 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-32e01778-d13b-4851-9173-2f66666e7e02 tempest-VolumesCloneNegativeTest-1554945316 None] Lock "cinder-quobyte-a7420ff7-ad41-44f4-a989-a8a482eac9e3" acquired by "delete_volume" :: waited 0.037s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:50:41 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb8162f-b5b7-44f3-9b28-6c714ea17f65]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:50:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-32e01778-d13b-4851-9173-2f66666e7e02 tempest-VolumesCloneNegativeTest-1554945316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-a7420ff7-ad41-44f4-a989-a8a482eac9e3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:50:41 devstack sudo[101508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-a7420ff7-ad41-44f4-a989-a8a482eac9e3 Sep 04 22:50:41 devstack sudo[101508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:50:42 devstack sudo[101508]: pam_unix(sudo:session): session closed for user root Sep 04 22:50:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-32e01778-d13b-4851-9173-2f66666e7e02 tempest-VolumesCloneNegativeTest-1554945316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-a7420ff7-ad41-44f4-a989-a8a482eac9e3" returned: 0 in 0.531s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:50:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-32e01778-d13b-4851-9173-2f66666e7e02 tempest-VolumesCloneNegativeTest-1554945316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-a7420ff7-ad41-44f4-a989-a8a482eac9e3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:50:42 devstack sudo[101520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-a7420ff7-ad41-44f4-a989-a8a482eac9e3 Sep 04 22:50:42 devstack sudo[101520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:50:42 devstack sudo[101520]: pam_unix(sudo:session): session closed for user root Sep 04 22:50:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-32e01778-d13b-4851-9173-2f66666e7e02 tempest-VolumesCloneNegativeTest-1554945316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-a7420ff7-ad41-44f4-a989-a8a482eac9e3" returned: 0 in 0.722s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:50:43 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-32e01778-d13b-4851-9173-2f66666e7e02 tempest-VolumesCloneNegativeTest-1554945316 None] Lock "cinder-quobyte-a7420ff7-ad41-44f4-a989-a8a482eac9e3" released by "delete_volume" :: held 1.357s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:50:43 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-32e01778-d13b-4851-9173-2f66666e7e02 tempest-VolumesCloneNegativeTest-1554945316 None] Created reservations ['22a65d32-f09b-40d0-89ce-6218edd71149', '20c8063f-0ca2-4094-8a38-ed440e8b747d', '9331d990-e0d0-44b2-a6e8-0011053ec5a4', '83f6872e-a35a-4838-94b5-f59578fcb9a1'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:50:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-32e01778-d13b-4851-9173-2f66666e7e02 tempest-VolumesCloneNegativeTest-1554945316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:50:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-32e01778-d13b-4851-9173-2f66666e7e02 tempest-VolumesCloneNegativeTest-1554945316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:50:43 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-32e01778-d13b-4851-9173-2f66666e7e02 tempest-VolumesCloneNegativeTest-1554945316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:50:43 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-32e01778-d13b-4851-9173-2f66666e7e02 tempest-VolumesCloneNegativeTest-1554945316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:50:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-32e01778-d13b-4851-9173-2f66666e7e02 tempest-VolumesCloneNegativeTest-1554945316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:50:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-32e01778-d13b-4851-9173-2f66666e7e02 tempest-VolumesCloneNegativeTest-1554945316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:50:43 devstack sudo[101528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:50:43 devstack sudo[101528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:50:44 devstack sudo[101528]: pam_unix(sudo:session): session closed for user root Sep 04 22:50:44 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-32e01778-d13b-4851-9173-2f66666e7e02 tempest-VolumesCloneNegativeTest-1554945316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.570s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:50:44 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-32e01778-d13b-4851-9173-2f66666e7e02 tempest-VolumesCloneNegativeTest-1554945316 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:50:44 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-32e01778-d13b-4851-9173-2f66666e7e02 tempest-VolumesCloneNegativeTest-1554945316 None] Deleted volume successfully. Sep 04 22:50:44 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-32e01778-d13b-4851-9173-2f66666e7e02 tempest-VolumesCloneNegativeTest-1554945316 None] Lock "cinder-a7420ff7-ad41-44f4-a989-a8a482eac9e3-delete_volume" released by "delete_volume" :: held 2.577s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:50:48 devstack sudo[101506]: pam_unix(sudo:session): session closed for user root Sep 04 22:50:48 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-71e0b3ff-b868-4c6f-b401-967a2e042614 tempest-TestStampPattern-1034473821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-313d1bd3-92d3-4f1e-808c-876c31543218 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-05c7519e-2464-4382-9ae8-a2eb99ef3db7" returned: 0 in 6.769s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:50:48 devstack cinder-volume[87576]: DEBUG cinder.image.image_utils [None req-71e0b3ff-b868-4c6f-b401-967a2e042614 tempest-TestStampPattern-1034473821 None] Image conversion details: src /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-313d1bd3-92d3-4f1e-808c-876c31543218, size 1024.00 MB, duration 6.77 sec, destination /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-05c7519e-2464-4382-9ae8-a2eb99ef3db7 {{(pid=87576) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 22:50:48 devstack cinder-volume[87576]: INFO cinder.image.image_utils [None req-71e0b3ff-b868-4c6f-b401-967a2e042614 tempest-TestStampPattern-1034473821 None] Converted 1024.00 MB image at 151.26 MB/s Sep 04 22:50:48 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-71e0b3ff-b868-4c6f-b401-967a2e042614 tempest-TestStampPattern-1034473821 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-05c7519e-2464-4382-9ae8-a2eb99ef3db7 is being set with open permissions: ugo+rw Sep 04 22:50:48 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-71e0b3ff-b868-4c6f-b401-967a2e042614 tempest-TestStampPattern-1034473821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-05c7519e-2464-4382-9ae8-a2eb99ef3db7 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:50:48 devstack sudo[101550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-05c7519e-2464-4382-9ae8-a2eb99ef3db7 Sep 04 22:50:48 devstack sudo[101550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:50:48 devstack sudo[101550]: pam_unix(sudo:session): session closed for user root Sep 04 22:50:48 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-71e0b3ff-b868-4c6f-b401-967a2e042614 tempest-TestStampPattern-1034473821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-05c7519e-2464-4382-9ae8-a2eb99ef3db7" returned: 0 in 0.331s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:50:48 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-71e0b3ff-b868-4c6f-b401-967a2e042614 tempest-TestStampPattern-1034473821 None] Lock "cinder-quobyte-05c7519e-2464-4382-9ae8-a2eb99ef3db7" released by "_copy_volume_from_snapshot" :: held 8.231s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:50:48 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-71e0b3ff-b868-4c6f-b401-967a2e042614 tempest-TestStampPattern-1034473821 None] Lock "cinder-quobyte-134381b4-62a3-4e8a-8a6f-bf9ff18c5f9c-05c7519e-2464-4382-9ae8-a2eb99ef3db7" released by "_create_volume_from_snapshot" :: held 8.339s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:50:48 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-71e0b3ff-b868-4c6f-b401-967a2e042614 tempest-TestStampPattern-1034473821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.378s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:50:48 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-71e0b3ff-b868-4c6f-b401-967a2e042614 tempest-TestStampPattern-1034473821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9efcd3c3-a524-4d69-a2f5-45340e367d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05c7519e-2464-4382-9ae8-a2eb99ef3db7', 'volume_size': 1, 'snapshot_id': '134381b4-62a3-4e8a-8a6f-bf9ff18c5f9c'}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:50:48 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-71e0b3ff-b868-4c6f-b401-967a2e042614 tempest-TestStampPattern-1034473821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98cec586-46b2-4455-bffb-9978daeed7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:50:48 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-71e0b3ff-b868-4c6f-b401-967a2e042614 tempest-TestStampPattern-1034473821 None] Volume volume-05c7519e-2464-4382-9ae8-a2eb99ef3db7 (05c7519e-2464-4382-9ae8-a2eb99ef3db7): created successfully Sep 04 22:50:48 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-71e0b3ff-b868-4c6f-b401-967a2e042614 tempest-TestStampPattern-1034473821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98cec586-46b2-4455-bffb-9978daeed7cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:50:48 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-71e0b3ff-b868-4c6f-b401-967a2e042614 tempest-TestStampPattern-1034473821 None] Flow 'volume_create_manager' (33cf1fa2-8fce-44fd-8f02-f5e4bfe779da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:50:48 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-71e0b3ff-b868-4c6f-b401-967a2e042614 tempest-TestStampPattern-1034473821 None] Created volume successfully. Sep 04 22:50:58 devstack cinder-volume[87576]: DEBUG dbcounter [-] [87576] Writing DB stats cinder:SELECT=39,cinder:UPDATE=27,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 22:50:58 devstack cinder-volume[87576]: DEBUG dbcounter [-] [87576] Writing DB stats cinder:SELECT=38,cinder:UPDATE=34,cinder:INSERT=6,cinder:DELETE=5 {{(pid=87576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 22:51:09 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-933cbd50-bbe2-47cf-b7ce-20888d4fd3e9 tempest-VolumesSnapshotTestJSON-976727453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:51:09 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-933cbd50-bbe2-47cf-b7ce-20888d4fd3e9 tempest-VolumesSnapshotTestJSON-976727453 None] Flow 'volume_create_manager' (3f8648c9-4fde-4732-b994-0bfb1e4e3c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:51:09 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-933cbd50-bbe2-47cf-b7ce-20888d4fd3e9 tempest-VolumesSnapshotTestJSON-976727453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9f853c9-4cab-420f-9e09-828291cce09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:51:09 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-933cbd50-bbe2-47cf-b7ce-20888d4fd3e9 tempest-VolumesSnapshotTestJSON-976727453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9f853c9-4cab-420f-9e09-828291cce09b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:51:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-594515811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46a0ac7ea3b5483892ddadcd1eb1e727',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:51:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:51:10Z,use_quota=True,user_id='99ba67d6476c41c99b05a54ec37b2823',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:51:09 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-933cbd50-bbe2-47cf-b7ce-20888d4fd3e9 tempest-VolumesSnapshotTestJSON-976727453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11806f6d-16dc-461b-b194-d22ea86a2235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:51:09 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-933cbd50-bbe2-47cf-b7ce-20888d4fd3e9 tempest-VolumesSnapshotTestJSON-976727453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11806f6d-16dc-461b-b194-d22ea86a2235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:51:09 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-933cbd50-bbe2-47cf-b7ce-20888d4fd3e9 tempest-VolumesSnapshotTestJSON-976727453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54b5a6fc-422b-43ed-be63-fe8ef325d360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:51:09 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-933cbd50-bbe2-47cf-b7ce-20888d4fd3e9 tempest-VolumesSnapshotTestJSON-976727453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54b5a6fc-422b-43ed-be63-fe8ef325d360) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7', 'volume_name': 'volume-bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:51:09 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-933cbd50-bbe2-47cf-b7ce-20888d4fd3e9 tempest-VolumesSnapshotTestJSON-976727453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3b793bc-754d-4b67-9f57-76caf6b5373d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:51:09 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-933cbd50-bbe2-47cf-b7ce-20888d4fd3e9 tempest-VolumesSnapshotTestJSON-976727453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3b793bc-754d-4b67-9f57-76caf6b5373d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:51:09 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-933cbd50-bbe2-47cf-b7ce-20888d4fd3e9 tempest-VolumesSnapshotTestJSON-976727453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e68abd76-f166-4ad8-8f39-deb2690867f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:51:09 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-933cbd50-bbe2-47cf-b7ce-20888d4fd3e9 tempest-VolumesSnapshotTestJSON-976727453 None] Volume bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7', 'volume_size': 1} Sep 04 22:51:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-933cbd50-bbe2-47cf-b7ce-20888d4fd3e9 tempest-VolumesSnapshotTestJSON-976727453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:51:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-933cbd50-bbe2-47cf-b7ce-20888d4fd3e9 tempest-VolumesSnapshotTestJSON-976727453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:51:09 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-933cbd50-bbe2-47cf-b7ce-20888d4fd3e9 tempest-VolumesSnapshotTestJSON-976727453 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:51:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-594515811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46a0ac7ea3b5483892ddadcd1eb1e727',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:51:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:51:10Z,use_quota=True,user_id='99ba67d6476c41c99b05a54ec37b2823',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:51:09 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-933cbd50-bbe2-47cf-b7ce-20888d4fd3e9 tempest-VolumesSnapshotTestJSON-976727453 None] Creating volume bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:51:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-933cbd50-bbe2-47cf-b7ce-20888d4fd3e9 tempest-VolumesSnapshotTestJSON-976727453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:51:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-933cbd50-bbe2-47cf-b7ce-20888d4fd3e9 tempest-VolumesSnapshotTestJSON-976727453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:51:09 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-933cbd50-bbe2-47cf-b7ce-20888d4fd3e9 tempest-VolumesSnapshotTestJSON-976727453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:51:09 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-933cbd50-bbe2-47cf-b7ce-20888d4fd3e9 tempest-VolumesSnapshotTestJSON-976727453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:51:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-933cbd50-bbe2-47cf-b7ce-20888d4fd3e9 tempest-VolumesSnapshotTestJSON-976727453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:51:09 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-933cbd50-bbe2-47cf-b7ce-20888d4fd3e9 tempest-VolumesSnapshotTestJSON-976727453 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:51:09 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-933cbd50-bbe2-47cf-b7ce-20888d4fd3e9 tempest-VolumesSnapshotTestJSON-976727453 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:51:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-933cbd50-bbe2-47cf-b7ce-20888d4fd3e9 tempest-VolumesSnapshotTestJSON-976727453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:09 devstack sudo[101735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7 1073741824 Sep 04 22:51:09 devstack sudo[101735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:10 devstack sudo[101735]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-933cbd50-bbe2-47cf-b7ce-20888d4fd3e9 tempest-VolumesSnapshotTestJSON-976727453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7 1073741824" returned: 0 in 0.444s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-933cbd50-bbe2-47cf-b7ce-20888d4fd3e9 tempest-VolumesSnapshotTestJSON-976727453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:10 devstack sudo[101740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7 Sep 04 22:51:10 devstack sudo[101740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:10 devstack sudo[101740]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-933cbd50-bbe2-47cf-b7ce-20888d4fd3e9 tempest-VolumesSnapshotTestJSON-976727453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7" returned: 0 in 0.244s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:10 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-933cbd50-bbe2-47cf-b7ce-20888d4fd3e9 tempest-VolumesSnapshotTestJSON-976727453 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:51:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-933cbd50-bbe2-47cf-b7ce-20888d4fd3e9 tempest-VolumesSnapshotTestJSON-976727453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:51:10 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-933cbd50-bbe2-47cf-b7ce-20888d4fd3e9 tempest-VolumesSnapshotTestJSON-976727453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e68abd76-f166-4ad8-8f39-deb2690867f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:51:10 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-933cbd50-bbe2-47cf-b7ce-20888d4fd3e9 tempest-VolumesSnapshotTestJSON-976727453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (035b38bd-bd11-4d0c-b589-aac72f054340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:51:10 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-933cbd50-bbe2-47cf-b7ce-20888d4fd3e9 tempest-VolumesSnapshotTestJSON-976727453 None] Volume volume-bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7 (bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7): created successfully Sep 04 22:51:10 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-933cbd50-bbe2-47cf-b7ce-20888d4fd3e9 tempest-VolumesSnapshotTestJSON-976727453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (035b38bd-bd11-4d0c-b589-aac72f054340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:51:10 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-933cbd50-bbe2-47cf-b7ce-20888d4fd3e9 tempest-VolumesSnapshotTestJSON-976727453 None] Flow 'volume_create_manager' (3f8648c9-4fde-4732-b994-0bfb1e4e3c6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:51:10 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-933cbd50-bbe2-47cf-b7ce-20888d4fd3e9 tempest-VolumesSnapshotTestJSON-976727453 None] Created volume successfully. Sep 04 22:51:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f0023a11-a671-4c2a-97f9-d17707954007 tempest-VolumesSnapshotTestJSON-976727453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:51:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f0023a11-a671-4c2a-97f9-d17707954007 tempest-VolumesSnapshotTestJSON-976727453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:51:10 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-f0023a11-a671-4c2a-97f9-d17707954007 tempest-VolumesSnapshotTestJSON-976727453 None] Creating offline snapshot bf3f22cf-82d9-4821-9533-3259feff754e of volume bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7 {{(pid=87576) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 22:51:10 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b3287e-1e95-4e9a-b424-be73a44a5e7c]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:51:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f0023a11-a671-4c2a-97f9-d17707954007 tempest-VolumesSnapshotTestJSON-976727453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:11 devstack sudo[101743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7 Sep 04 22:51:11 devstack sudo[101743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:11 devstack sudo[101743]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f0023a11-a671-4c2a-97f9-d17707954007 tempest-VolumesSnapshotTestJSON-976727453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7" returned: 0 in 0.365s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f0023a11-a671-4c2a-97f9-d17707954007 tempest-VolumesSnapshotTestJSON-976727453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7.bf3f22cf-82d9-4821-9533-3259feff754e 1G {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:11 devstack sudo[101748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7.bf3f22cf-82d9-4821-9533-3259feff754e 1G Sep 04 22:51:11 devstack sudo[101748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:11 devstack sudo[101748]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f0023a11-a671-4c2a-97f9-d17707954007 tempest-VolumesSnapshotTestJSON-976727453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7.bf3f22cf-82d9-4821-9533-3259feff754e 1G" returned: 0 in 0.421s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f0023a11-a671-4c2a-97f9-d17707954007 tempest-VolumesSnapshotTestJSON-976727453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7.bf3f22cf-82d9-4821-9533-3259feff754e {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:11 devstack sudo[101753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7.bf3f22cf-82d9-4821-9533-3259feff754e Sep 04 22:51:11 devstack sudo[101753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:11 devstack cinder-volume[87576]: DEBUG oslo_service.periodic_task [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87576) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 22:51:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:51:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:51:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:51:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:51:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:51:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:11 devstack sudo[101755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:51:11 devstack sudo[101755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:12 devstack sudo[101753]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f0023a11-a671-4c2a-97f9-d17707954007 tempest-VolumesSnapshotTestJSON-976727453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7.bf3f22cf-82d9-4821-9533-3259feff754e" returned: 0 in 0.328s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:12 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-f0023a11-a671-4c2a-97f9-d17707954007 tempest-VolumesSnapshotTestJSON-976727453 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7.bf3f22cf-82d9-4821-9533-3259feff754e is being set with open permissions: ugo+rw Sep 04 22:51:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f0023a11-a671-4c2a-97f9-d17707954007 tempest-VolumesSnapshotTestJSON-976727453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7.bf3f22cf-82d9-4821-9533-3259feff754e {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:12 devstack sudo[101755]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.265s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:12 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:51:12 devstack cinder-volume[87576]: DEBUG oslo_service.periodic_task [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Running periodic task VolumeManager._thread_info {{(pid=87576) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 22:51:12 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] thread count: 28 {{(pid=87576) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 22:51:12 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] thread info: [<_MainThread(MainThread, started 125730416963712)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87576) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 22:51:12 devstack sudo[101762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7.bf3f22cf-82d9-4821-9533-3259feff754e Sep 04 22:51:12 devstack sudo[101762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:12 devstack sudo[101762]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f0023a11-a671-4c2a-97f9-d17707954007 tempest-VolumesSnapshotTestJSON-976727453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7.bf3f22cf-82d9-4821-9533-3259feff754e" returned: 0 in 0.272s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f0023a11-a671-4c2a-97f9-d17707954007 tempest-VolumesSnapshotTestJSON-976727453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:12 devstack sudo[101765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7.info Sep 04 22:51:12 devstack sudo[101765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:12 devstack sudo[101765]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f0023a11-a671-4c2a-97f9-d17707954007 tempest-VolumesSnapshotTestJSON-976727453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7.info" returned: 0 in 0.251s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:12 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-f0023a11-a671-4c2a-97f9-d17707954007 tempest-VolumesSnapshotTestJSON-976727453 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7.info is being set with open permissions: ugo+rw Sep 04 22:51:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f0023a11-a671-4c2a-97f9-d17707954007 tempest-VolumesSnapshotTestJSON-976727453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:12 devstack sudo[101768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7.info Sep 04 22:51:12 devstack sudo[101768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:12 devstack sudo[101768]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f0023a11-a671-4c2a-97f9-d17707954007 tempest-VolumesSnapshotTestJSON-976727453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7.info" returned: 0 in 0.274s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f0023a11-a671-4c2a-97f9-d17707954007 tempest-VolumesSnapshotTestJSON-976727453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.003s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:51:13 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-f0023a11-a671-4c2a-97f9-d17707954007 tempest-VolumesSnapshotTestJSON-976727453 None] Create snapshot completed successfully Sep 04 22:51:14 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f4791f4f-30c1-48be-a4cf-570e0b432d18 tempest-VolumesSnapshotTestJSON-976727453 None] Acquiring lock "cinder-bf3f22cf-82d9-4821-9533-3259feff754e-delete_snapshot" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:51:14 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f4791f4f-30c1-48be-a4cf-570e0b432d18 tempest-VolumesSnapshotTestJSON-976727453 None] Lock "cinder-bf3f22cf-82d9-4821-9533-3259feff754e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:51:14 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f4791f4f-30c1-48be-a4cf-570e0b432d18 tempest-VolumesSnapshotTestJSON-976727453 None] Acquiring lock "cinder-quobyte-bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:51:14 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f4791f4f-30c1-48be-a4cf-570e0b432d18 tempest-VolumesSnapshotTestJSON-976727453 None] Lock "cinder-quobyte-bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:51:14 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f4791f4f-30c1-48be-a4cf-570e0b432d18 tempest-VolumesSnapshotTestJSON-976727453 None] Acquiring lock "cinder-quobyte-bf3f22cf-82d9-4821-9533-3259feff754e" by "_delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:51:14 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f4791f4f-30c1-48be-a4cf-570e0b432d18 tempest-VolumesSnapshotTestJSON-976727453 None] Lock "cinder-quobyte-bf3f22cf-82d9-4821-9533-3259feff754e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:51:14 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-f4791f4f-30c1-48be-a4cf-570e0b432d18 tempest-VolumesSnapshotTestJSON-976727453 None] Deleting offline snapshot bf3f22cf-82d9-4821-9533-3259feff754e of volume bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7 {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 22:51:14 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-f4791f4f-30c1-48be-a4cf-570e0b432d18 tempest-VolumesSnapshotTestJSON-976727453 None] snapshot_file for this snap is: volume-bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7.bf3f22cf-82d9-4821-9533-3259feff754e {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 22:51:14 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f762ae9-6c95-4e3a-8675-041eec69ced5]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:51:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f4791f4f-30c1-48be-a4cf-570e0b432d18 tempest-VolumesSnapshotTestJSON-976727453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7.bf3f22cf-82d9-4821-9533-3259feff754e {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:14 devstack sudo[101789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7.bf3f22cf-82d9-4821-9533-3259feff754e Sep 04 22:51:14 devstack sudo[101789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:14 devstack sudo[101789]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f4791f4f-30c1-48be-a4cf-570e0b432d18 tempest-VolumesSnapshotTestJSON-976727453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7.bf3f22cf-82d9-4821-9533-3259feff754e" returned: 0 in 0.394s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:14 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-f4791f4f-30c1-48be-a4cf-570e0b432d18 tempest-VolumesSnapshotTestJSON-976727453 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 22:51:14 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[67233ea4-1d12-4737-bbb3-021781f9276a]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:51:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f4791f4f-30c1-48be-a4cf-570e0b432d18 tempest-VolumesSnapshotTestJSON-976727453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:14 devstack sudo[101794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7 Sep 04 22:51:14 devstack sudo[101794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:15 devstack sudo[101794]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f4791f4f-30c1-48be-a4cf-570e0b432d18 tempest-VolumesSnapshotTestJSON-976727453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7" returned: 0 in 0.353s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f4791f4f-30c1-48be-a4cf-570e0b432d18 tempest-VolumesSnapshotTestJSON-976727453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7.bf3f22cf-82d9-4821-9533-3259feff754e {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:15 devstack sudo[101799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7.bf3f22cf-82d9-4821-9533-3259feff754e Sep 04 22:51:15 devstack sudo[101799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:15 devstack sudo[101799]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f4791f4f-30c1-48be-a4cf-570e0b432d18 tempest-VolumesSnapshotTestJSON-976727453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7.bf3f22cf-82d9-4821-9533-3259feff754e" returned: 0 in 0.314s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f4791f4f-30c1-48be-a4cf-570e0b432d18 tempest-VolumesSnapshotTestJSON-976727453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7.bf3f22cf-82d9-4821-9533-3259feff754e {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:15 devstack sudo[101805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7.bf3f22cf-82d9-4821-9533-3259feff754e Sep 04 22:51:15 devstack sudo[101805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:15 devstack sudo[101805]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f4791f4f-30c1-48be-a4cf-570e0b432d18 tempest-VolumesSnapshotTestJSON-976727453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7.bf3f22cf-82d9-4821-9533-3259feff754e" returned: 0 in 0.234s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:15 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f4791f4f-30c1-48be-a4cf-570e0b432d18 tempest-VolumesSnapshotTestJSON-976727453 None] Lock "cinder-quobyte-bf3f22cf-82d9-4821-9533-3259feff754e" released by "_delete_snapshot" :: held 1.404s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:51:15 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f4791f4f-30c1-48be-a4cf-570e0b432d18 tempest-VolumesSnapshotTestJSON-976727453 None] Lock "cinder-quobyte-bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7" released by "delete_snapshot" :: held 1.427s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:51:15 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-f4791f4f-30c1-48be-a4cf-570e0b432d18 tempest-VolumesSnapshotTestJSON-976727453 None] Created reservations ['b0a41d6d-c25f-4655-acd0-18b11f2831a0', 'd790efbb-e7a4-4383-bd7c-84c80f9c0a65', 'e7003a28-464b-432e-a3e2-8815f9a13e7b', '0c2bfb6c-1dc6-4867-a083-2e1378b21372'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:51:16 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-f4791f4f-30c1-48be-a4cf-570e0b432d18 tempest-VolumesSnapshotTestJSON-976727453 None] Delete snapshot completed successfully. Sep 04 22:51:16 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f4791f4f-30c1-48be-a4cf-570e0b432d18 tempest-VolumesSnapshotTestJSON-976727453 None] Lock "cinder-bf3f22cf-82d9-4821-9533-3259feff754e-delete_snapshot" released by "delete_snapshot" :: held 1.748s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:51:16 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-97d47905-2d38-474d-9138-06051168f3e5 tempest-VolumesSnapshotTestJSON-976727453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:51:16 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-97d47905-2d38-474d-9138-06051168f3e5 tempest-VolumesSnapshotTestJSON-976727453 None] Flow 'volume_create_manager' (3054dd91-a8ce-4b58-8485-e8fa8a5114e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:51:16 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-97d47905-2d38-474d-9138-06051168f3e5 tempest-VolumesSnapshotTestJSON-976727453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb8c986b-3013-48d4-9055-511a1ba6c7dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:51:16 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-97d47905-2d38-474d-9138-06051168f3e5 tempest-VolumesSnapshotTestJSON-976727453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb8c986b-3013-48d4-9055-511a1ba6c7dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:51:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1883314435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d284f67c-3754-4d74-a7b0-d9c07a50a170,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46a0ac7ea3b5483892ddadcd1eb1e727',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:51:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:51:17Z,use_quota=True,user_id='99ba67d6476c41c99b05a54ec37b2823',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:51:16 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-97d47905-2d38-474d-9138-06051168f3e5 tempest-VolumesSnapshotTestJSON-976727453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceb894e1-c68e-4b70-bbae-111d143d7799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:51:16 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-97d47905-2d38-474d-9138-06051168f3e5 tempest-VolumesSnapshotTestJSON-976727453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceb894e1-c68e-4b70-bbae-111d143d7799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:51:16 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-97d47905-2d38-474d-9138-06051168f3e5 tempest-VolumesSnapshotTestJSON-976727453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d02e115d-4ab2-450d-985b-bc1a49d6d9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:51:16 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-97d47905-2d38-474d-9138-06051168f3e5 tempest-VolumesSnapshotTestJSON-976727453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d02e115d-4ab2-450d-985b-bc1a49d6d9f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd284f67c-3754-4d74-a7b0-d9c07a50a170', 'volume_name': 'volume-d284f67c-3754-4d74-a7b0-d9c07a50a170', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:51:17 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-97d47905-2d38-474d-9138-06051168f3e5 tempest-VolumesSnapshotTestJSON-976727453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dac731a-7b7e-4218-92fb-0759659a4cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:51:17 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-97d47905-2d38-474d-9138-06051168f3e5 tempest-VolumesSnapshotTestJSON-976727453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dac731a-7b7e-4218-92fb-0759659a4cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:51:17 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-97d47905-2d38-474d-9138-06051168f3e5 tempest-VolumesSnapshotTestJSON-976727453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdcb1807-9abe-496b-9b6e-a5235ac0c083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:51:17 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-97d47905-2d38-474d-9138-06051168f3e5 tempest-VolumesSnapshotTestJSON-976727453 None] Volume d284f67c-3754-4d74-a7b0-d9c07a50a170: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d284f67c-3754-4d74-a7b0-d9c07a50a170', 'volume_size': 1} Sep 04 22:51:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-97d47905-2d38-474d-9138-06051168f3e5 tempest-VolumesSnapshotTestJSON-976727453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:51:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-97d47905-2d38-474d-9138-06051168f3e5 tempest-VolumesSnapshotTestJSON-976727453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:51:17 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-97d47905-2d38-474d-9138-06051168f3e5 tempest-VolumesSnapshotTestJSON-976727453 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:51:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1883314435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d284f67c-3754-4d74-a7b0-d9c07a50a170,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46a0ac7ea3b5483892ddadcd1eb1e727',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:51:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:51:17Z,use_quota=True,user_id='99ba67d6476c41c99b05a54ec37b2823',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:51:17 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-97d47905-2d38-474d-9138-06051168f3e5 tempest-VolumesSnapshotTestJSON-976727453 None] Creating volume d284f67c-3754-4d74-a7b0-d9c07a50a170 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:51:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-97d47905-2d38-474d-9138-06051168f3e5 tempest-VolumesSnapshotTestJSON-976727453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:51:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-97d47905-2d38-474d-9138-06051168f3e5 tempest-VolumesSnapshotTestJSON-976727453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:51:17 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-97d47905-2d38-474d-9138-06051168f3e5 tempest-VolumesSnapshotTestJSON-976727453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:51:17 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-97d47905-2d38-474d-9138-06051168f3e5 tempest-VolumesSnapshotTestJSON-976727453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:51:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-97d47905-2d38-474d-9138-06051168f3e5 tempest-VolumesSnapshotTestJSON-976727453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:51:17 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-97d47905-2d38-474d-9138-06051168f3e5 tempest-VolumesSnapshotTestJSON-976727453 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:51:17 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-97d47905-2d38-474d-9138-06051168f3e5 tempest-VolumesSnapshotTestJSON-976727453 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:51:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-97d47905-2d38-474d-9138-06051168f3e5 tempest-VolumesSnapshotTestJSON-976727453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d284f67c-3754-4d74-a7b0-d9c07a50a170 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:17 devstack sudo[101808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d284f67c-3754-4d74-a7b0-d9c07a50a170 1073741824 Sep 04 22:51:17 devstack sudo[101808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:17 devstack sudo[101808]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-97d47905-2d38-474d-9138-06051168f3e5 tempest-VolumesSnapshotTestJSON-976727453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d284f67c-3754-4d74-a7b0-d9c07a50a170 1073741824" returned: 0 in 0.462s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-97d47905-2d38-474d-9138-06051168f3e5 tempest-VolumesSnapshotTestJSON-976727453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d284f67c-3754-4d74-a7b0-d9c07a50a170 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:17 devstack sudo[101814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d284f67c-3754-4d74-a7b0-d9c07a50a170 Sep 04 22:51:17 devstack sudo[101814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:17 devstack sudo[101814]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-97d47905-2d38-474d-9138-06051168f3e5 tempest-VolumesSnapshotTestJSON-976727453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d284f67c-3754-4d74-a7b0-d9c07a50a170" returned: 0 in 0.244s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:17 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-97d47905-2d38-474d-9138-06051168f3e5 tempest-VolumesSnapshotTestJSON-976727453 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:51:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-97d47905-2d38-474d-9138-06051168f3e5 tempest-VolumesSnapshotTestJSON-976727453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:51:17 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-97d47905-2d38-474d-9138-06051168f3e5 tempest-VolumesSnapshotTestJSON-976727453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdcb1807-9abe-496b-9b6e-a5235ac0c083) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d284f67c-3754-4d74-a7b0-d9c07a50a170', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:51:17 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-97d47905-2d38-474d-9138-06051168f3e5 tempest-VolumesSnapshotTestJSON-976727453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (825d187b-a7a9-4715-8f71-6d943527f540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:51:17 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-97d47905-2d38-474d-9138-06051168f3e5 tempest-VolumesSnapshotTestJSON-976727453 None] Volume volume-d284f67c-3754-4d74-a7b0-d9c07a50a170 (d284f67c-3754-4d74-a7b0-d9c07a50a170): created successfully Sep 04 22:51:17 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-97d47905-2d38-474d-9138-06051168f3e5 tempest-VolumesSnapshotTestJSON-976727453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (825d187b-a7a9-4715-8f71-6d943527f540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:51:17 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-97d47905-2d38-474d-9138-06051168f3e5 tempest-VolumesSnapshotTestJSON-976727453 None] Flow 'volume_create_manager' (3054dd91-a8ce-4b58-8485-e8fa8a5114e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:51:17 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-97d47905-2d38-474d-9138-06051168f3e5 tempest-VolumesSnapshotTestJSON-976727453 None] Created volume successfully. Sep 04 22:51:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-7020fee0-3c2d-4041-b662-69f914673ef6 tempest-VolumesSnapshotTestJSON-976727453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:51:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-7020fee0-3c2d-4041-b662-69f914673ef6 tempest-VolumesSnapshotTestJSON-976727453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:51:18 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-7020fee0-3c2d-4041-b662-69f914673ef6 tempest-VolumesSnapshotTestJSON-976727453 None] Creating offline snapshot e3035fad-af70-463e-88f0-dd00a3b6d9f2 of volume d284f67c-3754-4d74-a7b0-d9c07a50a170 {{(pid=87576) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 22:51:18 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[182389f2-daa0-476f-900b-54385188c4d7]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:51:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-7020fee0-3c2d-4041-b662-69f914673ef6 tempest-VolumesSnapshotTestJSON-976727453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d284f67c-3754-4d74-a7b0-d9c07a50a170 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:18 devstack sudo[101817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d284f67c-3754-4d74-a7b0-d9c07a50a170 Sep 04 22:51:18 devstack sudo[101817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:18 devstack sudo[101817]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-7020fee0-3c2d-4041-b662-69f914673ef6 tempest-VolumesSnapshotTestJSON-976727453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d284f67c-3754-4d74-a7b0-d9c07a50a170" returned: 0 in 0.377s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-7020fee0-3c2d-4041-b662-69f914673ef6 tempest-VolumesSnapshotTestJSON-976727453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d284f67c-3754-4d74-a7b0-d9c07a50a170,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d284f67c-3754-4d74-a7b0-d9c07a50a170.e3035fad-af70-463e-88f0-dd00a3b6d9f2 1G {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:18 devstack sudo[101822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d284f67c-3754-4d74-a7b0-d9c07a50a170,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d284f67c-3754-4d74-a7b0-d9c07a50a170.e3035fad-af70-463e-88f0-dd00a3b6d9f2 1G Sep 04 22:51:18 devstack sudo[101822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:18 devstack sudo[101822]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-7020fee0-3c2d-4041-b662-69f914673ef6 tempest-VolumesSnapshotTestJSON-976727453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d284f67c-3754-4d74-a7b0-d9c07a50a170,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d284f67c-3754-4d74-a7b0-d9c07a50a170.e3035fad-af70-463e-88f0-dd00a3b6d9f2 1G" returned: 0 in 0.386s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-7020fee0-3c2d-4041-b662-69f914673ef6 tempest-VolumesSnapshotTestJSON-976727453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d284f67c-3754-4d74-a7b0-d9c07a50a170 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d284f67c-3754-4d74-a7b0-d9c07a50a170.e3035fad-af70-463e-88f0-dd00a3b6d9f2 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:18 devstack sudo[101827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d284f67c-3754-4d74-a7b0-d9c07a50a170 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d284f67c-3754-4d74-a7b0-d9c07a50a170.e3035fad-af70-463e-88f0-dd00a3b6d9f2 Sep 04 22:51:18 devstack sudo[101827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:19 devstack sudo[101827]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:19 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-7020fee0-3c2d-4041-b662-69f914673ef6 tempest-VolumesSnapshotTestJSON-976727453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d284f67c-3754-4d74-a7b0-d9c07a50a170 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d284f67c-3754-4d74-a7b0-d9c07a50a170.e3035fad-af70-463e-88f0-dd00a3b6d9f2" returned: 0 in 0.288s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:19 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-7020fee0-3c2d-4041-b662-69f914673ef6 tempest-VolumesSnapshotTestJSON-976727453 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d284f67c-3754-4d74-a7b0-d9c07a50a170.e3035fad-af70-463e-88f0-dd00a3b6d9f2 is being set with open permissions: ugo+rw Sep 04 22:51:19 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-7020fee0-3c2d-4041-b662-69f914673ef6 tempest-VolumesSnapshotTestJSON-976727453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d284f67c-3754-4d74-a7b0-d9c07a50a170.e3035fad-af70-463e-88f0-dd00a3b6d9f2 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:19 devstack sudo[101832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d284f67c-3754-4d74-a7b0-d9c07a50a170.e3035fad-af70-463e-88f0-dd00a3b6d9f2 Sep 04 22:51:19 devstack sudo[101832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:19 devstack sudo[101832]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:19 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-7020fee0-3c2d-4041-b662-69f914673ef6 tempest-VolumesSnapshotTestJSON-976727453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d284f67c-3754-4d74-a7b0-d9c07a50a170.e3035fad-af70-463e-88f0-dd00a3b6d9f2" returned: 0 in 0.238s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:19 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-7020fee0-3c2d-4041-b662-69f914673ef6 tempest-VolumesSnapshotTestJSON-976727453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d284f67c-3754-4d74-a7b0-d9c07a50a170.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:19 devstack sudo[101835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d284f67c-3754-4d74-a7b0-d9c07a50a170.info Sep 04 22:51:19 devstack sudo[101835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:19 devstack sudo[101835]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:19 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-7020fee0-3c2d-4041-b662-69f914673ef6 tempest-VolumesSnapshotTestJSON-976727453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d284f67c-3754-4d74-a7b0-d9c07a50a170.info" returned: 0 in 0.250s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:19 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-7020fee0-3c2d-4041-b662-69f914673ef6 tempest-VolumesSnapshotTestJSON-976727453 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d284f67c-3754-4d74-a7b0-d9c07a50a170.info is being set with open permissions: ugo+rw Sep 04 22:51:19 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-7020fee0-3c2d-4041-b662-69f914673ef6 tempest-VolumesSnapshotTestJSON-976727453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d284f67c-3754-4d74-a7b0-d9c07a50a170.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:19 devstack sudo[101842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d284f67c-3754-4d74-a7b0-d9c07a50a170.info Sep 04 22:51:19 devstack sudo[101842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:20 devstack sudo[101842]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-7020fee0-3c2d-4041-b662-69f914673ef6 tempest-VolumesSnapshotTestJSON-976727453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d284f67c-3754-4d74-a7b0-d9c07a50a170.info" returned: 0 in 0.263s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-7020fee0-3c2d-4041-b662-69f914673ef6 tempest-VolumesSnapshotTestJSON-976727453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.899s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:51:20 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-7020fee0-3c2d-4041-b662-69f914673ef6 tempest-VolumesSnapshotTestJSON-976727453 None] Create snapshot completed successfully Sep 04 22:51:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-6884c1a8-9829-47ac-a3fb-c7bf6057d0ec req-1738eb67-5928-441d-8bfb-2429c80514aa tempest-TestStampPattern-1034473821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:51:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-6884c1a8-9829-47ac-a3fb-c7bf6057d0ec req-1738eb67-5928-441d-8bfb-2429c80514aa tempest-TestStampPattern-1034473821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:51:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-6884c1a8-9829-47ac-a3fb-c7bf6057d0ec req-1738eb67-5928-441d-8bfb-2429c80514aa tempest-TestStampPattern-1034473821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:51:20 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-6884c1a8-9829-47ac-a3fb-c7bf6057d0ec req-1738eb67-5928-441d-8bfb-2429c80514aa tempest-TestStampPattern-1034473821 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4', 'name': 'volume-05c7519e-2464-4382-9ae8-a2eb99ef3db7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e942697d-6bf8-46b7-a894-762ea09d0edd', 'enforce_multipath': True} {{(pid=87576) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 22:51:20 devstack cinder-volume[87576]: INFO cinder.volume.manager [req-6884c1a8-9829-47ac-a3fb-c7bf6057d0ec req-1738eb67-5928-441d-8bfb-2429c80514aa tempest-TestStampPattern-1034473821 None] attachment_update completed successfully. Sep 04 22:51:20 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-8908a03a-7f97-44fd-89a3-9795b85ceb75 tempest-VolumesSnapshotTestJSON-976727453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:51:20 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-8908a03a-7f97-44fd-89a3-9795b85ceb75 tempest-VolumesSnapshotTestJSON-976727453 None] Flow 'volume_create_manager' (33ee6e10-03e2-4102-b3c6-7ebd54ea053d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:51:20 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-8908a03a-7f97-44fd-89a3-9795b85ceb75 tempest-VolumesSnapshotTestJSON-976727453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d39cdc6e-8579-4bfa-9da5-95f40dd96895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:51:20 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-8908a03a-7f97-44fd-89a3-9795b85ceb75 tempest-VolumesSnapshotTestJSON-976727453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d39cdc6e-8579-4bfa-9da5-95f40dd96895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:51:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1413409173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1406788e-a4d0-4518-9f0d-8e0e5dd2d08d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46a0ac7ea3b5483892ddadcd1eb1e727',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:51:21Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=e3035fad-af70-463e-88f0-dd00a3b6d9f2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:51:21Z,use_quota=True,user_id='99ba67d6476c41c99b05a54ec37b2823',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:51:20 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-8908a03a-7f97-44fd-89a3-9795b85ceb75 tempest-VolumesSnapshotTestJSON-976727453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c682aa85-0ce2-4dcf-960d-df6d6b6fd5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:51:20 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-8908a03a-7f97-44fd-89a3-9795b85ceb75 tempest-VolumesSnapshotTestJSON-976727453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c682aa85-0ce2-4dcf-960d-df6d6b6fd5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:51:20 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-8908a03a-7f97-44fd-89a3-9795b85ceb75 tempest-VolumesSnapshotTestJSON-976727453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a5794be-396d-4df4-a3c7-4223415aae5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:51:20 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-8908a03a-7f97-44fd-89a3-9795b85ceb75 tempest-VolumesSnapshotTestJSON-976727453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a5794be-396d-4df4-a3c7-4223415aae5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1406788e-a4d0-4518-9f0d-8e0e5dd2d08d', 'volume_name': 'volume-1406788e-a4d0-4518-9f0d-8e0e5dd2d08d', 'volume_size': 2, 'snapshot_id': 'e3035fad-af70-463e-88f0-dd00a3b6d9f2'}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:51:20 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-8908a03a-7f97-44fd-89a3-9795b85ceb75 tempest-VolumesSnapshotTestJSON-976727453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84ddf077-b8fb-46b5-9d31-dfd4efda7bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:51:20 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-8908a03a-7f97-44fd-89a3-9795b85ceb75 tempest-VolumesSnapshotTestJSON-976727453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84ddf077-b8fb-46b5-9d31-dfd4efda7bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:51:20 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-8908a03a-7f97-44fd-89a3-9795b85ceb75 tempest-VolumesSnapshotTestJSON-976727453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e671e2a-da32-4325-bbc8-e507f714f8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:51:20 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-8908a03a-7f97-44fd-89a3-9795b85ceb75 tempest-VolumesSnapshotTestJSON-976727453 None] Volume 1406788e-a4d0-4518-9f0d-8e0e5dd2d08d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1406788e-a4d0-4518-9f0d-8e0e5dd2d08d', 'volume_size': 2, 'snapshot_id': 'e3035fad-af70-463e-88f0-dd00a3b6d9f2'} Sep 04 22:51:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-8908a03a-7f97-44fd-89a3-9795b85ceb75 tempest-VolumesSnapshotTestJSON-976727453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:51:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-8908a03a-7f97-44fd-89a3-9795b85ceb75 tempest-VolumesSnapshotTestJSON-976727453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:51:20 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-8908a03a-7f97-44fd-89a3-9795b85ceb75 tempest-VolumesSnapshotTestJSON-976727453 None] Acquiring lock "cinder-quobyte-e3035fad-af70-463e-88f0-dd00a3b6d9f2-1406788e-a4d0-4518-9f0d-8e0e5dd2d08d" by "_create_volume_from_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:51:20 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-8908a03a-7f97-44fd-89a3-9795b85ceb75 tempest-VolumesSnapshotTestJSON-976727453 None] Lock "cinder-quobyte-e3035fad-af70-463e-88f0-dd00a3b6d9f2-1406788e-a4d0-4518-9f0d-8e0e5dd2d08d" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:51:20 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-8908a03a-7f97-44fd-89a3-9795b85ceb75 tempest-VolumesSnapshotTestJSON-976727453 None] Creating volume 1406788e-a4d0-4518-9f0d-8e0e5dd2d08d from snapshot e3035fad-af70-463e-88f0-dd00a3b6d9f2 {{(pid=87576) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 04 22:51:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-8908a03a-7f97-44fd-89a3-9795b85ceb75 tempest-VolumesSnapshotTestJSON-976727453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:51:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-8908a03a-7f97-44fd-89a3-9795b85ceb75 tempest-VolumesSnapshotTestJSON-976727453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:51:20 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-8908a03a-7f97-44fd-89a3-9795b85ceb75 tempest-VolumesSnapshotTestJSON-976727453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:51:20 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-8908a03a-7f97-44fd-89a3-9795b85ceb75 tempest-VolumesSnapshotTestJSON-976727453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:51:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-8908a03a-7f97-44fd-89a3-9795b85ceb75 tempest-VolumesSnapshotTestJSON-976727453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:51:20 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-8908a03a-7f97-44fd-89a3-9795b85ceb75 tempest-VolumesSnapshotTestJSON-976727453 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:51:20 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-8908a03a-7f97-44fd-89a3-9795b85ceb75 tempest-VolumesSnapshotTestJSON-976727453 None] Acquiring lock "cinder-quobyte-1406788e-a4d0-4518-9f0d-8e0e5dd2d08d" by "_copy_volume_from_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:51:21 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-8908a03a-7f97-44fd-89a3-9795b85ceb75 tempest-VolumesSnapshotTestJSON-976727453 None] Lock "cinder-quobyte-1406788e-a4d0-4518-9f0d-8e0e5dd2d08d" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:51:21 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-8908a03a-7f97-44fd-89a3-9795b85ceb75 tempest-VolumesSnapshotTestJSON-976727453 None] snapshot: e3035fad-af70-463e-88f0-dd00a3b6d9f2, volume: 1406788e-a4d0-4518-9f0d-8e0e5dd2d08d, {{(pid=87576) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 04 22:51:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-8908a03a-7f97-44fd-89a3-9795b85ceb75 tempest-VolumesSnapshotTestJSON-976727453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:51:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-8908a03a-7f97-44fd-89a3-9795b85ceb75 tempest-VolumesSnapshotTestJSON-976727453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:51:21 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-8908a03a-7f97-44fd-89a3-9795b85ceb75 tempest-VolumesSnapshotTestJSON-976727453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:51:21 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-8908a03a-7f97-44fd-89a3-9795b85ceb75 tempest-VolumesSnapshotTestJSON-976727453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:51:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-8908a03a-7f97-44fd-89a3-9795b85ceb75 tempest-VolumesSnapshotTestJSON-976727453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:51:21 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c61a80d-a598-4f89-8524-10bfcc2626d3]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:51:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-8908a03a-7f97-44fd-89a3-9795b85ceb75 tempest-VolumesSnapshotTestJSON-976727453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d284f67c-3754-4d74-a7b0-d9c07a50a170.e3035fad-af70-463e-88f0-dd00a3b6d9f2 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:21 devstack sudo[101924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d284f67c-3754-4d74-a7b0-d9c07a50a170.e3035fad-af70-463e-88f0-dd00a3b6d9f2 Sep 04 22:51:21 devstack sudo[101924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:21 devstack sudo[101924]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-8908a03a-7f97-44fd-89a3-9795b85ceb75 tempest-VolumesSnapshotTestJSON-976727453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d284f67c-3754-4d74-a7b0-d9c07a50a170.e3035fad-af70-463e-88f0-dd00a3b6d9f2" returned: 0 in 0.428s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:21 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-8908a03a-7f97-44fd-89a3-9795b85ceb75 tempest-VolumesSnapshotTestJSON-976727453 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d284f67c-3754-4d74-a7b0-d9c07a50a170(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 22:51:21 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cca9df3-1aaa-4964-acee-0d7ac88981a5]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:51:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-8908a03a-7f97-44fd-89a3-9795b85ceb75 tempest-VolumesSnapshotTestJSON-976727453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d284f67c-3754-4d74-a7b0-d9c07a50a170 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:21 devstack sudo[102243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d284f67c-3754-4d74-a7b0-d9c07a50a170 Sep 04 22:51:21 devstack sudo[102243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:22 devstack sudo[102243]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-8908a03a-7f97-44fd-89a3-9795b85ceb75 tempest-VolumesSnapshotTestJSON-976727453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d284f67c-3754-4d74-a7b0-d9c07a50a170" returned: 0 in 0.524s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:22 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-8908a03a-7f97-44fd-89a3-9795b85ceb75 tempest-VolumesSnapshotTestJSON-976727453 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d284f67c-3754-4d74-a7b0-d9c07a50a170 {{(pid=87576) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 04 22:51:22 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-8908a03a-7f97-44fd-89a3-9795b85ceb75 tempest-VolumesSnapshotTestJSON-976727453 None] Creating direct copy from snapshot {{(pid=87576) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 04 22:51:22 devstack cinder-volume[87576]: DEBUG cinder.utils [None req-8908a03a-7f97-44fd-89a3-9795b85ceb75 tempest-VolumesSnapshotTestJSON-976727453 None] Path /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-1406788e-a4d0-4518-9f0d-8e0e5dd2d08d not found in is_blk_device check {{(pid=87576) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 04 22:51:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-8908a03a-7f97-44fd-89a3-9795b85ceb75 tempest-VolumesSnapshotTestJSON-976727453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d284f67c-3754-4d74-a7b0-d9c07a50a170 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-1406788e-a4d0-4518-9f0d-8e0e5dd2d08d {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:22 devstack sudo[102248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d284f67c-3754-4d74-a7b0-d9c07a50a170 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-1406788e-a4d0-4518-9f0d-8e0e5dd2d08d Sep 04 22:51:22 devstack sudo[102248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:25 devstack cinder-volume[87576]: INFO cinder.volume.manager [req-2174c78b-4c46-4d3a-bd80-88187f6b72f2 req-413574f6-75b5-4b66-9034-8aee771973f7 tempest-TestStampPattern-1034473821 None] Terminate volume connection completed successfully. Sep 04 22:51:25 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-2174c78b-4c46-4d3a-bd80-88187f6b72f2 req-413574f6-75b5-4b66-9034-8aee771973f7 tempest-TestStampPattern-1034473821 None] Deleting attachment e942697d-6bf8-46b7-a894-762ea09d0edd. {{(pid=87576) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 22:51:26 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-00d40622-d610-476a-996f-60c50079bdd3 tempest-AttachVolumeNegativeTest-2019172075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:51:26 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-00d40622-d610-476a-996f-60c50079bdd3 tempest-AttachVolumeNegativeTest-2019172075 None] Flow 'volume_create_manager' (24b0d50f-1189-433b-af7b-7431e1b8192b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:51:26 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-00d40622-d610-476a-996f-60c50079bdd3 tempest-AttachVolumeNegativeTest-2019172075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcc1587a-3476-4534-a96e-10bc66de1c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:51:26 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-00d40622-d610-476a-996f-60c50079bdd3 tempest-AttachVolumeNegativeTest-2019172075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcc1587a-3476-4534-a96e-10bc66de1c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:51:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1037588704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1e4e595-c0e1-4a1e-974e-1d5063e1c5b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e80e6c251404ba9b9947664ac5836f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:51:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:51:26Z,use_quota=True,user_id='047f7ffdca4c45cdb2cc83f5261484c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:51:26 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-00d40622-d610-476a-996f-60c50079bdd3 tempest-AttachVolumeNegativeTest-2019172075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (310e9089-0f71-4504-bf28-568ce94b92c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:51:26 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-00d40622-d610-476a-996f-60c50079bdd3 tempest-AttachVolumeNegativeTest-2019172075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (310e9089-0f71-4504-bf28-568ce94b92c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:51:26 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-00d40622-d610-476a-996f-60c50079bdd3 tempest-AttachVolumeNegativeTest-2019172075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7595e501-6ac9-41c4-a3ba-6f1003b33007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:51:26 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-00d40622-d610-476a-996f-60c50079bdd3 tempest-AttachVolumeNegativeTest-2019172075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7595e501-6ac9-41c4-a3ba-6f1003b33007) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1e4e595-c0e1-4a1e-974e-1d5063e1c5b2', 'volume_name': 'volume-d1e4e595-c0e1-4a1e-974e-1d5063e1c5b2', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:51:26 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-00d40622-d610-476a-996f-60c50079bdd3 tempest-AttachVolumeNegativeTest-2019172075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3af2d566-4029-4f07-b82d-9ca574ffd14a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:51:26 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-00d40622-d610-476a-996f-60c50079bdd3 tempest-AttachVolumeNegativeTest-2019172075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3af2d566-4029-4f07-b82d-9ca574ffd14a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:51:26 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-00d40622-d610-476a-996f-60c50079bdd3 tempest-AttachVolumeNegativeTest-2019172075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7684ba17-b2d2-4ee5-9420-adcc1d3a87e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:51:26 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-00d40622-d610-476a-996f-60c50079bdd3 tempest-AttachVolumeNegativeTest-2019172075 None] Volume d1e4e595-c0e1-4a1e-974e-1d5063e1c5b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1e4e595-c0e1-4a1e-974e-1d5063e1c5b2', 'volume_size': 1} Sep 04 22:51:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-00d40622-d610-476a-996f-60c50079bdd3 tempest-AttachVolumeNegativeTest-2019172075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:51:28 devstack sudo[102248]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-8908a03a-7f97-44fd-89a3-9795b85ceb75 tempest-VolumesSnapshotTestJSON-976727453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d284f67c-3754-4d74-a7b0-d9c07a50a170 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-1406788e-a4d0-4518-9f0d-8e0e5dd2d08d" returned: 0 in 6.286s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:28 devstack cinder-volume[87576]: DEBUG cinder.image.image_utils [None req-8908a03a-7f97-44fd-89a3-9795b85ceb75 tempest-VolumesSnapshotTestJSON-976727453 None] Image conversion details: src /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d284f67c-3754-4d74-a7b0-d9c07a50a170, size 1024.00 MB, duration 6.29 sec, destination /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-1406788e-a4d0-4518-9f0d-8e0e5dd2d08d {{(pid=87576) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 22:51:28 devstack cinder-volume[87576]: INFO cinder.image.image_utils [None req-8908a03a-7f97-44fd-89a3-9795b85ceb75 tempest-VolumesSnapshotTestJSON-976727453 None] Converted 1024.00 MB image at 162.88 MB/s Sep 04 22:51:28 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-8908a03a-7f97-44fd-89a3-9795b85ceb75 tempest-VolumesSnapshotTestJSON-976727453 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-1406788e-a4d0-4518-9f0d-8e0e5dd2d08d is being set with open permissions: ugo+rw Sep 04 22:51:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-8908a03a-7f97-44fd-89a3-9795b85ceb75 tempest-VolumesSnapshotTestJSON-976727453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-1406788e-a4d0-4518-9f0d-8e0e5dd2d08d {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:28 devstack sudo[102310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-1406788e-a4d0-4518-9f0d-8e0e5dd2d08d Sep 04 22:51:28 devstack sudo[102310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:28 devstack sudo[102310]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-8908a03a-7f97-44fd-89a3-9795b85ceb75 tempest-VolumesSnapshotTestJSON-976727453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-1406788e-a4d0-4518-9f0d-8e0e5dd2d08d" returned: 0 in 0.293s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:28 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-8908a03a-7f97-44fd-89a3-9795b85ceb75 tempest-VolumesSnapshotTestJSON-976727453 None] Lock "cinder-quobyte-1406788e-a4d0-4518-9f0d-8e0e5dd2d08d" released by "_copy_volume_from_snapshot" :: held 7.647s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:51:28 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-8908a03a-7f97-44fd-89a3-9795b85ceb75 tempest-VolumesSnapshotTestJSON-976727453 None] Lock "cinder-quobyte-e3035fad-af70-463e-88f0-dd00a3b6d9f2-1406788e-a4d0-4518-9f0d-8e0e5dd2d08d" released by "_create_volume_from_snapshot" :: held 7.739s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:51:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-8908a03a-7f97-44fd-89a3-9795b85ceb75 tempest-VolumesSnapshotTestJSON-976727453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.765s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:51:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-00d40622-d610-476a-996f-60c50079bdd3 tempest-AttachVolumeNegativeTest-2019172075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.158s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:51:28 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-00d40622-d610-476a-996f-60c50079bdd3 tempest-AttachVolumeNegativeTest-2019172075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:51:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1037588704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1e4e595-c0e1-4a1e-974e-1d5063e1c5b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e80e6c251404ba9b9947664ac5836f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:51:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:51:26Z,use_quota=True,user_id='047f7ffdca4c45cdb2cc83f5261484c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:51:28 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-00d40622-d610-476a-996f-60c50079bdd3 tempest-AttachVolumeNegativeTest-2019172075 None] Creating volume d1e4e595-c0e1-4a1e-974e-1d5063e1c5b2 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:51:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-00d40622-d610-476a-996f-60c50079bdd3 tempest-AttachVolumeNegativeTest-2019172075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:51:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-00d40622-d610-476a-996f-60c50079bdd3 tempest-AttachVolumeNegativeTest-2019172075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:51:28 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-00d40622-d610-476a-996f-60c50079bdd3 tempest-AttachVolumeNegativeTest-2019172075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:51:28 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-00d40622-d610-476a-996f-60c50079bdd3 tempest-AttachVolumeNegativeTest-2019172075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:51:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-00d40622-d610-476a-996f-60c50079bdd3 tempest-AttachVolumeNegativeTest-2019172075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:51:28 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-00d40622-d610-476a-996f-60c50079bdd3 tempest-AttachVolumeNegativeTest-2019172075 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:51:28 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-00d40622-d610-476a-996f-60c50079bdd3 tempest-AttachVolumeNegativeTest-2019172075 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:51:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-00d40622-d610-476a-996f-60c50079bdd3 tempest-AttachVolumeNegativeTest-2019172075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d1e4e595-c0e1-4a1e-974e-1d5063e1c5b2 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:28 devstack sudo[102318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d1e4e595-c0e1-4a1e-974e-1d5063e1c5b2 1073741824 Sep 04 22:51:28 devstack sudo[102318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-8908a03a-7f97-44fd-89a3-9795b85ceb75 tempest-VolumesSnapshotTestJSON-976727453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e671e2a-da32-4325-bbc8-e507f714f8a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1406788e-a4d0-4518-9f0d-8e0e5dd2d08d', 'volume_size': 2, 'snapshot_id': 'e3035fad-af70-463e-88f0-dd00a3b6d9f2'}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:51:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-8908a03a-7f97-44fd-89a3-9795b85ceb75 tempest-VolumesSnapshotTestJSON-976727453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14fad01b-a7b6-4c9f-8a84-4187bc838998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:51:28 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-8908a03a-7f97-44fd-89a3-9795b85ceb75 tempest-VolumesSnapshotTestJSON-976727453 None] Volume volume-1406788e-a4d0-4518-9f0d-8e0e5dd2d08d (1406788e-a4d0-4518-9f0d-8e0e5dd2d08d): created successfully Sep 04 22:51:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-8908a03a-7f97-44fd-89a3-9795b85ceb75 tempest-VolumesSnapshotTestJSON-976727453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14fad01b-a7b6-4c9f-8a84-4187bc838998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:51:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-8908a03a-7f97-44fd-89a3-9795b85ceb75 tempest-VolumesSnapshotTestJSON-976727453 None] Flow 'volume_create_manager' (33ee6e10-03e2-4102-b3c6-7ebd54ea053d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:51:28 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-8908a03a-7f97-44fd-89a3-9795b85ceb75 tempest-VolumesSnapshotTestJSON-976727453 None] Created volume successfully. Sep 04 22:51:29 devstack sudo[102318]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-00d40622-d610-476a-996f-60c50079bdd3 tempest-AttachVolumeNegativeTest-2019172075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d1e4e595-c0e1-4a1e-974e-1d5063e1c5b2 1073741824" returned: 0 in 0.627s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-00d40622-d610-476a-996f-60c50079bdd3 tempest-AttachVolumeNegativeTest-2019172075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d1e4e595-c0e1-4a1e-974e-1d5063e1c5b2 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:29 devstack sudo[102343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d1e4e595-c0e1-4a1e-974e-1d5063e1c5b2 Sep 04 22:51:29 devstack sudo[102343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:29 devstack sudo[102343]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-00d40622-d610-476a-996f-60c50079bdd3 tempest-AttachVolumeNegativeTest-2019172075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d1e4e595-c0e1-4a1e-974e-1d5063e1c5b2" returned: 0 in 0.271s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:29 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-00d40622-d610-476a-996f-60c50079bdd3 tempest-AttachVolumeNegativeTest-2019172075 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:51:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-00d40622-d610-476a-996f-60c50079bdd3 tempest-AttachVolumeNegativeTest-2019172075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:51:29 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-00d40622-d610-476a-996f-60c50079bdd3 tempest-AttachVolumeNegativeTest-2019172075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7684ba17-b2d2-4ee5-9420-adcc1d3a87e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1e4e595-c0e1-4a1e-974e-1d5063e1c5b2', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:51:29 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-00d40622-d610-476a-996f-60c50079bdd3 tempest-AttachVolumeNegativeTest-2019172075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7469f9b-4df9-4aac-8218-d93461fd7a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:51:29 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-00d40622-d610-476a-996f-60c50079bdd3 tempest-AttachVolumeNegativeTest-2019172075 None] Volume volume-d1e4e595-c0e1-4a1e-974e-1d5063e1c5b2 (d1e4e595-c0e1-4a1e-974e-1d5063e1c5b2): created successfully Sep 04 22:51:29 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-00d40622-d610-476a-996f-60c50079bdd3 tempest-AttachVolumeNegativeTest-2019172075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7469f9b-4df9-4aac-8218-d93461fd7a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:51:29 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-00d40622-d610-476a-996f-60c50079bdd3 tempest-AttachVolumeNegativeTest-2019172075 None] Flow 'volume_create_manager' (24b0d50f-1189-433b-af7b-7431e1b8192b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:51:29 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-00d40622-d610-476a-996f-60c50079bdd3 tempest-AttachVolumeNegativeTest-2019172075 None] Created volume successfully. Sep 04 22:51:30 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-110911d6-a736-4f7a-89bf-afcc7e2c526e tempest-VolumesSnapshotTestJSON-976727453 None] Acquiring lock "cinder-1406788e-a4d0-4518-9f0d-8e0e5dd2d08d-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:51:30 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-110911d6-a736-4f7a-89bf-afcc7e2c526e tempest-VolumesSnapshotTestJSON-976727453 None] Lock "cinder-1406788e-a4d0-4518-9f0d-8e0e5dd2d08d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:51:30 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-110911d6-a736-4f7a-89bf-afcc7e2c526e tempest-VolumesSnapshotTestJSON-976727453 None] Acquiring lock "cinder-quobyte-1406788e-a4d0-4518-9f0d-8e0e5dd2d08d" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:51:30 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-110911d6-a736-4f7a-89bf-afcc7e2c526e tempest-VolumesSnapshotTestJSON-976727453 None] Lock "cinder-quobyte-1406788e-a4d0-4518-9f0d-8e0e5dd2d08d" acquired by "delete_volume" :: waited 0.013s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:51:30 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[532b433b-ab07-46db-b1bd-505d31296713]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:51:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-110911d6-a736-4f7a-89bf-afcc7e2c526e tempest-VolumesSnapshotTestJSON-976727453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-1406788e-a4d0-4518-9f0d-8e0e5dd2d08d {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:30 devstack sudo[102348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-1406788e-a4d0-4518-9f0d-8e0e5dd2d08d Sep 04 22:51:30 devstack sudo[102348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:30 devstack sudo[102348]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-110911d6-a736-4f7a-89bf-afcc7e2c526e tempest-VolumesSnapshotTestJSON-976727453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-1406788e-a4d0-4518-9f0d-8e0e5dd2d08d" returned: 0 in 0.393s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-110911d6-a736-4f7a-89bf-afcc7e2c526e tempest-VolumesSnapshotTestJSON-976727453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-1406788e-a4d0-4518-9f0d-8e0e5dd2d08d {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:30 devstack sudo[102356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-1406788e-a4d0-4518-9f0d-8e0e5dd2d08d Sep 04 22:51:30 devstack sudo[102356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:30 devstack sudo[102356]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-110911d6-a736-4f7a-89bf-afcc7e2c526e tempest-VolumesSnapshotTestJSON-976727453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-1406788e-a4d0-4518-9f0d-8e0e5dd2d08d" returned: 0 in 0.264s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:30 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-110911d6-a736-4f7a-89bf-afcc7e2c526e tempest-VolumesSnapshotTestJSON-976727453 None] Lock "cinder-quobyte-1406788e-a4d0-4518-9f0d-8e0e5dd2d08d" released by "delete_volume" :: held 0.704s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:51:30 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-110911d6-a736-4f7a-89bf-afcc7e2c526e tempest-VolumesSnapshotTestJSON-976727453 None] Created reservations ['50252fc5-2ec2-4445-ab0c-f02c2d870d46', '8c490ef8-02cd-4321-a83b-010764c0cd1e', '0d9387c5-6aac-4ad5-9086-13dd963af7f1', '98a3c850-627c-4d14-9203-75775e3166f5'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:51:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-110911d6-a736-4f7a-89bf-afcc7e2c526e tempest-VolumesSnapshotTestJSON-976727453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:51:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-110911d6-a736-4f7a-89bf-afcc7e2c526e tempest-VolumesSnapshotTestJSON-976727453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:51:30 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-110911d6-a736-4f7a-89bf-afcc7e2c526e tempest-VolumesSnapshotTestJSON-976727453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:51:30 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-110911d6-a736-4f7a-89bf-afcc7e2c526e tempest-VolumesSnapshotTestJSON-976727453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:51:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-110911d6-a736-4f7a-89bf-afcc7e2c526e tempest-VolumesSnapshotTestJSON-976727453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:51:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-110911d6-a736-4f7a-89bf-afcc7e2c526e tempest-VolumesSnapshotTestJSON-976727453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:30 devstack sudo[102364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:51:31 devstack sudo[102364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:31 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-65913bb0-b873-494b-a79d-e2411e69c842 tempest-TestStampPattern-1034473821 None] Acquiring lock "cinder-05c7519e-2464-4382-9ae8-a2eb99ef3db7-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:51:31 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-65913bb0-b873-494b-a79d-e2411e69c842 tempest-TestStampPattern-1034473821 None] Lock "cinder-05c7519e-2464-4382-9ae8-a2eb99ef3db7-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:51:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-1f5ad0b7-d735-4f10-98ca-3003244db2d6 req-ea366358-ddeb-4737-83db-3f5571484817 tempest-AttachVolumeNegativeTest-2019172075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:51:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-1f5ad0b7-d735-4f10-98ca-3003244db2d6 req-ea366358-ddeb-4737-83db-3f5571484817 tempest-AttachVolumeNegativeTest-2019172075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:51:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-1f5ad0b7-d735-4f10-98ca-3003244db2d6 req-ea366358-ddeb-4737-83db-3f5571484817 tempest-AttachVolumeNegativeTest-2019172075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:51:31 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-65913bb0-b873-494b-a79d-e2411e69c842 tempest-TestStampPattern-1034473821 None] Acquiring lock "cinder-quobyte-05c7519e-2464-4382-9ae8-a2eb99ef3db7" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:51:31 devstack sudo[102364]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:31 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-65913bb0-b873-494b-a79d-e2411e69c842 tempest-TestStampPattern-1034473821 None] Lock "cinder-quobyte-05c7519e-2464-4382-9ae8-a2eb99ef3db7" acquired by "delete_volume" :: waited 0.032s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:51:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-110911d6-a736-4f7a-89bf-afcc7e2c526e tempest-VolumesSnapshotTestJSON-976727453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.357s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:31 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-110911d6-a736-4f7a-89bf-afcc7e2c526e tempest-VolumesSnapshotTestJSON-976727453 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:51:31 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-1f5ad0b7-d735-4f10-98ca-3003244db2d6 req-ea366358-ddeb-4737-83db-3f5571484817 tempest-AttachVolumeNegativeTest-2019172075 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4', 'name': 'volume-d1e4e595-c0e1-4a1e-974e-1d5063e1c5b2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9e45e118-9468-4724-8749-adbc7e8bbd18', 'enforce_multipath': True} {{(pid=87576) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 22:51:31 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ebb59a-827e-446e-a8c8-da0da9268462]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:51:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-65913bb0-b873-494b-a79d-e2411e69c842 tempest-TestStampPattern-1034473821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-05c7519e-2464-4382-9ae8-a2eb99ef3db7 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:31 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-110911d6-a736-4f7a-89bf-afcc7e2c526e tempest-VolumesSnapshotTestJSON-976727453 None] Deleted volume successfully. Sep 04 22:51:31 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-02753bc2-7d5a-414f-b48f-9114c054035e tempest-VolumesSnapshotTestJSON-976727453 None] Acquiring lock "cinder-e3035fad-af70-463e-88f0-dd00a3b6d9f2-delete_snapshot" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:51:31 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-02753bc2-7d5a-414f-b48f-9114c054035e tempest-VolumesSnapshotTestJSON-976727453 None] Lock "cinder-e3035fad-af70-463e-88f0-dd00a3b6d9f2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:51:31 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-02753bc2-7d5a-414f-b48f-9114c054035e tempest-VolumesSnapshotTestJSON-976727453 None] Acquiring lock "cinder-quobyte-d284f67c-3754-4d74-a7b0-d9c07a50a170" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:51:31 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-110911d6-a736-4f7a-89bf-afcc7e2c526e tempest-VolumesSnapshotTestJSON-976727453 None] Lock "cinder-1406788e-a4d0-4518-9f0d-8e0e5dd2d08d-delete_volume" released by "delete_volume" :: held 1.391s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:51:31 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-02753bc2-7d5a-414f-b48f-9114c054035e tempest-VolumesSnapshotTestJSON-976727453 None] Lock "cinder-quobyte-d284f67c-3754-4d74-a7b0-d9c07a50a170" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:51:31 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-02753bc2-7d5a-414f-b48f-9114c054035e tempest-VolumesSnapshotTestJSON-976727453 None] Acquiring lock "cinder-quobyte-e3035fad-af70-463e-88f0-dd00a3b6d9f2" by "_delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:51:31 devstack cinder-volume[87576]: INFO cinder.volume.manager [req-1f5ad0b7-d735-4f10-98ca-3003244db2d6 req-ea366358-ddeb-4737-83db-3f5571484817 tempest-AttachVolumeNegativeTest-2019172075 None] attachment_update completed successfully. Sep 04 22:51:31 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-02753bc2-7d5a-414f-b48f-9114c054035e tempest-VolumesSnapshotTestJSON-976727453 None] Lock "cinder-quobyte-e3035fad-af70-463e-88f0-dd00a3b6d9f2" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:51:31 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-02753bc2-7d5a-414f-b48f-9114c054035e tempest-VolumesSnapshotTestJSON-976727453 None] Deleting offline snapshot e3035fad-af70-463e-88f0-dd00a3b6d9f2 of volume d284f67c-3754-4d74-a7b0-d9c07a50a170 {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 22:51:31 devstack sudo[102370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-05c7519e-2464-4382-9ae8-a2eb99ef3db7 Sep 04 22:51:31 devstack sudo[102370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:31 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-02753bc2-7d5a-414f-b48f-9114c054035e tempest-VolumesSnapshotTestJSON-976727453 None] snapshot_file for this snap is: volume-d284f67c-3754-4d74-a7b0-d9c07a50a170.e3035fad-af70-463e-88f0-dd00a3b6d9f2 {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 22:51:31 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2987c83-be15-4cfd-8154-cfe6d66a9527]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:51:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-02753bc2-7d5a-414f-b48f-9114c054035e tempest-VolumesSnapshotTestJSON-976727453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d284f67c-3754-4d74-a7b0-d9c07a50a170.e3035fad-af70-463e-88f0-dd00a3b6d9f2 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:31 devstack sudo[102373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d284f67c-3754-4d74-a7b0-d9c07a50a170.e3035fad-af70-463e-88f0-dd00a3b6d9f2 Sep 04 22:51:31 devstack sudo[102373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:31 devstack sudo[102370]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-65913bb0-b873-494b-a79d-e2411e69c842 tempest-TestStampPattern-1034473821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-05c7519e-2464-4382-9ae8-a2eb99ef3db7" returned: 0 in 0.426s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-65913bb0-b873-494b-a79d-e2411e69c842 tempest-TestStampPattern-1034473821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-05c7519e-2464-4382-9ae8-a2eb99ef3db7 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:31 devstack sudo[102757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-05c7519e-2464-4382-9ae8-a2eb99ef3db7 Sep 04 22:51:31 devstack sudo[102757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:31 devstack sudo[102373]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-02753bc2-7d5a-414f-b48f-9114c054035e tempest-VolumesSnapshotTestJSON-976727453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d284f67c-3754-4d74-a7b0-d9c07a50a170.e3035fad-af70-463e-88f0-dd00a3b6d9f2" returned: 0 in 0.448s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:31 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-02753bc2-7d5a-414f-b48f-9114c054035e tempest-VolumesSnapshotTestJSON-976727453 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d284f67c-3754-4d74-a7b0-d9c07a50a170(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 22:51:32 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b8e949-162a-4eee-9464-3a821ceabfe3]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:51:32 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-02753bc2-7d5a-414f-b48f-9114c054035e tempest-VolumesSnapshotTestJSON-976727453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d284f67c-3754-4d74-a7b0-d9c07a50a170 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:32 devstack sudo[102757]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:32 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-65913bb0-b873-494b-a79d-e2411e69c842 tempest-TestStampPattern-1034473821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-05c7519e-2464-4382-9ae8-a2eb99ef3db7" returned: 0 in 0.287s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:32 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-65913bb0-b873-494b-a79d-e2411e69c842 tempest-TestStampPattern-1034473821 None] Lock "cinder-quobyte-05c7519e-2464-4382-9ae8-a2eb99ef3db7" released by "delete_volume" :: held 0.774s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:51:32 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-65913bb0-b873-494b-a79d-e2411e69c842 tempest-TestStampPattern-1034473821 None] Created reservations ['e46cfb3d-3103-48fa-9a60-951e56b0a083', 'b336d6a0-5403-4cca-bffe-19b10ad1d349', '4691e24b-5297-49ad-9330-ebf51c21f68e', '70d19310-cd1a-48ea-9e4e-7b484535437e'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:51:32 devstack sudo[102765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d284f67c-3754-4d74-a7b0-d9c07a50a170 Sep 04 22:51:32 devstack sudo[102765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:32 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-65913bb0-b873-494b-a79d-e2411e69c842 tempest-TestStampPattern-1034473821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:51:32 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-65913bb0-b873-494b-a79d-e2411e69c842 tempest-TestStampPattern-1034473821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:51:32 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-65913bb0-b873-494b-a79d-e2411e69c842 tempest-TestStampPattern-1034473821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:51:32 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-65913bb0-b873-494b-a79d-e2411e69c842 tempest-TestStampPattern-1034473821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:51:32 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-65913bb0-b873-494b-a79d-e2411e69c842 tempest-TestStampPattern-1034473821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:51:32 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-65913bb0-b873-494b-a79d-e2411e69c842 tempest-TestStampPattern-1034473821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:32 devstack sudo[102767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:51:32 devstack sudo[102767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:32 devstack sudo[102767]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:32 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-65913bb0-b873-494b-a79d-e2411e69c842 tempest-TestStampPattern-1034473821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.288s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:32 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-65913bb0-b873-494b-a79d-e2411e69c842 tempest-TestStampPattern-1034473821 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:51:32 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-65913bb0-b873-494b-a79d-e2411e69c842 tempest-TestStampPattern-1034473821 None] Deleted volume successfully. Sep 04 22:51:32 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-65913bb0-b873-494b-a79d-e2411e69c842 tempest-TestStampPattern-1034473821 None] Lock "cinder-05c7519e-2464-4382-9ae8-a2eb99ef3db7-delete_volume" released by "delete_volume" :: held 1.343s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:51:32 devstack sudo[102765]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:32 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-df9a9a15-a82b-491f-9cfe-433e2f14ad5b tempest-TestStampPattern-1034473821 None] Acquiring lock "cinder-134381b4-62a3-4e8a-8a6f-bf9ff18c5f9c-delete_snapshot" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:51:32 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-02753bc2-7d5a-414f-b48f-9114c054035e tempest-VolumesSnapshotTestJSON-976727453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d284f67c-3754-4d74-a7b0-d9c07a50a170" returned: 0 in 0.619s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:32 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-02753bc2-7d5a-414f-b48f-9114c054035e tempest-VolumesSnapshotTestJSON-976727453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d284f67c-3754-4d74-a7b0-d9c07a50a170.e3035fad-af70-463e-88f0-dd00a3b6d9f2 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:32 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-df9a9a15-a82b-491f-9cfe-433e2f14ad5b tempest-TestStampPattern-1034473821 None] Lock "cinder-134381b4-62a3-4e8a-8a6f-bf9ff18c5f9c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:51:32 devstack sudo[102773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d284f67c-3754-4d74-a7b0-d9c07a50a170.e3035fad-af70-463e-88f0-dd00a3b6d9f2 Sep 04 22:51:32 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-df9a9a15-a82b-491f-9cfe-433e2f14ad5b tempest-TestStampPattern-1034473821 None] Acquiring lock "cinder-quobyte-313d1bd3-92d3-4f1e-808c-876c31543218" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:51:32 devstack sudo[102773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:32 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-df9a9a15-a82b-491f-9cfe-433e2f14ad5b tempest-TestStampPattern-1034473821 None] Lock "cinder-quobyte-313d1bd3-92d3-4f1e-808c-876c31543218" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:51:32 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-df9a9a15-a82b-491f-9cfe-433e2f14ad5b tempest-TestStampPattern-1034473821 None] Acquiring lock "cinder-quobyte-134381b4-62a3-4e8a-8a6f-bf9ff18c5f9c" by "_delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:51:32 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-df9a9a15-a82b-491f-9cfe-433e2f14ad5b tempest-TestStampPattern-1034473821 None] Lock "cinder-quobyte-134381b4-62a3-4e8a-8a6f-bf9ff18c5f9c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:51:32 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-df9a9a15-a82b-491f-9cfe-433e2f14ad5b tempest-TestStampPattern-1034473821 None] Deleting offline snapshot 134381b4-62a3-4e8a-8a6f-bf9ff18c5f9c of volume 313d1bd3-92d3-4f1e-808c-876c31543218 {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 22:51:32 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-df9a9a15-a82b-491f-9cfe-433e2f14ad5b tempest-TestStampPattern-1034473821 None] snapshot_file for this snap is: volume-313d1bd3-92d3-4f1e-808c-876c31543218.134381b4-62a3-4e8a-8a6f-bf9ff18c5f9c {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 22:51:32 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[daac7abf-6f5e-4157-8eac-920ce4dbe992]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:51:32 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-df9a9a15-a82b-491f-9cfe-433e2f14ad5b tempest-TestStampPattern-1034473821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-313d1bd3-92d3-4f1e-808c-876c31543218.134381b4-62a3-4e8a-8a6f-bf9ff18c5f9c {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:32 devstack sudo[102775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-313d1bd3-92d3-4f1e-808c-876c31543218.134381b4-62a3-4e8a-8a6f-bf9ff18c5f9c Sep 04 22:51:32 devstack sudo[102775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:32 devstack sudo[102773]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:32 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-02753bc2-7d5a-414f-b48f-9114c054035e tempest-VolumesSnapshotTestJSON-976727453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d284f67c-3754-4d74-a7b0-d9c07a50a170.e3035fad-af70-463e-88f0-dd00a3b6d9f2" returned: 0 in 0.333s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:32 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-02753bc2-7d5a-414f-b48f-9114c054035e tempest-VolumesSnapshotTestJSON-976727453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d284f67c-3754-4d74-a7b0-d9c07a50a170.e3035fad-af70-463e-88f0-dd00a3b6d9f2 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:33 devstack sudo[102781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d284f67c-3754-4d74-a7b0-d9c07a50a170.e3035fad-af70-463e-88f0-dd00a3b6d9f2 Sep 04 22:51:33 devstack sudo[102781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:33 devstack sudo[102775]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-df9a9a15-a82b-491f-9cfe-433e2f14ad5b tempest-TestStampPattern-1034473821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-313d1bd3-92d3-4f1e-808c-876c31543218.134381b4-62a3-4e8a-8a6f-bf9ff18c5f9c" returned: 0 in 0.393s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:33 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-df9a9a15-a82b-491f-9cfe-433e2f14ad5b tempest-TestStampPattern-1034473821 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-313d1bd3-92d3-4f1e-808c-876c31543218(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 22:51:33 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[b76c376a-51b3-43f6-b4c9-f9b939bf01ed]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:51:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-df9a9a15-a82b-491f-9cfe-433e2f14ad5b tempest-TestStampPattern-1034473821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-313d1bd3-92d3-4f1e-808c-876c31543218 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:33 devstack sudo[102781]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-02753bc2-7d5a-414f-b48f-9114c054035e tempest-VolumesSnapshotTestJSON-976727453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d284f67c-3754-4d74-a7b0-d9c07a50a170.e3035fad-af70-463e-88f0-dd00a3b6d9f2" returned: 0 in 0.265s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:33 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-02753bc2-7d5a-414f-b48f-9114c054035e tempest-VolumesSnapshotTestJSON-976727453 None] Lock "cinder-quobyte-e3035fad-af70-463e-88f0-dd00a3b6d9f2" released by "_delete_snapshot" :: held 1.813s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:51:33 devstack sudo[102786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-313d1bd3-92d3-4f1e-808c-876c31543218 Sep 04 22:51:33 devstack sudo[102786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:33 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-02753bc2-7d5a-414f-b48f-9114c054035e tempest-VolumesSnapshotTestJSON-976727453 None] Lock "cinder-quobyte-d284f67c-3754-4d74-a7b0-d9c07a50a170" released by "delete_snapshot" :: held 1.841s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:51:33 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-02753bc2-7d5a-414f-b48f-9114c054035e tempest-VolumesSnapshotTestJSON-976727453 None] Created reservations ['51cd5934-7c82-4733-b272-09df69fa2edb', '95134f8f-576b-4f5d-8de1-3bd7a7761154', '12023fbb-0fcb-41b7-9a01-dbea9774a7cc', '17e00e71-8b7a-47be-acdb-e3c443fcc029'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:51:33 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-02753bc2-7d5a-414f-b48f-9114c054035e tempest-VolumesSnapshotTestJSON-976727453 None] Delete snapshot completed successfully. Sep 04 22:51:33 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-02753bc2-7d5a-414f-b48f-9114c054035e tempest-VolumesSnapshotTestJSON-976727453 None] Lock "cinder-e3035fad-af70-463e-88f0-dd00a3b6d9f2-delete_snapshot" released by "delete_snapshot" :: held 2.006s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:51:33 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-2af42492-a93d-4d20-b291-cb9617e5f07d tempest-VolumesSnapshotTestJSON-976727453 None] Acquiring lock "cinder-d284f67c-3754-4d74-a7b0-d9c07a50a170-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:51:33 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-2af42492-a93d-4d20-b291-cb9617e5f07d tempest-VolumesSnapshotTestJSON-976727453 None] Lock "cinder-d284f67c-3754-4d74-a7b0-d9c07a50a170-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:51:33 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-2af42492-a93d-4d20-b291-cb9617e5f07d tempest-VolumesSnapshotTestJSON-976727453 None] Acquiring lock "cinder-quobyte-d284f67c-3754-4d74-a7b0-d9c07a50a170" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:51:33 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-2af42492-a93d-4d20-b291-cb9617e5f07d tempest-VolumesSnapshotTestJSON-976727453 None] Lock "cinder-quobyte-d284f67c-3754-4d74-a7b0-d9c07a50a170" acquired by "delete_volume" :: waited 0.027s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:51:33 devstack sudo[102786]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-df9a9a15-a82b-491f-9cfe-433e2f14ad5b tempest-TestStampPattern-1034473821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-313d1bd3-92d3-4f1e-808c-876c31543218" returned: 0 in 0.736s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-df9a9a15-a82b-491f-9cfe-433e2f14ad5b tempest-TestStampPattern-1034473821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-313d1bd3-92d3-4f1e-808c-876c31543218.134381b4-62a3-4e8a-8a6f-bf9ff18c5f9c {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:33 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[787355f0-ffa6-4c43-b6e7-1153335f26b6]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:51:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2af42492-a93d-4d20-b291-cb9617e5f07d tempest-VolumesSnapshotTestJSON-976727453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d284f67c-3754-4d74-a7b0-d9c07a50a170 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:33 devstack sudo[102828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-313d1bd3-92d3-4f1e-808c-876c31543218.134381b4-62a3-4e8a-8a6f-bf9ff18c5f9c Sep 04 22:51:33 devstack sudo[102828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:34 devstack sudo[102829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d284f67c-3754-4d74-a7b0-d9c07a50a170 Sep 04 22:51:34 devstack sudo[102829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:34 devstack cinder-volume[87576]: INFO cinder.volume.manager [req-b60642b7-9670-4189-8192-14d6865e8342 req-22e7b68b-2a30-47ab-b8c1-0d42c9e179c8 tempest-AttachVolumeNegativeTest-2019172075 None] Terminate volume connection completed successfully. Sep 04 22:51:34 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-b60642b7-9670-4189-8192-14d6865e8342 req-22e7b68b-2a30-47ab-b8c1-0d42c9e179c8 tempest-AttachVolumeNegativeTest-2019172075 None] Deleting attachment 9e45e118-9468-4724-8749-adbc7e8bbd18. {{(pid=87576) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 22:51:34 devstack sudo[102828]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:34 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-df9a9a15-a82b-491f-9cfe-433e2f14ad5b tempest-TestStampPattern-1034473821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-313d1bd3-92d3-4f1e-808c-876c31543218.134381b4-62a3-4e8a-8a6f-bf9ff18c5f9c" returned: 0 in 0.430s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:34 devstack sudo[102829]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:34 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-df9a9a15-a82b-491f-9cfe-433e2f14ad5b tempest-TestStampPattern-1034473821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-313d1bd3-92d3-4f1e-808c-876c31543218.134381b4-62a3-4e8a-8a6f-bf9ff18c5f9c {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:34 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2af42492-a93d-4d20-b291-cb9617e5f07d tempest-VolumesSnapshotTestJSON-976727453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d284f67c-3754-4d74-a7b0-d9c07a50a170" returned: 0 in 0.421s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:34 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2af42492-a93d-4d20-b291-cb9617e5f07d tempest-VolumesSnapshotTestJSON-976727453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d284f67c-3754-4d74-a7b0-d9c07a50a170 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:34 devstack sudo[102866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-313d1bd3-92d3-4f1e-808c-876c31543218.134381b4-62a3-4e8a-8a6f-bf9ff18c5f9c Sep 04 22:51:34 devstack sudo[102866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:34 devstack sudo[102867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d284f67c-3754-4d74-a7b0-d9c07a50a170 Sep 04 22:51:34 devstack sudo[102867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:34 devstack sudo[102866]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:34 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-df9a9a15-a82b-491f-9cfe-433e2f14ad5b tempest-TestStampPattern-1034473821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-313d1bd3-92d3-4f1e-808c-876c31543218.134381b4-62a3-4e8a-8a6f-bf9ff18c5f9c" returned: 0 in 0.261s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:34 devstack sudo[102867]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:34 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2af42492-a93d-4d20-b291-cb9617e5f07d tempest-VolumesSnapshotTestJSON-976727453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d284f67c-3754-4d74-a7b0-d9c07a50a170" returned: 0 in 0.280s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:34 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-df9a9a15-a82b-491f-9cfe-433e2f14ad5b tempest-TestStampPattern-1034473821 None] Lock "cinder-quobyte-134381b4-62a3-4e8a-8a6f-bf9ff18c5f9c" released by "_delete_snapshot" :: held 1.939s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:51:34 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-2af42492-a93d-4d20-b291-cb9617e5f07d tempest-VolumesSnapshotTestJSON-976727453 None] Lock "cinder-quobyte-d284f67c-3754-4d74-a7b0-d9c07a50a170" released by "delete_volume" :: held 0.791s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:51:34 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-df9a9a15-a82b-491f-9cfe-433e2f14ad5b tempest-TestStampPattern-1034473821 None] Lock "cinder-quobyte-313d1bd3-92d3-4f1e-808c-876c31543218" released by "delete_snapshot" :: held 1.966s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:51:34 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-2af42492-a93d-4d20-b291-cb9617e5f07d tempest-VolumesSnapshotTestJSON-976727453 None] Created reservations ['9c563d3e-665d-49fb-84b4-cf269e08ade5', '2ace1f3e-030a-4cc6-91bd-45b1857d44c5', '86d5bcbd-b238-4887-b6b5-3ddf9e315a20', '0ddece51-c257-47c4-a5b4-0d276da679df'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:51:34 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-df9a9a15-a82b-491f-9cfe-433e2f14ad5b tempest-TestStampPattern-1034473821 None] Created reservations ['873d4595-3c1d-438f-95fd-9b4828840b1b', '54725adc-8503-4516-8e3e-79f5ef211fcc', '225c9a40-3957-4909-917e-772c38cd4e7c', '699e0718-b4fd-4ed0-9f58-fbb25c547105'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:51:34 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-2af42492-a93d-4d20-b291-cb9617e5f07d tempest-VolumesSnapshotTestJSON-976727453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:51:34 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-2af42492-a93d-4d20-b291-cb9617e5f07d tempest-VolumesSnapshotTestJSON-976727453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:51:34 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-2af42492-a93d-4d20-b291-cb9617e5f07d tempest-VolumesSnapshotTestJSON-976727453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:51:34 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-2af42492-a93d-4d20-b291-cb9617e5f07d tempest-VolumesSnapshotTestJSON-976727453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:51:34 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-2af42492-a93d-4d20-b291-cb9617e5f07d tempest-VolumesSnapshotTestJSON-976727453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:51:34 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2af42492-a93d-4d20-b291-cb9617e5f07d tempest-VolumesSnapshotTestJSON-976727453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:34 devstack sudo[102872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:51:34 devstack sudo[102872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:34 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-df9a9a15-a82b-491f-9cfe-433e2f14ad5b tempest-TestStampPattern-1034473821 None] Delete snapshot completed successfully. Sep 04 22:51:34 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-df9a9a15-a82b-491f-9cfe-433e2f14ad5b tempest-TestStampPattern-1034473821 None] Lock "cinder-134381b4-62a3-4e8a-8a6f-bf9ff18c5f9c-delete_snapshot" released by "delete_snapshot" :: held 2.186s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:51:35 devstack sudo[102872]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2af42492-a93d-4d20-b291-cb9617e5f07d tempest-VolumesSnapshotTestJSON-976727453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.301s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:35 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-2af42492-a93d-4d20-b291-cb9617e5f07d tempest-VolumesSnapshotTestJSON-976727453 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:51:35 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-2af42492-a93d-4d20-b291-cb9617e5f07d tempest-VolumesSnapshotTestJSON-976727453 None] Deleted volume successfully. Sep 04 22:51:35 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-2af42492-a93d-4d20-b291-cb9617e5f07d tempest-VolumesSnapshotTestJSON-976727453 None] Lock "cinder-d284f67c-3754-4d74-a7b0-d9c07a50a170-delete_volume" released by "delete_volume" :: held 1.374s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:51:35 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-65be6440-4fe8-4dd8-80f9-d47cee8f6f3a tempest-VolumesSnapshotTestJSON-976727453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:51:35 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-65be6440-4fe8-4dd8-80f9-d47cee8f6f3a tempest-VolumesSnapshotTestJSON-976727453 None] Flow 'volume_create_manager' (ae5dbef1-f129-4439-8bec-b841575d7683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:51:35 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-65be6440-4fe8-4dd8-80f9-d47cee8f6f3a tempest-VolumesSnapshotTestJSON-976727453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9271c52f-cec1-427c-9bdc-6593e90304a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:51:35 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-65be6440-4fe8-4dd8-80f9-d47cee8f6f3a tempest-VolumesSnapshotTestJSON-976727453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9271c52f-cec1-427c-9bdc-6593e90304a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:51:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1497879370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a91df99-b35c-45a4-b6b3-cdcc2bfc145b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46a0ac7ea3b5483892ddadcd1eb1e727',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:51:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:51:36Z,use_quota=True,user_id='99ba67d6476c41c99b05a54ec37b2823',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:51:35 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-65be6440-4fe8-4dd8-80f9-d47cee8f6f3a tempest-VolumesSnapshotTestJSON-976727453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55bb9536-1d16-41aa-8809-811749a67179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:51:35 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-65be6440-4fe8-4dd8-80f9-d47cee8f6f3a tempest-VolumesSnapshotTestJSON-976727453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55bb9536-1d16-41aa-8809-811749a67179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:51:35 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-65be6440-4fe8-4dd8-80f9-d47cee8f6f3a tempest-VolumesSnapshotTestJSON-976727453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fee057d9-feca-4b81-ae20-4b36c8e745ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:51:35 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-65be6440-4fe8-4dd8-80f9-d47cee8f6f3a tempest-VolumesSnapshotTestJSON-976727453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fee057d9-feca-4b81-ae20-4b36c8e745ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a91df99-b35c-45a4-b6b3-cdcc2bfc145b', 'volume_name': 'volume-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:51:35 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-65be6440-4fe8-4dd8-80f9-d47cee8f6f3a tempest-VolumesSnapshotTestJSON-976727453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2aef564-796e-4e9b-9b88-f8ef241940a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:51:35 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-65be6440-4fe8-4dd8-80f9-d47cee8f6f3a tempest-VolumesSnapshotTestJSON-976727453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2aef564-796e-4e9b-9b88-f8ef241940a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:51:35 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-65be6440-4fe8-4dd8-80f9-d47cee8f6f3a tempest-VolumesSnapshotTestJSON-976727453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1119124e-0045-417d-9314-42196020e49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:51:35 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-65be6440-4fe8-4dd8-80f9-d47cee8f6f3a tempest-VolumesSnapshotTestJSON-976727453 None] Volume 5a91df99-b35c-45a4-b6b3-cdcc2bfc145b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b', 'volume_size': 1} Sep 04 22:51:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-65be6440-4fe8-4dd8-80f9-d47cee8f6f3a tempest-VolumesSnapshotTestJSON-976727453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:51:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-65be6440-4fe8-4dd8-80f9-d47cee8f6f3a tempest-VolumesSnapshotTestJSON-976727453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:51:35 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-65be6440-4fe8-4dd8-80f9-d47cee8f6f3a tempest-VolumesSnapshotTestJSON-976727453 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:51:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1497879370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a91df99-b35c-45a4-b6b3-cdcc2bfc145b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46a0ac7ea3b5483892ddadcd1eb1e727',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:51:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:51:36Z,use_quota=True,user_id='99ba67d6476c41c99b05a54ec37b2823',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:51:35 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-65be6440-4fe8-4dd8-80f9-d47cee8f6f3a tempest-VolumesSnapshotTestJSON-976727453 None] Creating volume 5a91df99-b35c-45a4-b6b3-cdcc2bfc145b {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:51:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-65be6440-4fe8-4dd8-80f9-d47cee8f6f3a tempest-VolumesSnapshotTestJSON-976727453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:51:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-65be6440-4fe8-4dd8-80f9-d47cee8f6f3a tempest-VolumesSnapshotTestJSON-976727453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:51:35 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-65be6440-4fe8-4dd8-80f9-d47cee8f6f3a tempest-VolumesSnapshotTestJSON-976727453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:51:35 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-65be6440-4fe8-4dd8-80f9-d47cee8f6f3a tempest-VolumesSnapshotTestJSON-976727453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:51:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-65be6440-4fe8-4dd8-80f9-d47cee8f6f3a tempest-VolumesSnapshotTestJSON-976727453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:51:35 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-65be6440-4fe8-4dd8-80f9-d47cee8f6f3a tempest-VolumesSnapshotTestJSON-976727453 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:51:35 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-65be6440-4fe8-4dd8-80f9-d47cee8f6f3a tempest-VolumesSnapshotTestJSON-976727453 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:51:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-65be6440-4fe8-4dd8-80f9-d47cee8f6f3a tempest-VolumesSnapshotTestJSON-976727453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:35 devstack sudo[102894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b 1073741824 Sep 04 22:51:35 devstack sudo[102894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:36 devstack sudo[102894]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-65be6440-4fe8-4dd8-80f9-d47cee8f6f3a tempest-VolumesSnapshotTestJSON-976727453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b 1073741824" returned: 0 in 0.536s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-65be6440-4fe8-4dd8-80f9-d47cee8f6f3a tempest-VolumesSnapshotTestJSON-976727453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:36 devstack sudo[102900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b Sep 04 22:51:36 devstack sudo[102900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:36 devstack sudo[102900]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-65be6440-4fe8-4dd8-80f9-d47cee8f6f3a tempest-VolumesSnapshotTestJSON-976727453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b" returned: 0 in 0.293s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:36 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-65be6440-4fe8-4dd8-80f9-d47cee8f6f3a tempest-VolumesSnapshotTestJSON-976727453 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:51:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-65be6440-4fe8-4dd8-80f9-d47cee8f6f3a tempest-VolumesSnapshotTestJSON-976727453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:51:36 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-65be6440-4fe8-4dd8-80f9-d47cee8f6f3a tempest-VolumesSnapshotTestJSON-976727453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1119124e-0045-417d-9314-42196020e49e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:51:36 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-65be6440-4fe8-4dd8-80f9-d47cee8f6f3a tempest-VolumesSnapshotTestJSON-976727453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93aa4463-8e26-4b4e-8e49-55b5077e5320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:51:36 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-65be6440-4fe8-4dd8-80f9-d47cee8f6f3a tempest-VolumesSnapshotTestJSON-976727453 None] Volume volume-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b (5a91df99-b35c-45a4-b6b3-cdcc2bfc145b): created successfully Sep 04 22:51:36 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-65be6440-4fe8-4dd8-80f9-d47cee8f6f3a tempest-VolumesSnapshotTestJSON-976727453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93aa4463-8e26-4b4e-8e49-55b5077e5320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:51:36 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-65be6440-4fe8-4dd8-80f9-d47cee8f6f3a tempest-VolumesSnapshotTestJSON-976727453 None] Flow 'volume_create_manager' (ae5dbef1-f129-4439-8bec-b841575d7683) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:51:36 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-65be6440-4fe8-4dd8-80f9-d47cee8f6f3a tempest-VolumesSnapshotTestJSON-976727453 None] Created volume successfully. Sep 04 22:51:38 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-ca85eb2d-bf91-4dd9-8860-2515fa794e63 tempest-VolumesSnapshotTestJSON-976727453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:51:38 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-ca85eb2d-bf91-4dd9-8860-2515fa794e63 tempest-VolumesSnapshotTestJSON-976727453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:51:38 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-ca85eb2d-bf91-4dd9-8860-2515fa794e63 tempest-VolumesSnapshotTestJSON-976727453 None] Creating offline snapshot a1b367eb-b055-4550-b270-5d7fcea987d9 of volume 5a91df99-b35c-45a4-b6b3-cdcc2bfc145b {{(pid=87576) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 22:51:38 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3704de-5984-49d9-bf4b-7a86ca0ff87b]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:51:38 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ca85eb2d-bf91-4dd9-8860-2515fa794e63 tempest-VolumesSnapshotTestJSON-976727453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:38 devstack sudo[102929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b Sep 04 22:51:38 devstack sudo[102929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:38 devstack sudo[102929]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:38 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ca85eb2d-bf91-4dd9-8860-2515fa794e63 tempest-VolumesSnapshotTestJSON-976727453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b" returned: 0 in 0.439s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:38 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ca85eb2d-bf91-4dd9-8860-2515fa794e63 tempest-VolumesSnapshotTestJSON-976727453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b.a1b367eb-b055-4550-b270-5d7fcea987d9 1G {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:38 devstack sudo[102935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b.a1b367eb-b055-4550-b270-5d7fcea987d9 1G Sep 04 22:51:38 devstack sudo[102935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:39 devstack sudo[102935]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ca85eb2d-bf91-4dd9-8860-2515fa794e63 tempest-VolumesSnapshotTestJSON-976727453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b.a1b367eb-b055-4550-b270-5d7fcea987d9 1G" returned: 0 in 0.554s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ca85eb2d-bf91-4dd9-8860-2515fa794e63 tempest-VolumesSnapshotTestJSON-976727453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b.a1b367eb-b055-4550-b270-5d7fcea987d9 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:39 devstack sudo[102943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b.a1b367eb-b055-4550-b270-5d7fcea987d9 Sep 04 22:51:39 devstack sudo[102943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:39 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-bf670136-c801-4d08-9dad-1061c0a8d6cc tempest-AttachVolumeNegativeTest-2019172075 None] Acquiring lock "cinder-d1e4e595-c0e1-4a1e-974e-1d5063e1c5b2-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:51:39 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-bf670136-c801-4d08-9dad-1061c0a8d6cc tempest-AttachVolumeNegativeTest-2019172075 None] Lock "cinder-d1e4e595-c0e1-4a1e-974e-1d5063e1c5b2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:51:39 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-bf670136-c801-4d08-9dad-1061c0a8d6cc tempest-AttachVolumeNegativeTest-2019172075 None] Acquiring lock "cinder-quobyte-d1e4e595-c0e1-4a1e-974e-1d5063e1c5b2" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:51:39 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-bf670136-c801-4d08-9dad-1061c0a8d6cc tempest-AttachVolumeNegativeTest-2019172075 None] Lock "cinder-quobyte-d1e4e595-c0e1-4a1e-974e-1d5063e1c5b2" acquired by "delete_volume" :: waited 0.022s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:51:39 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb0c3a7-f8bc-4577-a483-29c9d1111b73]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:51:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-bf670136-c801-4d08-9dad-1061c0a8d6cc tempest-AttachVolumeNegativeTest-2019172075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d1e4e595-c0e1-4a1e-974e-1d5063e1c5b2 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:39 devstack sudo[102943]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:39 devstack sudo[102947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d1e4e595-c0e1-4a1e-974e-1d5063e1c5b2 Sep 04 22:51:39 devstack sudo[102947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ca85eb2d-bf91-4dd9-8860-2515fa794e63 tempest-VolumesSnapshotTestJSON-976727453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b.a1b367eb-b055-4550-b270-5d7fcea987d9" returned: 0 in 0.367s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:39 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-ca85eb2d-bf91-4dd9-8860-2515fa794e63 tempest-VolumesSnapshotTestJSON-976727453 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b.a1b367eb-b055-4550-b270-5d7fcea987d9 is being set with open permissions: ugo+rw Sep 04 22:51:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ca85eb2d-bf91-4dd9-8860-2515fa794e63 tempest-VolumesSnapshotTestJSON-976727453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b.a1b367eb-b055-4550-b270-5d7fcea987d9 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:39 devstack sudo[102951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b.a1b367eb-b055-4550-b270-5d7fcea987d9 Sep 04 22:51:39 devstack sudo[102951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:39 devstack sudo[102951]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ca85eb2d-bf91-4dd9-8860-2515fa794e63 tempest-VolumesSnapshotTestJSON-976727453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b.a1b367eb-b055-4550-b270-5d7fcea987d9" returned: 0 in 0.253s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:39 devstack sudo[102947]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-bf670136-c801-4d08-9dad-1061c0a8d6cc tempest-AttachVolumeNegativeTest-2019172075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d1e4e595-c0e1-4a1e-974e-1d5063e1c5b2" returned: 0 in 0.394s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-bf670136-c801-4d08-9dad-1061c0a8d6cc tempest-AttachVolumeNegativeTest-2019172075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d1e4e595-c0e1-4a1e-974e-1d5063e1c5b2 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ca85eb2d-bf91-4dd9-8860-2515fa794e63 tempest-VolumesSnapshotTestJSON-976727453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:39 devstack sudo[102957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d1e4e595-c0e1-4a1e-974e-1d5063e1c5b2 Sep 04 22:51:39 devstack sudo[102957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:39 devstack sudo[102959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b.info Sep 04 22:51:39 devstack sudo[102959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:39 devstack sudo[102957]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-bf670136-c801-4d08-9dad-1061c0a8d6cc tempest-AttachVolumeNegativeTest-2019172075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d1e4e595-c0e1-4a1e-974e-1d5063e1c5b2" returned: 0 in 0.255s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:39 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-bf670136-c801-4d08-9dad-1061c0a8d6cc tempest-AttachVolumeNegativeTest-2019172075 None] Lock "cinder-quobyte-d1e4e595-c0e1-4a1e-974e-1d5063e1c5b2" released by "delete_volume" :: held 0.697s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:51:39 devstack sudo[102959]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ca85eb2d-bf91-4dd9-8860-2515fa794e63 tempest-VolumesSnapshotTestJSON-976727453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b.info" returned: 0 in 0.266s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:39 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-ca85eb2d-bf91-4dd9-8860-2515fa794e63 tempest-VolumesSnapshotTestJSON-976727453 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b.info is being set with open permissions: ugo+rw Sep 04 22:51:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ca85eb2d-bf91-4dd9-8860-2515fa794e63 tempest-VolumesSnapshotTestJSON-976727453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:40 devstack sudo[102963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b.info Sep 04 22:51:40 devstack sudo[102963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:40 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-bf670136-c801-4d08-9dad-1061c0a8d6cc tempest-AttachVolumeNegativeTest-2019172075 None] Created reservations ['2de52a82-99ec-4dab-bf8c-31c2af3e8c6e', '1dddab2b-5a7a-40a1-a87e-75e166988b8a', 'b5c33b64-9a75-4b73-967c-d9e958a1834e', '86226994-3764-4de8-9287-d2965b41a62a'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:51:40 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f978524f-6fd2-4190-a208-434165e38da4 tempest-TestStampPattern-1034473821 None] Acquiring lock "cinder-313d1bd3-92d3-4f1e-808c-876c31543218-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:51:40 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f978524f-6fd2-4190-a208-434165e38da4 tempest-TestStampPattern-1034473821 None] Lock "cinder-313d1bd3-92d3-4f1e-808c-876c31543218-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:51:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-bf670136-c801-4d08-9dad-1061c0a8d6cc tempest-AttachVolumeNegativeTest-2019172075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:51:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-bf670136-c801-4d08-9dad-1061c0a8d6cc tempest-AttachVolumeNegativeTest-2019172075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:51:40 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-bf670136-c801-4d08-9dad-1061c0a8d6cc tempest-AttachVolumeNegativeTest-2019172075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:51:40 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-bf670136-c801-4d08-9dad-1061c0a8d6cc tempest-AttachVolumeNegativeTest-2019172075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:51:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-bf670136-c801-4d08-9dad-1061c0a8d6cc tempest-AttachVolumeNegativeTest-2019172075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:51:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-bf670136-c801-4d08-9dad-1061c0a8d6cc tempest-AttachVolumeNegativeTest-2019172075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:40 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f978524f-6fd2-4190-a208-434165e38da4 tempest-TestStampPattern-1034473821 None] Acquiring lock "cinder-quobyte-313d1bd3-92d3-4f1e-808c-876c31543218" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:51:40 devstack sudo[102965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:51:40 devstack sudo[102965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:40 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f978524f-6fd2-4190-a208-434165e38da4 tempest-TestStampPattern-1034473821 None] Lock "cinder-quobyte-313d1bd3-92d3-4f1e-808c-876c31543218" acquired by "delete_volume" :: waited 0.020s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:51:40 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8e3d75-331b-42c2-9eca-46258ab94885]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:51:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f978524f-6fd2-4190-a208-434165e38da4 tempest-TestStampPattern-1034473821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-313d1bd3-92d3-4f1e-808c-876c31543218 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:40 devstack sudo[102963]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ca85eb2d-bf91-4dd9-8860-2515fa794e63 tempest-VolumesSnapshotTestJSON-976727453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b.info" returned: 0 in 0.332s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-ca85eb2d-bf91-4dd9-8860-2515fa794e63 tempest-VolumesSnapshotTestJSON-976727453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.317s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:51:40 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-ca85eb2d-bf91-4dd9-8860-2515fa794e63 tempest-VolumesSnapshotTestJSON-976727453 None] Create snapshot completed successfully Sep 04 22:51:40 devstack sudo[102968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-313d1bd3-92d3-4f1e-808c-876c31543218 Sep 04 22:51:40 devstack sudo[102968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:40 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d2a1b4b3-0c62-4112-b37d-f19f3ea3de29 tempest-AttachVolumeNegativeTest-2019172075 None] Acquiring lock "cinder-0e6bccb7-98f0-40e3-a7a3-53760138abbd-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:51:40 devstack sudo[102965]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-bf670136-c801-4d08-9dad-1061c0a8d6cc tempest-AttachVolumeNegativeTest-2019172075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.296s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:40 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-bf670136-c801-4d08-9dad-1061c0a8d6cc tempest-AttachVolumeNegativeTest-2019172075 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:51:40 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-bf670136-c801-4d08-9dad-1061c0a8d6cc tempest-AttachVolumeNegativeTest-2019172075 None] Deleted volume successfully. Sep 04 22:51:40 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d2a1b4b3-0c62-4112-b37d-f19f3ea3de29 tempest-AttachVolumeNegativeTest-2019172075 None] Lock "cinder-0e6bccb7-98f0-40e3-a7a3-53760138abbd-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:51:40 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-bf670136-c801-4d08-9dad-1061c0a8d6cc tempest-AttachVolumeNegativeTest-2019172075 None] Lock "cinder-d1e4e595-c0e1-4a1e-974e-1d5063e1c5b2-delete_volume" released by "delete_volume" :: held 1.342s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:51:40 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d2a1b4b3-0c62-4112-b37d-f19f3ea3de29 tempest-AttachVolumeNegativeTest-2019172075 None] Acquiring lock "cinder-quobyte-0e6bccb7-98f0-40e3-a7a3-53760138abbd" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:51:40 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d2a1b4b3-0c62-4112-b37d-f19f3ea3de29 tempest-AttachVolumeNegativeTest-2019172075 None] Lock "cinder-quobyte-0e6bccb7-98f0-40e3-a7a3-53760138abbd" acquired by "delete_volume" :: waited 0.016s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:51:40 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9b8606-f72c-4c86-8b04-c673f0337552]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:51:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d2a1b4b3-0c62-4112-b37d-f19f3ea3de29 tempest-AttachVolumeNegativeTest-2019172075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-0e6bccb7-98f0-40e3-a7a3-53760138abbd {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:40 devstack sudo[102968]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f978524f-6fd2-4190-a208-434165e38da4 tempest-TestStampPattern-1034473821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-313d1bd3-92d3-4f1e-808c-876c31543218" returned: 0 in 0.437s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f978524f-6fd2-4190-a208-434165e38da4 tempest-TestStampPattern-1034473821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-313d1bd3-92d3-4f1e-808c-876c31543218 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:40 devstack sudo[102971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-0e6bccb7-98f0-40e3-a7a3-53760138abbd Sep 04 22:51:40 devstack sudo[102971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:40 devstack sudo[102976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-313d1bd3-92d3-4f1e-808c-876c31543218 Sep 04 22:51:40 devstack sudo[102976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:40 devstack sudo[102971]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d2a1b4b3-0c62-4112-b37d-f19f3ea3de29 tempest-AttachVolumeNegativeTest-2019172075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-0e6bccb7-98f0-40e3-a7a3-53760138abbd" returned: 0 in 0.375s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d2a1b4b3-0c62-4112-b37d-f19f3ea3de29 tempest-AttachVolumeNegativeTest-2019172075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-0e6bccb7-98f0-40e3-a7a3-53760138abbd {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:40 devstack sudo[102976]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f978524f-6fd2-4190-a208-434165e38da4 tempest-TestStampPattern-1034473821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-313d1bd3-92d3-4f1e-808c-876c31543218" returned: 0 in 0.272s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:41 devstack sudo[102982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-0e6bccb7-98f0-40e3-a7a3-53760138abbd Sep 04 22:51:41 devstack sudo[102982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:41 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f978524f-6fd2-4190-a208-434165e38da4 tempest-TestStampPattern-1034473821 None] Lock "cinder-quobyte-313d1bd3-92d3-4f1e-808c-876c31543218" released by "delete_volume" :: held 0.783s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:51:41 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-f978524f-6fd2-4190-a208-434165e38da4 tempest-TestStampPattern-1034473821 None] Created reservations ['bfe578eb-5fe5-4f22-ab6e-ee83f7425ecc', '6cd08d7e-db33-4048-8120-490d753b04c8', '05c09910-1922-4c5b-899b-3b0fd3bf7823', '36163245-d913-4f70-9b11-20aa07202668'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:51:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f978524f-6fd2-4190-a208-434165e38da4 tempest-TestStampPattern-1034473821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:51:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f978524f-6fd2-4190-a208-434165e38da4 tempest-TestStampPattern-1034473821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:51:41 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-f978524f-6fd2-4190-a208-434165e38da4 tempest-TestStampPattern-1034473821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:51:41 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-f978524f-6fd2-4190-a208-434165e38da4 tempest-TestStampPattern-1034473821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:51:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f978524f-6fd2-4190-a208-434165e38da4 tempest-TestStampPattern-1034473821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:51:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f978524f-6fd2-4190-a208-434165e38da4 tempest-TestStampPattern-1034473821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:41 devstack sudo[102984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:51:41 devstack sudo[102984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:41 devstack sudo[102982]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d2a1b4b3-0c62-4112-b37d-f19f3ea3de29 tempest-AttachVolumeNegativeTest-2019172075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-0e6bccb7-98f0-40e3-a7a3-53760138abbd" returned: 0 in 0.297s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:41 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d2a1b4b3-0c62-4112-b37d-f19f3ea3de29 tempest-AttachVolumeNegativeTest-2019172075 None] Lock "cinder-quobyte-0e6bccb7-98f0-40e3-a7a3-53760138abbd" released by "delete_volume" :: held 0.725s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:51:41 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-d2a1b4b3-0c62-4112-b37d-f19f3ea3de29 tempest-AttachVolumeNegativeTest-2019172075 None] Created reservations ['e2892c60-79e5-44fb-a4d2-e3ec651157cc', '72f6e2b2-f6ca-4ae8-8c04-dfcac9eac18e', '34b0dfe3-d6ac-48b2-96d5-1f5f925c05c0', '1b57babf-6b17-468c-8911-3cfc9e9c7ed1'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:51:41 devstack sudo[102984]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f978524f-6fd2-4190-a208-434165e38da4 tempest-TestStampPattern-1034473821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.278s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:41 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-f978524f-6fd2-4190-a208-434165e38da4 tempest-TestStampPattern-1034473821 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:51:41 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-f978524f-6fd2-4190-a208-434165e38da4 tempest-TestStampPattern-1034473821 None] Deleted volume successfully. Sep 04 22:51:41 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f978524f-6fd2-4190-a208-434165e38da4 tempest-TestStampPattern-1034473821 None] Lock "cinder-313d1bd3-92d3-4f1e-808c-876c31543218-delete_volume" released by "delete_volume" :: held 1.323s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:51:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-d2a1b4b3-0c62-4112-b37d-f19f3ea3de29 tempest-AttachVolumeNegativeTest-2019172075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:51:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-d2a1b4b3-0c62-4112-b37d-f19f3ea3de29 tempest-AttachVolumeNegativeTest-2019172075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:51:41 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-d2a1b4b3-0c62-4112-b37d-f19f3ea3de29 tempest-AttachVolumeNegativeTest-2019172075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:51:41 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-d2a1b4b3-0c62-4112-b37d-f19f3ea3de29 tempest-AttachVolumeNegativeTest-2019172075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:51:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-d2a1b4b3-0c62-4112-b37d-f19f3ea3de29 tempest-AttachVolumeNegativeTest-2019172075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:51:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d2a1b4b3-0c62-4112-b37d-f19f3ea3de29 tempest-AttachVolumeNegativeTest-2019172075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:41 devstack sudo[102988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:51:41 devstack sudo[102988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:41 devstack sudo[102988]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d2a1b4b3-0c62-4112-b37d-f19f3ea3de29 tempest-AttachVolumeNegativeTest-2019172075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.390s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:41 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-d2a1b4b3-0c62-4112-b37d-f19f3ea3de29 tempest-AttachVolumeNegativeTest-2019172075 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:51:41 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-d2a1b4b3-0c62-4112-b37d-f19f3ea3de29 tempest-AttachVolumeNegativeTest-2019172075 None] Deleted volume successfully. Sep 04 22:51:41 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d2a1b4b3-0c62-4112-b37d-f19f3ea3de29 tempest-AttachVolumeNegativeTest-2019172075 None] Lock "cinder-0e6bccb7-98f0-40e3-a7a3-53760138abbd-delete_volume" released by "delete_volume" :: held 1.437s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:51:41 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-90e86c9d-a8d2-428a-8ab6-794be6b91fdd tempest-VolumesSnapshotTestJSON-976727453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:51:41 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-717cc48f-5e2c-49da-86d8-42a1a91d92e7 tempest-AttachVolumeNegativeTest-2019172075 None] Acquiring lock "cinder-d4658efb-31d0-45d7-9e39-16fb47aeb69b-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:51:42 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-90e86c9d-a8d2-428a-8ab6-794be6b91fdd tempest-VolumesSnapshotTestJSON-976727453 None] Flow 'volume_create_manager' (b29313ef-6fe5-4b2d-b3f8-76b3b3a1d769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:51:42 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-90e86c9d-a8d2-428a-8ab6-794be6b91fdd tempest-VolumesSnapshotTestJSON-976727453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88c8d15c-91f9-412b-a9a5-d63877c5195a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:51:42 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-90e86c9d-a8d2-428a-8ab6-794be6b91fdd tempest-VolumesSnapshotTestJSON-976727453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88c8d15c-91f9-412b-a9a5-d63877c5195a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:51:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-182313594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=741ae241-0037-4ba6-8da5-1b64c573f699,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46a0ac7ea3b5483892ddadcd1eb1e727',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:51:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a1b367eb-b055-4550-b270-5d7fcea987d9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:51:42Z,use_quota=True,user_id='99ba67d6476c41c99b05a54ec37b2823',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:51:42 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-90e86c9d-a8d2-428a-8ab6-794be6b91fdd tempest-VolumesSnapshotTestJSON-976727453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9197161-f8a4-45c4-99bb-e1ceb0307bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:51:42 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-90e86c9d-a8d2-428a-8ab6-794be6b91fdd tempest-VolumesSnapshotTestJSON-976727453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9197161-f8a4-45c4-99bb-e1ceb0307bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:51:42 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-90e86c9d-a8d2-428a-8ab6-794be6b91fdd tempest-VolumesSnapshotTestJSON-976727453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3973cef3-0aa7-4272-bfd4-0b2f0d3edbc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:51:42 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-90e86c9d-a8d2-428a-8ab6-794be6b91fdd tempest-VolumesSnapshotTestJSON-976727453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3973cef3-0aa7-4272-bfd4-0b2f0d3edbc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '741ae241-0037-4ba6-8da5-1b64c573f699', 'volume_name': 'volume-741ae241-0037-4ba6-8da5-1b64c573f699', 'volume_size': 1, 'snapshot_id': 'a1b367eb-b055-4550-b270-5d7fcea987d9'}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:51:42 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-90e86c9d-a8d2-428a-8ab6-794be6b91fdd tempest-VolumesSnapshotTestJSON-976727453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b4b31dc-6bb8-4d65-8277-a1e2c643a89f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:51:42 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-90e86c9d-a8d2-428a-8ab6-794be6b91fdd tempest-VolumesSnapshotTestJSON-976727453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b4b31dc-6bb8-4d65-8277-a1e2c643a89f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:51:42 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-90e86c9d-a8d2-428a-8ab6-794be6b91fdd tempest-VolumesSnapshotTestJSON-976727453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8a34884-f5c4-470a-b4cc-c55769a00fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:51:42 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-90e86c9d-a8d2-428a-8ab6-794be6b91fdd tempest-VolumesSnapshotTestJSON-976727453 None] Volume 741ae241-0037-4ba6-8da5-1b64c573f699: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-741ae241-0037-4ba6-8da5-1b64c573f699', 'volume_size': 1, 'snapshot_id': 'a1b367eb-b055-4550-b270-5d7fcea987d9'} Sep 04 22:51:42 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-717cc48f-5e2c-49da-86d8-42a1a91d92e7 tempest-AttachVolumeNegativeTest-2019172075 None] Lock "cinder-d4658efb-31d0-45d7-9e39-16fb47aeb69b-delete_volume" acquired by "delete_volume" :: waited 0.105s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:51:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-90e86c9d-a8d2-428a-8ab6-794be6b91fdd tempest-VolumesSnapshotTestJSON-976727453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:51:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-90e86c9d-a8d2-428a-8ab6-794be6b91fdd tempest-VolumesSnapshotTestJSON-976727453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:51:42 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-90e86c9d-a8d2-428a-8ab6-794be6b91fdd tempest-VolumesSnapshotTestJSON-976727453 None] Acquiring lock "cinder-quobyte-a1b367eb-b055-4550-b270-5d7fcea987d9-741ae241-0037-4ba6-8da5-1b64c573f699" by "_create_volume_from_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:51:42 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-90e86c9d-a8d2-428a-8ab6-794be6b91fdd tempest-VolumesSnapshotTestJSON-976727453 None] Lock "cinder-quobyte-a1b367eb-b055-4550-b270-5d7fcea987d9-741ae241-0037-4ba6-8da5-1b64c573f699" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:51:42 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-90e86c9d-a8d2-428a-8ab6-794be6b91fdd tempest-VolumesSnapshotTestJSON-976727453 None] Creating volume 741ae241-0037-4ba6-8da5-1b64c573f699 from snapshot a1b367eb-b055-4550-b270-5d7fcea987d9 {{(pid=87576) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 04 22:51:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-90e86c9d-a8d2-428a-8ab6-794be6b91fdd tempest-VolumesSnapshotTestJSON-976727453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:51:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-90e86c9d-a8d2-428a-8ab6-794be6b91fdd tempest-VolumesSnapshotTestJSON-976727453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:51:42 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-90e86c9d-a8d2-428a-8ab6-794be6b91fdd tempest-VolumesSnapshotTestJSON-976727453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:51:42 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-90e86c9d-a8d2-428a-8ab6-794be6b91fdd tempest-VolumesSnapshotTestJSON-976727453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:51:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-90e86c9d-a8d2-428a-8ab6-794be6b91fdd tempest-VolumesSnapshotTestJSON-976727453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:51:42 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-90e86c9d-a8d2-428a-8ab6-794be6b91fdd tempest-VolumesSnapshotTestJSON-976727453 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:51:42 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-90e86c9d-a8d2-428a-8ab6-794be6b91fdd tempest-VolumesSnapshotTestJSON-976727453 None] Acquiring lock "cinder-quobyte-741ae241-0037-4ba6-8da5-1b64c573f699" by "_copy_volume_from_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:51:42 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-717cc48f-5e2c-49da-86d8-42a1a91d92e7 tempest-AttachVolumeNegativeTest-2019172075 None] Acquiring lock "cinder-quobyte-d4658efb-31d0-45d7-9e39-16fb47aeb69b" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:51:42 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-90e86c9d-a8d2-428a-8ab6-794be6b91fdd tempest-VolumesSnapshotTestJSON-976727453 None] Lock "cinder-quobyte-741ae241-0037-4ba6-8da5-1b64c573f699" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:51:42 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-90e86c9d-a8d2-428a-8ab6-794be6b91fdd tempest-VolumesSnapshotTestJSON-976727453 None] snapshot: a1b367eb-b055-4550-b270-5d7fcea987d9, volume: 741ae241-0037-4ba6-8da5-1b64c573f699, {{(pid=87576) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 04 22:51:42 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-717cc48f-5e2c-49da-86d8-42a1a91d92e7 tempest-AttachVolumeNegativeTest-2019172075 None] Lock "cinder-quobyte-d4658efb-31d0-45d7-9e39-16fb47aeb69b" acquired by "delete_volume" :: waited 0.026s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:51:42 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99d756e-1e2e-404d-a942-62c6e55925a3]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:51:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-717cc48f-5e2c-49da-86d8-42a1a91d92e7 tempest-AttachVolumeNegativeTest-2019172075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d4658efb-31d0-45d7-9e39-16fb47aeb69b {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-90e86c9d-a8d2-428a-8ab6-794be6b91fdd tempest-VolumesSnapshotTestJSON-976727453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:51:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-90e86c9d-a8d2-428a-8ab6-794be6b91fdd tempest-VolumesSnapshotTestJSON-976727453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:51:42 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-90e86c9d-a8d2-428a-8ab6-794be6b91fdd tempest-VolumesSnapshotTestJSON-976727453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:51:42 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-90e86c9d-a8d2-428a-8ab6-794be6b91fdd tempest-VolumesSnapshotTestJSON-976727453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:51:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-90e86c9d-a8d2-428a-8ab6-794be6b91fdd tempest-VolumesSnapshotTestJSON-976727453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:51:42 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d7f4e6-ef87-4e51-85e5-9d169ccf45cd]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:51:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-90e86c9d-a8d2-428a-8ab6-794be6b91fdd tempest-VolumesSnapshotTestJSON-976727453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b.a1b367eb-b055-4550-b270-5d7fcea987d9 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:42 devstack sudo[102991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d4658efb-31d0-45d7-9e39-16fb47aeb69b Sep 04 22:51:42 devstack sudo[102991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:42 devstack sudo[102992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b.a1b367eb-b055-4550-b270-5d7fcea987d9 Sep 04 22:51:42 devstack sudo[102992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:42 devstack sudo[102991]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-717cc48f-5e2c-49da-86d8-42a1a91d92e7 tempest-AttachVolumeNegativeTest-2019172075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d4658efb-31d0-45d7-9e39-16fb47aeb69b" returned: 0 in 0.402s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-717cc48f-5e2c-49da-86d8-42a1a91d92e7 tempest-AttachVolumeNegativeTest-2019172075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d4658efb-31d0-45d7-9e39-16fb47aeb69b {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:42 devstack sudo[103000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d4658efb-31d0-45d7-9e39-16fb47aeb69b Sep 04 22:51:42 devstack sudo[103000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:42 devstack sudo[102992]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-90e86c9d-a8d2-428a-8ab6-794be6b91fdd tempest-VolumesSnapshotTestJSON-976727453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b.a1b367eb-b055-4550-b270-5d7fcea987d9" returned: 0 in 0.413s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:42 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-90e86c9d-a8d2-428a-8ab6-794be6b91fdd tempest-VolumesSnapshotTestJSON-976727453 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 22:51:42 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf5085e-d72e-4904-9bcf-ffe3f5685afb]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:51:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-90e86c9d-a8d2-428a-8ab6-794be6b91fdd tempest-VolumesSnapshotTestJSON-976727453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:42 devstack sudo[103003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b Sep 04 22:51:42 devstack sudo[103003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:42 devstack sudo[103000]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-717cc48f-5e2c-49da-86d8-42a1a91d92e7 tempest-AttachVolumeNegativeTest-2019172075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d4658efb-31d0-45d7-9e39-16fb47aeb69b" returned: 0 in 0.305s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:42 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-717cc48f-5e2c-49da-86d8-42a1a91d92e7 tempest-AttachVolumeNegativeTest-2019172075 None] Lock "cinder-quobyte-d4658efb-31d0-45d7-9e39-16fb47aeb69b" released by "delete_volume" :: held 0.767s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:51:43 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-717cc48f-5e2c-49da-86d8-42a1a91d92e7 tempest-AttachVolumeNegativeTest-2019172075 None] Created reservations ['50a92ca5-f0ed-4252-a0a7-7aa4c713e369', '95bf052c-531d-4ae9-bb29-7d7e27d61303', 'c62c69ad-9fd8-47a9-b688-3cf0eb5f5310', 'b6eb099a-fac4-4610-9a55-a1ad8b9f9281'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:51:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-717cc48f-5e2c-49da-86d8-42a1a91d92e7 tempest-AttachVolumeNegativeTest-2019172075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:51:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-717cc48f-5e2c-49da-86d8-42a1a91d92e7 tempest-AttachVolumeNegativeTest-2019172075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:51:43 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-717cc48f-5e2c-49da-86d8-42a1a91d92e7 tempest-AttachVolumeNegativeTest-2019172075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:51:43 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-717cc48f-5e2c-49da-86d8-42a1a91d92e7 tempest-AttachVolumeNegativeTest-2019172075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:51:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-717cc48f-5e2c-49da-86d8-42a1a91d92e7 tempest-AttachVolumeNegativeTest-2019172075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:51:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-717cc48f-5e2c-49da-86d8-42a1a91d92e7 tempest-AttachVolumeNegativeTest-2019172075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:43 devstack sudo[103010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:51:43 devstack sudo[103010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:43 devstack sudo[103003]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-90e86c9d-a8d2-428a-8ab6-794be6b91fdd tempest-VolumesSnapshotTestJSON-976727453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b" returned: 0 in 0.441s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:43 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-90e86c9d-a8d2-428a-8ab6-794be6b91fdd tempest-VolumesSnapshotTestJSON-976727453 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b {{(pid=87576) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 04 22:51:43 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-90e86c9d-a8d2-428a-8ab6-794be6b91fdd tempest-VolumesSnapshotTestJSON-976727453 None] Creating direct copy from snapshot {{(pid=87576) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 04 22:51:43 devstack cinder-volume[87576]: DEBUG cinder.utils [None req-90e86c9d-a8d2-428a-8ab6-794be6b91fdd tempest-VolumesSnapshotTestJSON-976727453 None] Path /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-741ae241-0037-4ba6-8da5-1b64c573f699 not found in is_blk_device check {{(pid=87576) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 04 22:51:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-90e86c9d-a8d2-428a-8ab6-794be6b91fdd tempest-VolumesSnapshotTestJSON-976727453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-741ae241-0037-4ba6-8da5-1b64c573f699 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:43 devstack sudo[103012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-741ae241-0037-4ba6-8da5-1b64c573f699 Sep 04 22:51:43 devstack sudo[103012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:43 devstack sudo[103010]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-717cc48f-5e2c-49da-86d8-42a1a91d92e7 tempest-AttachVolumeNegativeTest-2019172075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.299s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:43 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-717cc48f-5e2c-49da-86d8-42a1a91d92e7 tempest-AttachVolumeNegativeTest-2019172075 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:51:43 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-717cc48f-5e2c-49da-86d8-42a1a91d92e7 tempest-AttachVolumeNegativeTest-2019172075 None] Deleted volume successfully. Sep 04 22:51:43 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-717cc48f-5e2c-49da-86d8-42a1a91d92e7 tempest-AttachVolumeNegativeTest-2019172075 None] Lock "cinder-d4658efb-31d0-45d7-9e39-16fb47aeb69b-delete_volume" released by "delete_volume" :: held 1.362s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:51:48 devstack sudo[103012]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:48 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-90e86c9d-a8d2-428a-8ab6-794be6b91fdd tempest-VolumesSnapshotTestJSON-976727453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-741ae241-0037-4ba6-8da5-1b64c573f699" returned: 0 in 5.491s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:48 devstack cinder-volume[87576]: DEBUG cinder.image.image_utils [None req-90e86c9d-a8d2-428a-8ab6-794be6b91fdd tempest-VolumesSnapshotTestJSON-976727453 None] Image conversion details: src /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b, size 1024.00 MB, duration 5.49 sec, destination /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-741ae241-0037-4ba6-8da5-1b64c573f699 {{(pid=87576) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 22:51:48 devstack cinder-volume[87576]: INFO cinder.image.image_utils [None req-90e86c9d-a8d2-428a-8ab6-794be6b91fdd tempest-VolumesSnapshotTestJSON-976727453 None] Converted 1024.00 MB image at 186.44 MB/s Sep 04 22:51:48 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-90e86c9d-a8d2-428a-8ab6-794be6b91fdd tempest-VolumesSnapshotTestJSON-976727453 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-741ae241-0037-4ba6-8da5-1b64c573f699 is being set with open permissions: ugo+rw Sep 04 22:51:48 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-90e86c9d-a8d2-428a-8ab6-794be6b91fdd tempest-VolumesSnapshotTestJSON-976727453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-741ae241-0037-4ba6-8da5-1b64c573f699 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:48 devstack sudo[103038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-741ae241-0037-4ba6-8da5-1b64c573f699 Sep 04 22:51:48 devstack sudo[103038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:48 devstack sudo[103038]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:48 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-90e86c9d-a8d2-428a-8ab6-794be6b91fdd tempest-VolumesSnapshotTestJSON-976727453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-741ae241-0037-4ba6-8da5-1b64c573f699" returned: 0 in 0.313s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:49 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-90e86c9d-a8d2-428a-8ab6-794be6b91fdd tempest-VolumesSnapshotTestJSON-976727453 None] Lock "cinder-quobyte-741ae241-0037-4ba6-8da5-1b64c573f699" released by "_copy_volume_from_snapshot" :: held 6.817s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:51:49 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-90e86c9d-a8d2-428a-8ab6-794be6b91fdd tempest-VolumesSnapshotTestJSON-976727453 None] Lock "cinder-quobyte-a1b367eb-b055-4550-b270-5d7fcea987d9-741ae241-0037-4ba6-8da5-1b64c573f699" released by "_create_volume_from_snapshot" :: held 6.900s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:51:49 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-90e86c9d-a8d2-428a-8ab6-794be6b91fdd tempest-VolumesSnapshotTestJSON-976727453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.932s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:51:49 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-90e86c9d-a8d2-428a-8ab6-794be6b91fdd tempest-VolumesSnapshotTestJSON-976727453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8a34884-f5c4-470a-b4cc-c55769a00fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-741ae241-0037-4ba6-8da5-1b64c573f699', 'volume_size': 1, 'snapshot_id': 'a1b367eb-b055-4550-b270-5d7fcea987d9'}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:51:49 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-90e86c9d-a8d2-428a-8ab6-794be6b91fdd tempest-VolumesSnapshotTestJSON-976727453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c211725-898a-488a-bd13-18fff60802fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:51:49 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-90e86c9d-a8d2-428a-8ab6-794be6b91fdd tempest-VolumesSnapshotTestJSON-976727453 None] Volume volume-741ae241-0037-4ba6-8da5-1b64c573f699 (741ae241-0037-4ba6-8da5-1b64c573f699): created successfully Sep 04 22:51:49 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-90e86c9d-a8d2-428a-8ab6-794be6b91fdd tempest-VolumesSnapshotTestJSON-976727453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c211725-898a-488a-bd13-18fff60802fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:51:49 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-90e86c9d-a8d2-428a-8ab6-794be6b91fdd tempest-VolumesSnapshotTestJSON-976727453 None] Flow 'volume_create_manager' (b29313ef-6fe5-4b2d-b3f8-76b3b3a1d769) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:51:49 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-90e86c9d-a8d2-428a-8ab6-794be6b91fdd tempest-VolumesSnapshotTestJSON-976727453 None] Created volume successfully. Sep 04 22:51:49 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-0fca4d76-6c34-43a3-96e5-369edce216b4 tempest-VolumesSnapshotTestJSON-976727453 None] Acquiring lock "cinder-741ae241-0037-4ba6-8da5-1b64c573f699-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:51:49 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-0fca4d76-6c34-43a3-96e5-369edce216b4 tempest-VolumesSnapshotTestJSON-976727453 None] Lock "cinder-741ae241-0037-4ba6-8da5-1b64c573f699-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:51:49 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-0fca4d76-6c34-43a3-96e5-369edce216b4 tempest-VolumesSnapshotTestJSON-976727453 None] Acquiring lock "cinder-quobyte-741ae241-0037-4ba6-8da5-1b64c573f699" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:51:49 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-0fca4d76-6c34-43a3-96e5-369edce216b4 tempest-VolumesSnapshotTestJSON-976727453 None] Lock "cinder-quobyte-741ae241-0037-4ba6-8da5-1b64c573f699" acquired by "delete_volume" :: waited 0.018s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:51:49 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[48fda757-7704-420a-a9fd-7f6e336b7cf3]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:51:49 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0fca4d76-6c34-43a3-96e5-369edce216b4 tempest-VolumesSnapshotTestJSON-976727453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-741ae241-0037-4ba6-8da5-1b64c573f699 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:50 devstack sudo[103042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-741ae241-0037-4ba6-8da5-1b64c573f699 Sep 04 22:51:50 devstack sudo[103042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:50 devstack sudo[103042]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:50 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0fca4d76-6c34-43a3-96e5-369edce216b4 tempest-VolumesSnapshotTestJSON-976727453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-741ae241-0037-4ba6-8da5-1b64c573f699" returned: 0 in 0.426s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:50 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0fca4d76-6c34-43a3-96e5-369edce216b4 tempest-VolumesSnapshotTestJSON-976727453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-741ae241-0037-4ba6-8da5-1b64c573f699 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:50 devstack sudo[103048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-741ae241-0037-4ba6-8da5-1b64c573f699 Sep 04 22:51:50 devstack sudo[103048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:50 devstack sudo[103048]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:50 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0fca4d76-6c34-43a3-96e5-369edce216b4 tempest-VolumesSnapshotTestJSON-976727453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-741ae241-0037-4ba6-8da5-1b64c573f699" returned: 0 in 0.295s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:50 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-0fca4d76-6c34-43a3-96e5-369edce216b4 tempest-VolumesSnapshotTestJSON-976727453 None] Lock "cinder-quobyte-741ae241-0037-4ba6-8da5-1b64c573f699" released by "delete_volume" :: held 0.776s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:51:50 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-0fca4d76-6c34-43a3-96e5-369edce216b4 tempest-VolumesSnapshotTestJSON-976727453 None] Created reservations ['ed398c4d-3f83-46b7-aebf-ca5505f8535d', '61dc47a5-ce62-4332-b860-51efaeb889d4', 'a5ad0374-2f73-4230-bf95-dd038e133a6a', '66ce2c95-05f7-4b2c-b76c-13f07440f697'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:51:50 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-0fca4d76-6c34-43a3-96e5-369edce216b4 tempest-VolumesSnapshotTestJSON-976727453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:51:50 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-0fca4d76-6c34-43a3-96e5-369edce216b4 tempest-VolumesSnapshotTestJSON-976727453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:51:50 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-0fca4d76-6c34-43a3-96e5-369edce216b4 tempest-VolumesSnapshotTestJSON-976727453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:51:50 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-0fca4d76-6c34-43a3-96e5-369edce216b4 tempest-VolumesSnapshotTestJSON-976727453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:51:50 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-0fca4d76-6c34-43a3-96e5-369edce216b4 tempest-VolumesSnapshotTestJSON-976727453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:51:50 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0fca4d76-6c34-43a3-96e5-369edce216b4 tempest-VolumesSnapshotTestJSON-976727453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:50 devstack sudo[103052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:51:50 devstack sudo[103052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:51 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-78dfc188-b990-46b7-857e-90aa5094137e tempest-VolumesSnapshotTestJSON-976727453 None] Acquiring lock "cinder-a1b367eb-b055-4550-b270-5d7fcea987d9-delete_snapshot" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:51:51 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-78dfc188-b990-46b7-857e-90aa5094137e tempest-VolumesSnapshotTestJSON-976727453 None] Lock "cinder-a1b367eb-b055-4550-b270-5d7fcea987d9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:51:51 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-78dfc188-b990-46b7-857e-90aa5094137e tempest-VolumesSnapshotTestJSON-976727453 None] Acquiring lock "cinder-quobyte-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:51:51 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-78dfc188-b990-46b7-857e-90aa5094137e tempest-VolumesSnapshotTestJSON-976727453 None] Lock "cinder-quobyte-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:51:51 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-78dfc188-b990-46b7-857e-90aa5094137e tempest-VolumesSnapshotTestJSON-976727453 None] Acquiring lock "cinder-quobyte-a1b367eb-b055-4550-b270-5d7fcea987d9" by "_delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:51:51 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-78dfc188-b990-46b7-857e-90aa5094137e tempest-VolumesSnapshotTestJSON-976727453 None] Lock "cinder-quobyte-a1b367eb-b055-4550-b270-5d7fcea987d9" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:51:51 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-78dfc188-b990-46b7-857e-90aa5094137e tempest-VolumesSnapshotTestJSON-976727453 None] Deleting offline snapshot a1b367eb-b055-4550-b270-5d7fcea987d9 of volume 5a91df99-b35c-45a4-b6b3-cdcc2bfc145b {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 22:51:51 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-78dfc188-b990-46b7-857e-90aa5094137e tempest-VolumesSnapshotTestJSON-976727453 None] snapshot_file for this snap is: volume-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b.a1b367eb-b055-4550-b270-5d7fcea987d9 {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 22:51:51 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc74e07-e735-4194-b666-7ec83d830190]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:51:51 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-78dfc188-b990-46b7-857e-90aa5094137e tempest-VolumesSnapshotTestJSON-976727453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b.a1b367eb-b055-4550-b270-5d7fcea987d9 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:51 devstack sudo[103052]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:51 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0fca4d76-6c34-43a3-96e5-369edce216b4 tempest-VolumesSnapshotTestJSON-976727453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.399s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:51 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-0fca4d76-6c34-43a3-96e5-369edce216b4 tempest-VolumesSnapshotTestJSON-976727453 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:51:51 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-0fca4d76-6c34-43a3-96e5-369edce216b4 tempest-VolumesSnapshotTestJSON-976727453 None] Deleted volume successfully. Sep 04 22:51:51 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-0fca4d76-6c34-43a3-96e5-369edce216b4 tempest-VolumesSnapshotTestJSON-976727453 None] Lock "cinder-741ae241-0037-4ba6-8da5-1b64c573f699-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:51:51 devstack sudo[103056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b.a1b367eb-b055-4550-b270-5d7fcea987d9 Sep 04 22:51:51 devstack sudo[103056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:51 devstack sudo[103056]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:51 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-78dfc188-b990-46b7-857e-90aa5094137e tempest-VolumesSnapshotTestJSON-976727453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b.a1b367eb-b055-4550-b270-5d7fcea987d9" returned: 0 in 0.438s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:51 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-78dfc188-b990-46b7-857e-90aa5094137e tempest-VolumesSnapshotTestJSON-976727453 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 22:51:51 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cacb473-a940-458f-a769-94a262c756f0]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:51:51 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-78dfc188-b990-46b7-857e-90aa5094137e tempest-VolumesSnapshotTestJSON-976727453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:51 devstack sudo[103061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b Sep 04 22:51:51 devstack sudo[103061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:52 devstack sudo[103061]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-78dfc188-b990-46b7-857e-90aa5094137e tempest-VolumesSnapshotTestJSON-976727453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b" returned: 0 in 0.650s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-78dfc188-b990-46b7-857e-90aa5094137e tempest-VolumesSnapshotTestJSON-976727453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b.a1b367eb-b055-4550-b270-5d7fcea987d9 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:52 devstack sudo[103067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b.a1b367eb-b055-4550-b270-5d7fcea987d9 Sep 04 22:51:52 devstack sudo[103067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:52 devstack sudo[103067]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-78dfc188-b990-46b7-857e-90aa5094137e tempest-VolumesSnapshotTestJSON-976727453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b.a1b367eb-b055-4550-b270-5d7fcea987d9" returned: 0 in 0.373s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-78dfc188-b990-46b7-857e-90aa5094137e tempest-VolumesSnapshotTestJSON-976727453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b.a1b367eb-b055-4550-b270-5d7fcea987d9 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:52 devstack sudo[103073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b.a1b367eb-b055-4550-b270-5d7fcea987d9 Sep 04 22:51:52 devstack sudo[103073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:53 devstack sudo[103073]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:53 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-78dfc188-b990-46b7-857e-90aa5094137e tempest-VolumesSnapshotTestJSON-976727453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b.a1b367eb-b055-4550-b270-5d7fcea987d9" returned: 0 in 0.255s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:53 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-78dfc188-b990-46b7-857e-90aa5094137e tempest-VolumesSnapshotTestJSON-976727453 None] Lock "cinder-quobyte-a1b367eb-b055-4550-b270-5d7fcea987d9" released by "_delete_snapshot" :: held 1.870s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:51:53 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-78dfc188-b990-46b7-857e-90aa5094137e tempest-VolumesSnapshotTestJSON-976727453 None] Lock "cinder-quobyte-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b" released by "delete_snapshot" :: held 1.899s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:51:53 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-78dfc188-b990-46b7-857e-90aa5094137e tempest-VolumesSnapshotTestJSON-976727453 None] Created reservations ['de582815-4ef7-4f76-9fa4-ad7eb9196fda', '2bc968b9-3051-49dd-9eb4-59cacc638d01', '91188110-2f46-4a57-a22b-eb69891974ae', 'e37066a0-50d3-45db-941b-8d268dd8214e'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:51:53 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-78dfc188-b990-46b7-857e-90aa5094137e tempest-VolumesSnapshotTestJSON-976727453 None] Delete snapshot completed successfully. Sep 04 22:51:53 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-78dfc188-b990-46b7-857e-90aa5094137e tempest-VolumesSnapshotTestJSON-976727453 None] Lock "cinder-a1b367eb-b055-4550-b270-5d7fcea987d9-delete_snapshot" released by "delete_snapshot" :: held 2.098s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:51:53 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-8dc4f1b4-2397-4d51-b3dc-a37d27a9008b tempest-VolumesSnapshotTestJSON-976727453 None] Acquiring lock "cinder-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:51:53 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-8dc4f1b4-2397-4d51-b3dc-a37d27a9008b tempest-VolumesSnapshotTestJSON-976727453 None] Lock "cinder-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:51:53 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-8dc4f1b4-2397-4d51-b3dc-a37d27a9008b tempest-VolumesSnapshotTestJSON-976727453 None] Acquiring lock "cinder-quobyte-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:51:53 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-8dc4f1b4-2397-4d51-b3dc-a37d27a9008b tempest-VolumesSnapshotTestJSON-976727453 None] Lock "cinder-quobyte-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b" acquired by "delete_volume" :: waited 0.025s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:51:53 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ca694d-b157-4b67-b7b6-43299d57a55d]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:51:53 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-8dc4f1b4-2397-4d51-b3dc-a37d27a9008b tempest-VolumesSnapshotTestJSON-976727453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:53 devstack sudo[103077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b Sep 04 22:51:53 devstack sudo[103077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:54 devstack sudo[103077]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-8dc4f1b4-2397-4d51-b3dc-a37d27a9008b tempest-VolumesSnapshotTestJSON-976727453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b" returned: 0 in 0.391s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-8dc4f1b4-2397-4d51-b3dc-a37d27a9008b tempest-VolumesSnapshotTestJSON-976727453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:54 devstack sudo[103083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b Sep 04 22:51:54 devstack sudo[103083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:54 devstack sudo[103083]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-8dc4f1b4-2397-4d51-b3dc-a37d27a9008b tempest-VolumesSnapshotTestJSON-976727453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b" returned: 0 in 0.294s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:54 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-8dc4f1b4-2397-4d51-b3dc-a37d27a9008b tempest-VolumesSnapshotTestJSON-976727453 None] Lock "cinder-quobyte-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b" released by "delete_volume" :: held 0.757s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:51:54 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-8dc4f1b4-2397-4d51-b3dc-a37d27a9008b tempest-VolumesSnapshotTestJSON-976727453 None] Created reservations ['b38bd698-6de7-4660-8ff4-5de24decb91f', '9771a628-e476-4146-8aca-b5dca07e61ec', '9907a00e-23b0-4031-9a79-ea9e1cfab3a2', '9ae4fe09-1d5d-4996-88e1-4a0666e70aea'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:51:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-8dc4f1b4-2397-4d51-b3dc-a37d27a9008b tempest-VolumesSnapshotTestJSON-976727453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:51:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-8dc4f1b4-2397-4d51-b3dc-a37d27a9008b tempest-VolumesSnapshotTestJSON-976727453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:51:54 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-8dc4f1b4-2397-4d51-b3dc-a37d27a9008b tempest-VolumesSnapshotTestJSON-976727453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:51:54 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-8dc4f1b4-2397-4d51-b3dc-a37d27a9008b tempest-VolumesSnapshotTestJSON-976727453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:51:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-8dc4f1b4-2397-4d51-b3dc-a37d27a9008b tempest-VolumesSnapshotTestJSON-976727453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:51:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-8dc4f1b4-2397-4d51-b3dc-a37d27a9008b tempest-VolumesSnapshotTestJSON-976727453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:54 devstack sudo[103087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:51:54 devstack sudo[103087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:54 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [req-310066d0-897a-4c3a-90b0-c55de314d151 req-fd0fc252-5e6e-40e6-8b3d-88c33fe8f883 tempest-VolumesSnapshotsTestJSON-1755807511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:51:54 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-310066d0-897a-4c3a-90b0-c55de314d151 req-fd0fc252-5e6e-40e6-8b3d-88c33fe8f883 tempest-VolumesSnapshotsTestJSON-1755807511 None] Flow 'volume_create_manager' (e1fe6f8f-3f42-4054-8ba2-cb5229470d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:51:54 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-310066d0-897a-4c3a-90b0-c55de314d151 req-fd0fc252-5e6e-40e6-8b3d-88c33fe8f883 tempest-VolumesSnapshotsTestJSON-1755807511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e06b8c38-4a78-4e70-b380-ac7e6adcc230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:51:54 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d22b798f-6eb6-4b91-b678-9e62f89b5758 tempest-VolumesSnapshotTestJSON-976727453 None] Acquiring lock "cinder-bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:51:54 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-310066d0-897a-4c3a-90b0-c55de314d151 req-fd0fc252-5e6e-40e6-8b3d-88c33fe8f883 tempest-VolumesSnapshotsTestJSON-1755807511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e06b8c38-4a78-4e70-b380-ac7e6adcc230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:51:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2141893640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bab9980-f414-40db-8ec9-d1245646e3e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='383ffd19a8514402bf76ec3ffb674ef0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:51:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:51:55Z,use_quota=True,user_id='c5a7d6a8f41840c9ab9ac043a25d6de8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:51:54 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-310066d0-897a-4c3a-90b0-c55de314d151 req-fd0fc252-5e6e-40e6-8b3d-88c33fe8f883 tempest-VolumesSnapshotsTestJSON-1755807511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08cf08a7-1c27-4714-aff0-526b442f9f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:51:54 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-310066d0-897a-4c3a-90b0-c55de314d151 req-fd0fc252-5e6e-40e6-8b3d-88c33fe8f883 tempest-VolumesSnapshotsTestJSON-1755807511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08cf08a7-1c27-4714-aff0-526b442f9f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:51:54 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-310066d0-897a-4c3a-90b0-c55de314d151 req-fd0fc252-5e6e-40e6-8b3d-88c33fe8f883 tempest-VolumesSnapshotsTestJSON-1755807511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c617fd78-d13d-4316-992e-5535a30e609f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:51:54 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-310066d0-897a-4c3a-90b0-c55de314d151 req-fd0fc252-5e6e-40e6-8b3d-88c33fe8f883 tempest-VolumesSnapshotsTestJSON-1755807511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c617fd78-d13d-4316-992e-5535a30e609f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bab9980-f414-40db-8ec9-d1245646e3e1', 'volume_name': 'volume-4bab9980-f414-40db-8ec9-d1245646e3e1', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:51:54 devstack sudo[103087]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:54 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-310066d0-897a-4c3a-90b0-c55de314d151 req-fd0fc252-5e6e-40e6-8b3d-88c33fe8f883 tempest-VolumesSnapshotsTestJSON-1755807511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a369da73-1672-4e4b-ad9d-d2c58c57f16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:51:54 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-310066d0-897a-4c3a-90b0-c55de314d151 req-fd0fc252-5e6e-40e6-8b3d-88c33fe8f883 tempest-VolumesSnapshotsTestJSON-1755807511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a369da73-1672-4e4b-ad9d-d2c58c57f16b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:51:54 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-310066d0-897a-4c3a-90b0-c55de314d151 req-fd0fc252-5e6e-40e6-8b3d-88c33fe8f883 tempest-VolumesSnapshotsTestJSON-1755807511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (976f17d2-8a03-477b-89a3-02535b1860aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:51:54 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [req-310066d0-897a-4c3a-90b0-c55de314d151 req-fd0fc252-5e6e-40e6-8b3d-88c33fe8f883 tempest-VolumesSnapshotsTestJSON-1755807511 None] Volume 4bab9980-f414-40db-8ec9-d1245646e3e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bab9980-f414-40db-8ec9-d1245646e3e1', 'volume_size': 1} Sep 04 22:51:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-310066d0-897a-4c3a-90b0-c55de314d151 req-fd0fc252-5e6e-40e6-8b3d-88c33fe8f883 tempest-VolumesSnapshotsTestJSON-1755807511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:51:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-310066d0-897a-4c3a-90b0-c55de314d151 req-fd0fc252-5e6e-40e6-8b3d-88c33fe8f883 tempest-VolumesSnapshotsTestJSON-1755807511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:51:54 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [req-310066d0-897a-4c3a-90b0-c55de314d151 req-fd0fc252-5e6e-40e6-8b3d-88c33fe8f883 tempest-VolumesSnapshotsTestJSON-1755807511 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:51:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2141893640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bab9980-f414-40db-8ec9-d1245646e3e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='383ffd19a8514402bf76ec3ffb674ef0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:51:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:51:55Z,use_quota=True,user_id='c5a7d6a8f41840c9ab9ac043a25d6de8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:51:54 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [req-310066d0-897a-4c3a-90b0-c55de314d151 req-fd0fc252-5e6e-40e6-8b3d-88c33fe8f883 tempest-VolumesSnapshotsTestJSON-1755807511 None] Creating volume 4bab9980-f414-40db-8ec9-d1245646e3e1 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:51:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-310066d0-897a-4c3a-90b0-c55de314d151 req-fd0fc252-5e6e-40e6-8b3d-88c33fe8f883 tempest-VolumesSnapshotsTestJSON-1755807511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:51:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-310066d0-897a-4c3a-90b0-c55de314d151 req-fd0fc252-5e6e-40e6-8b3d-88c33fe8f883 tempest-VolumesSnapshotsTestJSON-1755807511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:51:54 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [req-310066d0-897a-4c3a-90b0-c55de314d151 req-fd0fc252-5e6e-40e6-8b3d-88c33fe8f883 tempest-VolumesSnapshotsTestJSON-1755807511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:51:54 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [req-310066d0-897a-4c3a-90b0-c55de314d151 req-fd0fc252-5e6e-40e6-8b3d-88c33fe8f883 tempest-VolumesSnapshotsTestJSON-1755807511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:51:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-310066d0-897a-4c3a-90b0-c55de314d151 req-fd0fc252-5e6e-40e6-8b3d-88c33fe8f883 tempest-VolumesSnapshotsTestJSON-1755807511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:51:54 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [req-310066d0-897a-4c3a-90b0-c55de314d151 req-fd0fc252-5e6e-40e6-8b3d-88c33fe8f883 tempest-VolumesSnapshotsTestJSON-1755807511 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:51:54 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [req-310066d0-897a-4c3a-90b0-c55de314d151 req-fd0fc252-5e6e-40e6-8b3d-88c33fe8f883 tempest-VolumesSnapshotsTestJSON-1755807511 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:51:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [req-310066d0-897a-4c3a-90b0-c55de314d151 req-fd0fc252-5e6e-40e6-8b3d-88c33fe8f883 tempest-VolumesSnapshotsTestJSON-1755807511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4bab9980-f414-40db-8ec9-d1245646e3e1 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:54 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d22b798f-6eb6-4b91-b678-9e62f89b5758 tempest-VolumesSnapshotTestJSON-976727453 None] Lock "cinder-bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7-delete_volume" acquired by "delete_volume" :: waited 0.132s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:51:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-8dc4f1b4-2397-4d51-b3dc-a37d27a9008b tempest-VolumesSnapshotTestJSON-976727453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.395s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:54 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-8dc4f1b4-2397-4d51-b3dc-a37d27a9008b tempest-VolumesSnapshotTestJSON-976727453 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:51:54 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-8dc4f1b4-2397-4d51-b3dc-a37d27a9008b tempest-VolumesSnapshotTestJSON-976727453 None] Deleted volume successfully. Sep 04 22:51:54 devstack sudo[103090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4bab9980-f414-40db-8ec9-d1245646e3e1 1073741824 Sep 04 22:51:54 devstack sudo[103090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:54 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-8dc4f1b4-2397-4d51-b3dc-a37d27a9008b tempest-VolumesSnapshotTestJSON-976727453 None] Lock "cinder-5a91df99-b35c-45a4-b6b3-cdcc2bfc145b-delete_volume" released by "delete_volume" :: held 1.465s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:51:54 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d22b798f-6eb6-4b91-b678-9e62f89b5758 tempest-VolumesSnapshotTestJSON-976727453 None] Acquiring lock "cinder-quobyte-bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:51:55 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d22b798f-6eb6-4b91-b678-9e62f89b5758 tempest-VolumesSnapshotTestJSON-976727453 None] Lock "cinder-quobyte-bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7" acquired by "delete_volume" :: waited 0.014s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:51:55 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a2c826-b4f5-4151-948e-854d195fcf81]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:51:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d22b798f-6eb6-4b91-b678-9e62f89b5758 tempest-VolumesSnapshotTestJSON-976727453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:55 devstack sudo[103092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7 Sep 04 22:51:55 devstack sudo[103092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:55 devstack sudo[103090]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [req-310066d0-897a-4c3a-90b0-c55de314d151 req-fd0fc252-5e6e-40e6-8b3d-88c33fe8f883 tempest-VolumesSnapshotsTestJSON-1755807511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4bab9980-f414-40db-8ec9-d1245646e3e1 1073741824" returned: 0 in 0.503s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [req-310066d0-897a-4c3a-90b0-c55de314d151 req-fd0fc252-5e6e-40e6-8b3d-88c33fe8f883 tempest-VolumesSnapshotsTestJSON-1755807511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4bab9980-f414-40db-8ec9-d1245646e3e1 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:55 devstack sudo[103092]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d22b798f-6eb6-4b91-b678-9e62f89b5758 tempest-VolumesSnapshotTestJSON-976727453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7" returned: 0 in 0.421s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d22b798f-6eb6-4b91-b678-9e62f89b5758 tempest-VolumesSnapshotTestJSON-976727453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:55 devstack sudo[103102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4bab9980-f414-40db-8ec9-d1245646e3e1 Sep 04 22:51:55 devstack sudo[103102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:55 devstack sudo[103103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7 Sep 04 22:51:55 devstack sudo[103103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:55 devstack sudo[103102]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [req-310066d0-897a-4c3a-90b0-c55de314d151 req-fd0fc252-5e6e-40e6-8b3d-88c33fe8f883 tempest-VolumesSnapshotsTestJSON-1755807511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4bab9980-f414-40db-8ec9-d1245646e3e1" returned: 0 in 0.256s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:55 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [req-310066d0-897a-4c3a-90b0-c55de314d151 req-fd0fc252-5e6e-40e6-8b3d-88c33fe8f883 tempest-VolumesSnapshotsTestJSON-1755807511 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:51:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-310066d0-897a-4c3a-90b0-c55de314d151 req-fd0fc252-5e6e-40e6-8b3d-88c33fe8f883 tempest-VolumesSnapshotsTestJSON-1755807511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:51:55 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-310066d0-897a-4c3a-90b0-c55de314d151 req-fd0fc252-5e6e-40e6-8b3d-88c33fe8f883 tempest-VolumesSnapshotsTestJSON-1755807511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (976f17d2-8a03-477b-89a3-02535b1860aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bab9980-f414-40db-8ec9-d1245646e3e1', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:51:55 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-310066d0-897a-4c3a-90b0-c55de314d151 req-fd0fc252-5e6e-40e6-8b3d-88c33fe8f883 tempest-VolumesSnapshotsTestJSON-1755807511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aef0320a-ad05-42cf-b12e-63ce9c601b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:51:55 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [req-310066d0-897a-4c3a-90b0-c55de314d151 req-fd0fc252-5e6e-40e6-8b3d-88c33fe8f883 tempest-VolumesSnapshotsTestJSON-1755807511 None] Volume volume-4bab9980-f414-40db-8ec9-d1245646e3e1 (4bab9980-f414-40db-8ec9-d1245646e3e1): created successfully Sep 04 22:51:55 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-310066d0-897a-4c3a-90b0-c55de314d151 req-fd0fc252-5e6e-40e6-8b3d-88c33fe8f883 tempest-VolumesSnapshotsTestJSON-1755807511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aef0320a-ad05-42cf-b12e-63ce9c601b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:51:55 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-310066d0-897a-4c3a-90b0-c55de314d151 req-fd0fc252-5e6e-40e6-8b3d-88c33fe8f883 tempest-VolumesSnapshotsTestJSON-1755807511 None] Flow 'volume_create_manager' (e1fe6f8f-3f42-4054-8ba2-cb5229470d47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:51:55 devstack cinder-volume[87576]: INFO cinder.volume.manager [req-310066d0-897a-4c3a-90b0-c55de314d151 req-fd0fc252-5e6e-40e6-8b3d-88c33fe8f883 tempest-VolumesSnapshotsTestJSON-1755807511 None] Created volume successfully. Sep 04 22:51:55 devstack sudo[103103]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d22b798f-6eb6-4b91-b678-9e62f89b5758 tempest-VolumesSnapshotTestJSON-976727453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7" returned: 0 in 0.361s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:55 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d22b798f-6eb6-4b91-b678-9e62f89b5758 tempest-VolumesSnapshotTestJSON-976727453 None] Lock "cinder-quobyte-bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7" released by "delete_volume" :: held 0.859s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:51:55 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-d22b798f-6eb6-4b91-b678-9e62f89b5758 tempest-VolumesSnapshotTestJSON-976727453 None] Created reservations ['e3ae9208-a10c-4088-bcc1-c495ee472fb0', 'e9101281-ed70-4547-b53c-9d3ecbaf8e82', '2695ce24-d064-4b1c-aacc-220769d85e7c', '71a56f83-77a5-4fcf-9605-980c906c2dce'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:51:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-d22b798f-6eb6-4b91-b678-9e62f89b5758 tempest-VolumesSnapshotTestJSON-976727453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:51:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-d22b798f-6eb6-4b91-b678-9e62f89b5758 tempest-VolumesSnapshotTestJSON-976727453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:51:55 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-d22b798f-6eb6-4b91-b678-9e62f89b5758 tempest-VolumesSnapshotTestJSON-976727453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:51:55 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-d22b798f-6eb6-4b91-b678-9e62f89b5758 tempest-VolumesSnapshotTestJSON-976727453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:51:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-d22b798f-6eb6-4b91-b678-9e62f89b5758 tempest-VolumesSnapshotTestJSON-976727453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:51:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d22b798f-6eb6-4b91-b678-9e62f89b5758 tempest-VolumesSnapshotTestJSON-976727453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:56 devstack sudo[103108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:51:56 devstack sudo[103108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:56 devstack sudo[103108]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d22b798f-6eb6-4b91-b678-9e62f89b5758 tempest-VolumesSnapshotTestJSON-976727453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.251s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:56 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-d22b798f-6eb6-4b91-b678-9e62f89b5758 tempest-VolumesSnapshotTestJSON-976727453 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:51:56 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-d22b798f-6eb6-4b91-b678-9e62f89b5758 tempest-VolumesSnapshotTestJSON-976727453 None] Deleted volume successfully. Sep 04 22:51:56 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d22b798f-6eb6-4b91-b678-9e62f89b5758 tempest-VolumesSnapshotTestJSON-976727453 None] Lock "cinder-bbd39a26-fe10-4eb4-9a95-b1b3f0ed77b7-delete_volume" released by "delete_volume" :: held 1.341s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:51:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-1939f1f8-6ad9-4c68-b70c-c181fe9931d5 req-f57791ec-292a-4d2c-9f2d-de9af6de166a tempest-VolumesSnapshotsTestJSON-1755807511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:51:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-1939f1f8-6ad9-4c68-b70c-c181fe9931d5 req-f57791ec-292a-4d2c-9f2d-de9af6de166a tempest-VolumesSnapshotsTestJSON-1755807511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:51:57 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [req-1939f1f8-6ad9-4c68-b70c-c181fe9931d5 req-f57791ec-292a-4d2c-9f2d-de9af6de166a tempest-VolumesSnapshotsTestJSON-1755807511 None] Creating offline snapshot ed9148f6-1ce2-4fae-92fb-eb8c44ada556 of volume 4bab9980-f414-40db-8ec9-d1245646e3e1 {{(pid=87576) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 22:51:57 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[04de6649-b513-41cc-81cf-aaa3590f8c6c]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:51:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [req-1939f1f8-6ad9-4c68-b70c-c181fe9931d5 req-f57791ec-292a-4d2c-9f2d-de9af6de166a tempest-VolumesSnapshotsTestJSON-1755807511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4bab9980-f414-40db-8ec9-d1245646e3e1 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:57 devstack sudo[103111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4bab9980-f414-40db-8ec9-d1245646e3e1 Sep 04 22:51:57 devstack sudo[103111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:57 devstack sudo[103111]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [req-1939f1f8-6ad9-4c68-b70c-c181fe9931d5 req-f57791ec-292a-4d2c-9f2d-de9af6de166a tempest-VolumesSnapshotsTestJSON-1755807511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4bab9980-f414-40db-8ec9-d1245646e3e1" returned: 0 in 0.464s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [req-1939f1f8-6ad9-4c68-b70c-c181fe9931d5 req-f57791ec-292a-4d2c-9f2d-de9af6de166a tempest-VolumesSnapshotsTestJSON-1755807511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4bab9980-f414-40db-8ec9-d1245646e3e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4bab9980-f414-40db-8ec9-d1245646e3e1.ed9148f6-1ce2-4fae-92fb-eb8c44ada556 1G {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:57 devstack sudo[103116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4bab9980-f414-40db-8ec9-d1245646e3e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4bab9980-f414-40db-8ec9-d1245646e3e1.ed9148f6-1ce2-4fae-92fb-eb8c44ada556 1G Sep 04 22:51:57 devstack sudo[103116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:58 devstack sudo[103116]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [req-1939f1f8-6ad9-4c68-b70c-c181fe9931d5 req-f57791ec-292a-4d2c-9f2d-de9af6de166a tempest-VolumesSnapshotsTestJSON-1755807511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4bab9980-f414-40db-8ec9-d1245646e3e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4bab9980-f414-40db-8ec9-d1245646e3e1.ed9148f6-1ce2-4fae-92fb-eb8c44ada556 1G" returned: 0 in 0.525s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [req-1939f1f8-6ad9-4c68-b70c-c181fe9931d5 req-f57791ec-292a-4d2c-9f2d-de9af6de166a tempest-VolumesSnapshotsTestJSON-1755807511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bab9980-f414-40db-8ec9-d1245646e3e1 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4bab9980-f414-40db-8ec9-d1245646e3e1.ed9148f6-1ce2-4fae-92fb-eb8c44ada556 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:58 devstack sudo[103122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bab9980-f414-40db-8ec9-d1245646e3e1 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4bab9980-f414-40db-8ec9-d1245646e3e1.ed9148f6-1ce2-4fae-92fb-eb8c44ada556 Sep 04 22:51:58 devstack sudo[103122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:58 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-855bfa8e-a9c0-422b-bdba-54c8d30bfa67 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:51:58 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-855bfa8e-a9c0-422b-bdba-54c8d30bfa67 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Flow 'volume_create_manager' (7b823aeb-e4ca-422a-9f79-6d4e8c87bee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:51:58 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-855bfa8e-a9c0-422b-bdba-54c8d30bfa67 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a740af5-1627-4c37-9f38-525e99fbcf68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:51:58 devstack sudo[103122]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [req-1939f1f8-6ad9-4c68-b70c-c181fe9931d5 req-f57791ec-292a-4d2c-9f2d-de9af6de166a tempest-VolumesSnapshotsTestJSON-1755807511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bab9980-f414-40db-8ec9-d1245646e3e1 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4bab9980-f414-40db-8ec9-d1245646e3e1.ed9148f6-1ce2-4fae-92fb-eb8c44ada556" returned: 0 in 0.323s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:58 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [req-1939f1f8-6ad9-4c68-b70c-c181fe9931d5 req-f57791ec-292a-4d2c-9f2d-de9af6de166a tempest-VolumesSnapshotsTestJSON-1755807511 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4bab9980-f414-40db-8ec9-d1245646e3e1.ed9148f6-1ce2-4fae-92fb-eb8c44ada556 is being set with open permissions: ugo+rw Sep 04 22:51:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [req-1939f1f8-6ad9-4c68-b70c-c181fe9931d5 req-f57791ec-292a-4d2c-9f2d-de9af6de166a tempest-VolumesSnapshotsTestJSON-1755807511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4bab9980-f414-40db-8ec9-d1245646e3e1.ed9148f6-1ce2-4fae-92fb-eb8c44ada556 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:58 devstack sudo[103127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4bab9980-f414-40db-8ec9-d1245646e3e1.ed9148f6-1ce2-4fae-92fb-eb8c44ada556 Sep 04 22:51:58 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-855bfa8e-a9c0-422b-bdba-54c8d30bfa67 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a740af5-1627-4c37-9f38-525e99fbcf68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:51:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-307160994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fed7560-9258-44e6-9c76-007969022b90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1ceb202c69547779d948bffee611b1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:51:58Z,use_quota=True,user_id='3b210220cfcd4683816590ba21914e4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:51:58 devstack sudo[103127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:58 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-855bfa8e-a9c0-422b-bdba-54c8d30bfa67 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31dcdfaf-5820-4804-b1c4-d6fa63f4dd27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:51:58 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-855bfa8e-a9c0-422b-bdba-54c8d30bfa67 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31dcdfaf-5820-4804-b1c4-d6fa63f4dd27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:51:58 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-855bfa8e-a9c0-422b-bdba-54c8d30bfa67 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad299538-92ef-49f0-b017-1addae030d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:51:58 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-855bfa8e-a9c0-422b-bdba-54c8d30bfa67 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad299538-92ef-49f0-b017-1addae030d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fed7560-9258-44e6-9c76-007969022b90', 'volume_name': 'volume-6fed7560-9258-44e6-9c76-007969022b90', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:51:58 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-855bfa8e-a9c0-422b-bdba-54c8d30bfa67 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6fde171-98b0-471e-8107-d5f99ea05759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:51:58 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-855bfa8e-a9c0-422b-bdba-54c8d30bfa67 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6fde171-98b0-471e-8107-d5f99ea05759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:51:58 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-855bfa8e-a9c0-422b-bdba-54c8d30bfa67 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (937ed8f7-e59b-4f31-9236-dac3e5059ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:51:58 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-855bfa8e-a9c0-422b-bdba-54c8d30bfa67 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Volume 6fed7560-9258-44e6-9c76-007969022b90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fed7560-9258-44e6-9c76-007969022b90', 'volume_size': 1} Sep 04 22:51:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-855bfa8e-a9c0-422b-bdba-54c8d30bfa67 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:51:58 devstack sudo[103127]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [req-1939f1f8-6ad9-4c68-b70c-c181fe9931d5 req-f57791ec-292a-4d2c-9f2d-de9af6de166a tempest-VolumesSnapshotsTestJSON-1755807511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4bab9980-f414-40db-8ec9-d1245646e3e1.ed9148f6-1ce2-4fae-92fb-eb8c44ada556" returned: 0 in 0.265s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [req-1939f1f8-6ad9-4c68-b70c-c181fe9931d5 req-f57791ec-292a-4d2c-9f2d-de9af6de166a tempest-VolumesSnapshotsTestJSON-1755807511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4bab9980-f414-40db-8ec9-d1245646e3e1.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:58 devstack sudo[103131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4bab9980-f414-40db-8ec9-d1245646e3e1.info Sep 04 22:51:58 devstack sudo[103131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:59 devstack sudo[103131]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [req-1939f1f8-6ad9-4c68-b70c-c181fe9931d5 req-f57791ec-292a-4d2c-9f2d-de9af6de166a tempest-VolumesSnapshotsTestJSON-1755807511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4bab9980-f414-40db-8ec9-d1245646e3e1.info" returned: 0 in 0.272s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:59 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [req-1939f1f8-6ad9-4c68-b70c-c181fe9931d5 req-f57791ec-292a-4d2c-9f2d-de9af6de166a tempest-VolumesSnapshotsTestJSON-1755807511 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4bab9980-f414-40db-8ec9-d1245646e3e1.info is being set with open permissions: ugo+rw Sep 04 22:51:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [req-1939f1f8-6ad9-4c68-b70c-c181fe9931d5 req-f57791ec-292a-4d2c-9f2d-de9af6de166a tempest-VolumesSnapshotsTestJSON-1755807511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4bab9980-f414-40db-8ec9-d1245646e3e1.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:59 devstack sudo[103134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4bab9980-f414-40db-8ec9-d1245646e3e1.info Sep 04 22:51:59 devstack sudo[103134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:59 devstack sudo[103134]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [req-1939f1f8-6ad9-4c68-b70c-c181fe9931d5 req-f57791ec-292a-4d2c-9f2d-de9af6de166a tempest-VolumesSnapshotsTestJSON-1755807511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4bab9980-f414-40db-8ec9-d1245646e3e1.info" returned: 0 in 0.265s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:51:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-1939f1f8-6ad9-4c68-b70c-c181fe9931d5 req-f57791ec-292a-4d2c-9f2d-de9af6de166a tempest-VolumesSnapshotsTestJSON-1755807511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.225s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:51:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-855bfa8e-a9c0-422b-bdba-54c8d30bfa67 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.798s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:51:59 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-855bfa8e-a9c0-422b-bdba-54c8d30bfa67 tempest-CreateVolumesFromSnapshotTest-1164552097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:51:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-307160994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fed7560-9258-44e6-9c76-007969022b90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1ceb202c69547779d948bffee611b1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:51:58Z,use_quota=True,user_id='3b210220cfcd4683816590ba21914e4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:51:59 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-855bfa8e-a9c0-422b-bdba-54c8d30bfa67 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Creating volume 6fed7560-9258-44e6-9c76-007969022b90 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:51:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-855bfa8e-a9c0-422b-bdba-54c8d30bfa67 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:51:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-855bfa8e-a9c0-422b-bdba-54c8d30bfa67 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:51:59 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-855bfa8e-a9c0-422b-bdba-54c8d30bfa67 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:51:59 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-855bfa8e-a9c0-422b-bdba-54c8d30bfa67 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:51:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-855bfa8e-a9c0-422b-bdba-54c8d30bfa67 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:51:59 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-855bfa8e-a9c0-422b-bdba-54c8d30bfa67 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:51:59 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-855bfa8e-a9c0-422b-bdba-54c8d30bfa67 tempest-CreateVolumesFromSnapshotTest-1164552097 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:51:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-855bfa8e-a9c0-422b-bdba-54c8d30bfa67 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6fed7560-9258-44e6-9c76-007969022b90 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:59 devstack sudo[103137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6fed7560-9258-44e6-9c76-007969022b90 1073741824 Sep 04 22:51:59 devstack sudo[103137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:51:59 devstack cinder-volume[87576]: INFO cinder.volume.manager [req-1939f1f8-6ad9-4c68-b70c-c181fe9931d5 req-f57791ec-292a-4d2c-9f2d-de9af6de166a tempest-VolumesSnapshotsTestJSON-1755807511 None] Create snapshot completed successfully Sep 04 22:51:59 devstack cinder-volume[87576]: DEBUG cinder.coordination [req-1dfc5661-591c-4937-bc75-4901afdf5e4e req-1f49da09-23b5-41c5-b652-54b12fdcb5ac tempest-VolumesSnapshotsTestJSON-1755807511 None] Acquiring lock "cinder-ed9148f6-1ce2-4fae-92fb-eb8c44ada556-delete_snapshot" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:51:59 devstack cinder-volume[87576]: DEBUG cinder.coordination [req-1dfc5661-591c-4937-bc75-4901afdf5e4e req-1f49da09-23b5-41c5-b652-54b12fdcb5ac tempest-VolumesSnapshotsTestJSON-1755807511 None] Lock "cinder-ed9148f6-1ce2-4fae-92fb-eb8c44ada556-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:51:59 devstack cinder-volume[87576]: DEBUG cinder.coordination [req-1dfc5661-591c-4937-bc75-4901afdf5e4e req-1f49da09-23b5-41c5-b652-54b12fdcb5ac tempest-VolumesSnapshotsTestJSON-1755807511 None] Acquiring lock "cinder-quobyte-4bab9980-f414-40db-8ec9-d1245646e3e1" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:51:59 devstack cinder-volume[87576]: DEBUG cinder.coordination [req-1dfc5661-591c-4937-bc75-4901afdf5e4e req-1f49da09-23b5-41c5-b652-54b12fdcb5ac tempest-VolumesSnapshotsTestJSON-1755807511 None] Lock "cinder-quobyte-4bab9980-f414-40db-8ec9-d1245646e3e1" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:51:59 devstack cinder-volume[87576]: DEBUG cinder.coordination [req-1dfc5661-591c-4937-bc75-4901afdf5e4e req-1f49da09-23b5-41c5-b652-54b12fdcb5ac tempest-VolumesSnapshotsTestJSON-1755807511 None] Acquiring lock "cinder-quobyte-ed9148f6-1ce2-4fae-92fb-eb8c44ada556" by "_delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:51:59 devstack cinder-volume[87576]: DEBUG cinder.coordination [req-1dfc5661-591c-4937-bc75-4901afdf5e4e req-1f49da09-23b5-41c5-b652-54b12fdcb5ac tempest-VolumesSnapshotsTestJSON-1755807511 None] Lock "cinder-quobyte-ed9148f6-1ce2-4fae-92fb-eb8c44ada556" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:51:59 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [req-1dfc5661-591c-4937-bc75-4901afdf5e4e req-1f49da09-23b5-41c5-b652-54b12fdcb5ac tempest-VolumesSnapshotsTestJSON-1755807511 None] Deleting offline snapshot ed9148f6-1ce2-4fae-92fb-eb8c44ada556 of volume 4bab9980-f414-40db-8ec9-d1245646e3e1 {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 22:51:59 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [req-1dfc5661-591c-4937-bc75-4901afdf5e4e req-1f49da09-23b5-41c5-b652-54b12fdcb5ac tempest-VolumesSnapshotsTestJSON-1755807511 None] snapshot_file for this snap is: volume-4bab9980-f414-40db-8ec9-d1245646e3e1.ed9148f6-1ce2-4fae-92fb-eb8c44ada556 {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 22:51:59 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b58f311-0da5-44ca-8720-0e92f9ced5d3]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:51:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [req-1dfc5661-591c-4937-bc75-4901afdf5e4e req-1f49da09-23b5-41c5-b652-54b12fdcb5ac tempest-VolumesSnapshotsTestJSON-1755807511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4bab9980-f414-40db-8ec9-d1245646e3e1.ed9148f6-1ce2-4fae-92fb-eb8c44ada556 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:51:59 devstack sudo[103137]: pam_unix(sudo:session): session closed for user root Sep 04 22:51:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-855bfa8e-a9c0-422b-bdba-54c8d30bfa67 tempest-CreateVolumesFromSnapshotTest-1164552097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6fed7560-9258-44e6-9c76-007969022b90 1073741824" returned: 0 in 0.604s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-855bfa8e-a9c0-422b-bdba-54c8d30bfa67 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6fed7560-9258-44e6-9c76-007969022b90 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:00 devstack sudo[103144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4bab9980-f414-40db-8ec9-d1245646e3e1.ed9148f6-1ce2-4fae-92fb-eb8c44ada556 Sep 04 22:52:00 devstack sudo[103144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:00 devstack sudo[103145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6fed7560-9258-44e6-9c76-007969022b90 Sep 04 22:52:00 devstack sudo[103145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:00 devstack sudo[103144]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:00 devstack sudo[103145]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [req-1dfc5661-591c-4937-bc75-4901afdf5e4e req-1f49da09-23b5-41c5-b652-54b12fdcb5ac tempest-VolumesSnapshotsTestJSON-1755807511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4bab9980-f414-40db-8ec9-d1245646e3e1.ed9148f6-1ce2-4fae-92fb-eb8c44ada556" returned: 0 in 0.381s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:00 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [req-1dfc5661-591c-4937-bc75-4901afdf5e4e req-1f49da09-23b5-41c5-b652-54b12fdcb5ac tempest-VolumesSnapshotsTestJSON-1755807511 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4bab9980-f414-40db-8ec9-d1245646e3e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 22:52:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-855bfa8e-a9c0-422b-bdba-54c8d30bfa67 tempest-CreateVolumesFromSnapshotTest-1164552097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6fed7560-9258-44e6-9c76-007969022b90" returned: 0 in 0.287s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:00 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-855bfa8e-a9c0-422b-bdba-54c8d30bfa67 tempest-CreateVolumesFromSnapshotTest-1164552097 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:52:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-855bfa8e-a9c0-422b-bdba-54c8d30bfa67 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:52:00 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[808302ff-85ff-482c-9a7c-082680e67da6]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:52:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [req-1dfc5661-591c-4937-bc75-4901afdf5e4e req-1f49da09-23b5-41c5-b652-54b12fdcb5ac tempest-VolumesSnapshotsTestJSON-1755807511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4bab9980-f414-40db-8ec9-d1245646e3e1 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:00 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-855bfa8e-a9c0-422b-bdba-54c8d30bfa67 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (937ed8f7-e59b-4f31-9236-dac3e5059ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fed7560-9258-44e6-9c76-007969022b90', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:00 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-855bfa8e-a9c0-422b-bdba-54c8d30bfa67 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2bf4c4f-f4dc-457d-b204-506a7aa7374d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:00 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-855bfa8e-a9c0-422b-bdba-54c8d30bfa67 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Volume volume-6fed7560-9258-44e6-9c76-007969022b90 (6fed7560-9258-44e6-9c76-007969022b90): created successfully Sep 04 22:52:00 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-855bfa8e-a9c0-422b-bdba-54c8d30bfa67 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2bf4c4f-f4dc-457d-b204-506a7aa7374d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:00 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-855bfa8e-a9c0-422b-bdba-54c8d30bfa67 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Flow 'volume_create_manager' (7b823aeb-e4ca-422a-9f79-6d4e8c87bee1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:52:00 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-855bfa8e-a9c0-422b-bdba-54c8d30bfa67 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Created volume successfully. Sep 04 22:52:00 devstack sudo[103152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4bab9980-f414-40db-8ec9-d1245646e3e1 Sep 04 22:52:00 devstack sudo[103152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:00 devstack sudo[103152]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-023d0215-dc51-4dc2-ace0-41ce73516b83 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:52:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-023d0215-dc51-4dc2-ace0-41ce73516b83 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:52:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [req-1dfc5661-591c-4937-bc75-4901afdf5e4e req-1f49da09-23b5-41c5-b652-54b12fdcb5ac tempest-VolumesSnapshotsTestJSON-1755807511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4bab9980-f414-40db-8ec9-d1245646e3e1" returned: 0 in 0.410s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [req-1dfc5661-591c-4937-bc75-4901afdf5e4e req-1f49da09-23b5-41c5-b652-54b12fdcb5ac tempest-VolumesSnapshotsTestJSON-1755807511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4bab9980-f414-40db-8ec9-d1245646e3e1.ed9148f6-1ce2-4fae-92fb-eb8c44ada556 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:00 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-023d0215-dc51-4dc2-ace0-41ce73516b83 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Creating offline snapshot 04898c2a-1ca7-4bfa-b018-09ed6df7ba19 of volume 6fed7560-9258-44e6-9c76-007969022b90 {{(pid=87576) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 22:52:00 devstack sudo[103157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4bab9980-f414-40db-8ec9-d1245646e3e1.ed9148f6-1ce2-4fae-92fb-eb8c44ada556 Sep 04 22:52:00 devstack sudo[103157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:00 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9f22f6-7b4e-4242-bf94-3a6a449f6bee]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:52:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-023d0215-dc51-4dc2-ace0-41ce73516b83 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6fed7560-9258-44e6-9c76-007969022b90 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:00 devstack sudo[103159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6fed7560-9258-44e6-9c76-007969022b90 Sep 04 22:52:00 devstack sudo[103159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:01 devstack sudo[103157]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [req-1dfc5661-591c-4937-bc75-4901afdf5e4e req-1f49da09-23b5-41c5-b652-54b12fdcb5ac tempest-VolumesSnapshotsTestJSON-1755807511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4bab9980-f414-40db-8ec9-d1245646e3e1.ed9148f6-1ce2-4fae-92fb-eb8c44ada556" returned: 0 in 0.442s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [req-1dfc5661-591c-4937-bc75-4901afdf5e4e req-1f49da09-23b5-41c5-b652-54b12fdcb5ac tempest-VolumesSnapshotsTestJSON-1755807511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4bab9980-f414-40db-8ec9-d1245646e3e1.ed9148f6-1ce2-4fae-92fb-eb8c44ada556 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:01 devstack sudo[103166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4bab9980-f414-40db-8ec9-d1245646e3e1.ed9148f6-1ce2-4fae-92fb-eb8c44ada556 Sep 04 22:52:01 devstack sudo[103166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:01 devstack sudo[103159]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-023d0215-dc51-4dc2-ace0-41ce73516b83 tempest-CreateVolumesFromSnapshotTest-1164552097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6fed7560-9258-44e6-9c76-007969022b90" returned: 0 in 0.483s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-023d0215-dc51-4dc2-ace0-41ce73516b83 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6fed7560-9258-44e6-9c76-007969022b90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6fed7560-9258-44e6-9c76-007969022b90.04898c2a-1ca7-4bfa-b018-09ed6df7ba19 1G {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:01 devstack sudo[103170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6fed7560-9258-44e6-9c76-007969022b90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6fed7560-9258-44e6-9c76-007969022b90.04898c2a-1ca7-4bfa-b018-09ed6df7ba19 1G Sep 04 22:52:01 devstack sudo[103170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:01 devstack sudo[103166]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [req-1dfc5661-591c-4937-bc75-4901afdf5e4e req-1f49da09-23b5-41c5-b652-54b12fdcb5ac tempest-VolumesSnapshotsTestJSON-1755807511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4bab9980-f414-40db-8ec9-d1245646e3e1.ed9148f6-1ce2-4fae-92fb-eb8c44ada556" returned: 0 in 0.313s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:01 devstack cinder-volume[87576]: DEBUG cinder.coordination [req-1dfc5661-591c-4937-bc75-4901afdf5e4e req-1f49da09-23b5-41c5-b652-54b12fdcb5ac tempest-VolumesSnapshotsTestJSON-1755807511 None] Lock "cinder-quobyte-ed9148f6-1ce2-4fae-92fb-eb8c44ada556" released by "_delete_snapshot" :: held 1.669s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:52:01 devstack cinder-volume[87576]: DEBUG cinder.coordination [req-1dfc5661-591c-4937-bc75-4901afdf5e4e req-1f49da09-23b5-41c5-b652-54b12fdcb5ac tempest-VolumesSnapshotsTestJSON-1755807511 None] Lock "cinder-quobyte-4bab9980-f414-40db-8ec9-d1245646e3e1" released by "delete_snapshot" :: held 1.697s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:52:01 devstack cinder-volume[87576]: DEBUG cinder.quota [req-1dfc5661-591c-4937-bc75-4901afdf5e4e req-1f49da09-23b5-41c5-b652-54b12fdcb5ac tempest-VolumesSnapshotsTestJSON-1755807511 None] Created reservations ['7d620010-8c00-43f5-8604-c3ea755ac905', '8378fb03-ccf7-4f33-a64c-c4c4c17302c6', '18bc4437-c03b-4260-851e-ed9763bfa47d', 'e67faa37-280f-4581-927b-cc1f784c81df'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:52:01 devstack cinder-volume[87576]: INFO cinder.volume.manager [req-1dfc5661-591c-4937-bc75-4901afdf5e4e req-1f49da09-23b5-41c5-b652-54b12fdcb5ac tempest-VolumesSnapshotsTestJSON-1755807511 None] Delete snapshot completed successfully. Sep 04 22:52:01 devstack cinder-volume[87576]: DEBUG cinder.coordination [req-1dfc5661-591c-4937-bc75-4901afdf5e4e req-1f49da09-23b5-41c5-b652-54b12fdcb5ac tempest-VolumesSnapshotsTestJSON-1755807511 None] Lock "cinder-ed9148f6-1ce2-4fae-92fb-eb8c44ada556-delete_snapshot" released by "delete_snapshot" :: held 1.869s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:52:01 devstack sudo[103170]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-023d0215-dc51-4dc2-ace0-41ce73516b83 tempest-CreateVolumesFromSnapshotTest-1164552097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6fed7560-9258-44e6-9c76-007969022b90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6fed7560-9258-44e6-9c76-007969022b90.04898c2a-1ca7-4bfa-b018-09ed6df7ba19 1G" returned: 0 in 0.431s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-023d0215-dc51-4dc2-ace0-41ce73516b83 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fed7560-9258-44e6-9c76-007969022b90 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6fed7560-9258-44e6-9c76-007969022b90.04898c2a-1ca7-4bfa-b018-09ed6df7ba19 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:01 devstack sudo[103177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fed7560-9258-44e6-9c76-007969022b90 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6fed7560-9258-44e6-9c76-007969022b90.04898c2a-1ca7-4bfa-b018-09ed6df7ba19 Sep 04 22:52:01 devstack sudo[103177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:01 devstack sudo[103177]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-023d0215-dc51-4dc2-ace0-41ce73516b83 tempest-CreateVolumesFromSnapshotTest-1164552097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fed7560-9258-44e6-9c76-007969022b90 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6fed7560-9258-44e6-9c76-007969022b90.04898c2a-1ca7-4bfa-b018-09ed6df7ba19" returned: 0 in 0.301s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:01 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-023d0215-dc51-4dc2-ace0-41ce73516b83 tempest-CreateVolumesFromSnapshotTest-1164552097 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6fed7560-9258-44e6-9c76-007969022b90.04898c2a-1ca7-4bfa-b018-09ed6df7ba19 is being set with open permissions: ugo+rw Sep 04 22:52:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-023d0215-dc51-4dc2-ace0-41ce73516b83 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6fed7560-9258-44e6-9c76-007969022b90.04898c2a-1ca7-4bfa-b018-09ed6df7ba19 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:02 devstack sudo[103182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6fed7560-9258-44e6-9c76-007969022b90.04898c2a-1ca7-4bfa-b018-09ed6df7ba19 Sep 04 22:52:02 devstack sudo[103182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:02 devstack cinder-volume[87576]: DEBUG cinder.coordination [req-85d54d89-f6b9-4f17-834d-4ac1555e1b30 req-df11ee42-52ce-4896-85dc-4497ad65bdc2 tempest-VolumesSnapshotsTestJSON-1755807511 None] Acquiring lock "cinder-4bab9980-f414-40db-8ec9-d1245646e3e1-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:52:02 devstack cinder-volume[87576]: DEBUG cinder.coordination [req-85d54d89-f6b9-4f17-834d-4ac1555e1b30 req-df11ee42-52ce-4896-85dc-4497ad65bdc2 tempest-VolumesSnapshotsTestJSON-1755807511 None] Lock "cinder-4bab9980-f414-40db-8ec9-d1245646e3e1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:52:02 devstack cinder-volume[87576]: DEBUG cinder.coordination [req-85d54d89-f6b9-4f17-834d-4ac1555e1b30 req-df11ee42-52ce-4896-85dc-4497ad65bdc2 tempest-VolumesSnapshotsTestJSON-1755807511 None] Acquiring lock "cinder-quobyte-4bab9980-f414-40db-8ec9-d1245646e3e1" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:52:02 devstack sudo[103182]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:02 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-023d0215-dc51-4dc2-ace0-41ce73516b83 tempest-CreateVolumesFromSnapshotTest-1164552097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6fed7560-9258-44e6-9c76-007969022b90.04898c2a-1ca7-4bfa-b018-09ed6df7ba19" returned: 0 in 0.276s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:02 devstack cinder-volume[87576]: DEBUG cinder.coordination [req-85d54d89-f6b9-4f17-834d-4ac1555e1b30 req-df11ee42-52ce-4896-85dc-4497ad65bdc2 tempest-VolumesSnapshotsTestJSON-1755807511 None] Lock "cinder-quobyte-4bab9980-f414-40db-8ec9-d1245646e3e1" acquired by "delete_volume" :: waited 0.022s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:52:02 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[600f6f80-3885-486b-8746-08d973bc566d]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:52:02 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [req-85d54d89-f6b9-4f17-834d-4ac1555e1b30 req-df11ee42-52ce-4896-85dc-4497ad65bdc2 tempest-VolumesSnapshotsTestJSON-1755807511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4bab9980-f414-40db-8ec9-d1245646e3e1 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:02 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-023d0215-dc51-4dc2-ace0-41ce73516b83 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6fed7560-9258-44e6-9c76-007969022b90.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:02 devstack sudo[103186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6fed7560-9258-44e6-9c76-007969022b90.info Sep 04 22:52:02 devstack sudo[103186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:02 devstack sudo[103185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4bab9980-f414-40db-8ec9-d1245646e3e1 Sep 04 22:52:02 devstack sudo[103185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:02 devstack sudo[103186]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:02 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-023d0215-dc51-4dc2-ace0-41ce73516b83 tempest-CreateVolumesFromSnapshotTest-1164552097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6fed7560-9258-44e6-9c76-007969022b90.info" returned: 0 in 0.283s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:02 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-023d0215-dc51-4dc2-ace0-41ce73516b83 tempest-CreateVolumesFromSnapshotTest-1164552097 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6fed7560-9258-44e6-9c76-007969022b90.info is being set with open permissions: ugo+rw Sep 04 22:52:02 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-023d0215-dc51-4dc2-ace0-41ce73516b83 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6fed7560-9258-44e6-9c76-007969022b90.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:02 devstack sudo[103191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6fed7560-9258-44e6-9c76-007969022b90.info Sep 04 22:52:02 devstack sudo[103191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:02 devstack sudo[103185]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:02 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [req-85d54d89-f6b9-4f17-834d-4ac1555e1b30 req-df11ee42-52ce-4896-85dc-4497ad65bdc2 tempest-VolumesSnapshotsTestJSON-1755807511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4bab9980-f414-40db-8ec9-d1245646e3e1" returned: 0 in 0.482s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:02 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [req-85d54d89-f6b9-4f17-834d-4ac1555e1b30 req-df11ee42-52ce-4896-85dc-4497ad65bdc2 tempest-VolumesSnapshotsTestJSON-1755807511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4bab9980-f414-40db-8ec9-d1245646e3e1 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:02 devstack sudo[103196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4bab9980-f414-40db-8ec9-d1245646e3e1 Sep 04 22:52:02 devstack sudo[103196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:02 devstack sudo[103191]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:02 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-023d0215-dc51-4dc2-ace0-41ce73516b83 tempest-CreateVolumesFromSnapshotTest-1164552097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6fed7560-9258-44e6-9c76-007969022b90.info" returned: 0 in 0.312s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:02 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-023d0215-dc51-4dc2-ace0-41ce73516b83 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.250s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:52:03 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-023d0215-dc51-4dc2-ace0-41ce73516b83 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Create snapshot completed successfully Sep 04 22:52:03 devstack sudo[103196]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [req-85d54d89-f6b9-4f17-834d-4ac1555e1b30 req-df11ee42-52ce-4896-85dc-4497ad65bdc2 tempest-VolumesSnapshotsTestJSON-1755807511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4bab9980-f414-40db-8ec9-d1245646e3e1" returned: 0 in 0.271s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:03 devstack cinder-volume[87576]: DEBUG cinder.coordination [req-85d54d89-f6b9-4f17-834d-4ac1555e1b30 req-df11ee42-52ce-4896-85dc-4497ad65bdc2 tempest-VolumesSnapshotsTestJSON-1755807511 None] Lock "cinder-quobyte-4bab9980-f414-40db-8ec9-d1245646e3e1" released by "delete_volume" :: held 0.825s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:52:03 devstack cinder-volume[87576]: DEBUG cinder.quota [req-85d54d89-f6b9-4f17-834d-4ac1555e1b30 req-df11ee42-52ce-4896-85dc-4497ad65bdc2 tempest-VolumesSnapshotsTestJSON-1755807511 None] Created reservations ['259c7c67-7f52-4c25-b15b-866e2fdb5549', '8533b20d-509d-4a32-98a4-3162d24a91ae', 'd5da0fbe-b8bf-4799-8dcb-e22ff9e584a7', '59877c2b-1208-4ea7-a76c-7512982646c7'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:52:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-85d54d89-f6b9-4f17-834d-4ac1555e1b30 req-df11ee42-52ce-4896-85dc-4497ad65bdc2 tempest-VolumesSnapshotsTestJSON-1755807511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:52:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-85d54d89-f6b9-4f17-834d-4ac1555e1b30 req-df11ee42-52ce-4896-85dc-4497ad65bdc2 tempest-VolumesSnapshotsTestJSON-1755807511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:52:03 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [req-85d54d89-f6b9-4f17-834d-4ac1555e1b30 req-df11ee42-52ce-4896-85dc-4497ad65bdc2 tempest-VolumesSnapshotsTestJSON-1755807511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:52:03 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [req-85d54d89-f6b9-4f17-834d-4ac1555e1b30 req-df11ee42-52ce-4896-85dc-4497ad65bdc2 tempest-VolumesSnapshotsTestJSON-1755807511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:52:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-85d54d89-f6b9-4f17-834d-4ac1555e1b30 req-df11ee42-52ce-4896-85dc-4497ad65bdc2 tempest-VolumesSnapshotsTestJSON-1755807511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:52:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [req-85d54d89-f6b9-4f17-834d-4ac1555e1b30 req-df11ee42-52ce-4896-85dc-4497ad65bdc2 tempest-VolumesSnapshotsTestJSON-1755807511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:03 devstack sudo[103201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:52:03 devstack sudo[103201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:03 devstack sudo[103201]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [req-85d54d89-f6b9-4f17-834d-4ac1555e1b30 req-df11ee42-52ce-4896-85dc-4497ad65bdc2 tempest-VolumesSnapshotsTestJSON-1755807511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.291s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:03 devstack cinder-volume[87576]: DEBUG cinder.manager [req-85d54d89-f6b9-4f17-834d-4ac1555e1b30 req-df11ee42-52ce-4896-85dc-4497ad65bdc2 tempest-VolumesSnapshotsTestJSON-1755807511 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:52:03 devstack cinder-volume[87576]: INFO cinder.volume.manager [req-85d54d89-f6b9-4f17-834d-4ac1555e1b30 req-df11ee42-52ce-4896-85dc-4497ad65bdc2 tempest-VolumesSnapshotsTestJSON-1755807511 None] Deleted volume successfully. Sep 04 22:52:03 devstack cinder-volume[87576]: DEBUG cinder.coordination [req-85d54d89-f6b9-4f17-834d-4ac1555e1b30 req-df11ee42-52ce-4896-85dc-4497ad65bdc2 tempest-VolumesSnapshotsTestJSON-1755807511 None] Lock "cinder-4bab9980-f414-40db-8ec9-d1245646e3e1-delete_volume" released by "delete_volume" :: held 1.379s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:52:04 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-7eb6a23f-6b5a-4898-9e77-771ffe6143a2 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:52:04 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-7eb6a23f-6b5a-4898-9e77-771ffe6143a2 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Flow 'volume_create_manager' (b39b20e8-bb1c-4505-8d3e-0b2b7a640d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:52:04 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-7eb6a23f-6b5a-4898-9e77-771ffe6143a2 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10f27533-d447-4b35-b189-2a7661439626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:04 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-7eb6a23f-6b5a-4898-9e77-771ffe6143a2 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10f27533-d447-4b35-b189-2a7661439626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:52:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-219305911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed560e7f-32d2-4cf4-bb3d-54b9a105cba2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1ceb202c69547779d948bffee611b1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:52:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:52:04Z,use_quota=True,user_id='3b210220cfcd4683816590ba21914e4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:04 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-7eb6a23f-6b5a-4898-9e77-771ffe6143a2 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7936db5d-072c-4a55-8e7d-89e92abd9822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:04 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-7eb6a23f-6b5a-4898-9e77-771ffe6143a2 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7936db5d-072c-4a55-8e7d-89e92abd9822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:04 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-7eb6a23f-6b5a-4898-9e77-771ffe6143a2 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77ffdf99-3907-42f7-937f-052f7ebf8685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:04 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-7eb6a23f-6b5a-4898-9e77-771ffe6143a2 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77ffdf99-3907-42f7-937f-052f7ebf8685) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed560e7f-32d2-4cf4-bb3d-54b9a105cba2', 'volume_name': 'volume-ed560e7f-32d2-4cf4-bb3d-54b9a105cba2', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:04 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-7eb6a23f-6b5a-4898-9e77-771ffe6143a2 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd9d3278-da3a-43c5-ac29-8937a45215c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:04 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-7eb6a23f-6b5a-4898-9e77-771ffe6143a2 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd9d3278-da3a-43c5-ac29-8937a45215c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:04 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-7eb6a23f-6b5a-4898-9e77-771ffe6143a2 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26d60274-08bd-468a-aaaa-3ba15003afb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:04 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-7eb6a23f-6b5a-4898-9e77-771ffe6143a2 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Volume ed560e7f-32d2-4cf4-bb3d-54b9a105cba2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed560e7f-32d2-4cf4-bb3d-54b9a105cba2', 'volume_size': 1} Sep 04 22:52:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-7eb6a23f-6b5a-4898-9e77-771ffe6143a2 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:52:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-7eb6a23f-6b5a-4898-9e77-771ffe6143a2 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:52:04 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-7eb6a23f-6b5a-4898-9e77-771ffe6143a2 tempest-CreateVolumesFromSnapshotTest-1164552097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:52:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-219305911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed560e7f-32d2-4cf4-bb3d-54b9a105cba2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1ceb202c69547779d948bffee611b1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:52:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:52:04Z,use_quota=True,user_id='3b210220cfcd4683816590ba21914e4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:52:04 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-7eb6a23f-6b5a-4898-9e77-771ffe6143a2 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Creating volume ed560e7f-32d2-4cf4-bb3d-54b9a105cba2 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:52:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-7eb6a23f-6b5a-4898-9e77-771ffe6143a2 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:52:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-7eb6a23f-6b5a-4898-9e77-771ffe6143a2 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:52:04 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-7eb6a23f-6b5a-4898-9e77-771ffe6143a2 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:52:04 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-7eb6a23f-6b5a-4898-9e77-771ffe6143a2 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:52:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-7eb6a23f-6b5a-4898-9e77-771ffe6143a2 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:52:04 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-7eb6a23f-6b5a-4898-9e77-771ffe6143a2 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:52:04 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-7eb6a23f-6b5a-4898-9e77-771ffe6143a2 tempest-CreateVolumesFromSnapshotTest-1164552097 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:52:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-7eb6a23f-6b5a-4898-9e77-771ffe6143a2 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-ed560e7f-32d2-4cf4-bb3d-54b9a105cba2 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:04 devstack sudo[103204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-ed560e7f-32d2-4cf4-bb3d-54b9a105cba2 1073741824 Sep 04 22:52:04 devstack sudo[103204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:04 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-93bd4037-aef0-4ec8-beab-7581ea2fe94e tempest-CreateVolumesFromSnapshotTest-1164552097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:52:04 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-93bd4037-aef0-4ec8-beab-7581ea2fe94e tempest-CreateVolumesFromSnapshotTest-1164552097 None] Flow 'volume_create_manager' (b18616ce-570e-42c5-b119-fc475aa0fd09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:52:04 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-93bd4037-aef0-4ec8-beab-7581ea2fe94e tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74af0886-02fc-4489-a932-d43ed74c06d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:04 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-93bd4037-aef0-4ec8-beab-7581ea2fe94e tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74af0886-02fc-4489-a932-d43ed74c06d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:52:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1809096826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cbd1d77-af30-42d3-97ed-53cc29df0c21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1ceb202c69547779d948bffee611b1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:52:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:52:05Z,use_quota=True,user_id='3b210220cfcd4683816590ba21914e4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:04 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-93bd4037-aef0-4ec8-beab-7581ea2fe94e tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35f49ec4-69bc-4d95-a189-174a445cb48a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:04 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-93bd4037-aef0-4ec8-beab-7581ea2fe94e tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35f49ec4-69bc-4d95-a189-174a445cb48a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:04 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-93bd4037-aef0-4ec8-beab-7581ea2fe94e tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87700542-259f-47da-aef5-5f9e64caa42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:04 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-93bd4037-aef0-4ec8-beab-7581ea2fe94e tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87700542-259f-47da-aef5-5f9e64caa42a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cbd1d77-af30-42d3-97ed-53cc29df0c21', 'volume_name': 'volume-8cbd1d77-af30-42d3-97ed-53cc29df0c21', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:04 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-93bd4037-aef0-4ec8-beab-7581ea2fe94e tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe658edf-55d7-49cb-bf50-7bf24cef4d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:04 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-93bd4037-aef0-4ec8-beab-7581ea2fe94e tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe658edf-55d7-49cb-bf50-7bf24cef4d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:04 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-93bd4037-aef0-4ec8-beab-7581ea2fe94e tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d857ec6d-5a22-4e47-b987-8809319c5b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:04 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-93bd4037-aef0-4ec8-beab-7581ea2fe94e tempest-CreateVolumesFromSnapshotTest-1164552097 None] Volume 8cbd1d77-af30-42d3-97ed-53cc29df0c21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cbd1d77-af30-42d3-97ed-53cc29df0c21', 'volume_size': 1} Sep 04 22:52:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-93bd4037-aef0-4ec8-beab-7581ea2fe94e tempest-CreateVolumesFromSnapshotTest-1164552097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:52:05 devstack sudo[103204]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-7eb6a23f-6b5a-4898-9e77-771ffe6143a2 tempest-CreateVolumesFromSnapshotTest-1164552097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-ed560e7f-32d2-4cf4-bb3d-54b9a105cba2 1073741824" returned: 0 in 0.783s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-7eb6a23f-6b5a-4898-9e77-771ffe6143a2 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-ed560e7f-32d2-4cf4-bb3d-54b9a105cba2 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:05 devstack sudo[103210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-ed560e7f-32d2-4cf4-bb3d-54b9a105cba2 Sep 04 22:52:05 devstack sudo[103210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:05 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dd93a84-5d12-464e-ad25-111b7670f0d8 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:52:05 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0dd93a84-5d12-464e-ad25-111b7670f0d8 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Flow 'volume_create_manager' (ae11817d-077d-4de0-9ad0-04cb2370dd32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:52:05 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0dd93a84-5d12-464e-ad25-111b7670f0d8 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6934aea7-c832-4231-9fb7-c9281934399b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:05 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0dd93a84-5d12-464e-ad25-111b7670f0d8 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6934aea7-c832-4231-9fb7-c9281934399b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:52:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-169490344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c4e2f28-71d6-4bdc-96e5-a8cb992e0a21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1ceb202c69547779d948bffee611b1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:52:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:52:05Z,use_quota=True,user_id='3b210220cfcd4683816590ba21914e4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:05 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0dd93a84-5d12-464e-ad25-111b7670f0d8 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac9008ee-61d8-4fd9-8d86-7bb9192a2851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:05 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0dd93a84-5d12-464e-ad25-111b7670f0d8 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac9008ee-61d8-4fd9-8d86-7bb9192a2851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:05 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0dd93a84-5d12-464e-ad25-111b7670f0d8 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cf7eec4-fbf3-43cc-b67e-5b7eee82ec99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:05 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0dd93a84-5d12-464e-ad25-111b7670f0d8 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cf7eec4-fbf3-43cc-b67e-5b7eee82ec99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c4e2f28-71d6-4bdc-96e5-a8cb992e0a21', 'volume_name': 'volume-5c4e2f28-71d6-4bdc-96e5-a8cb992e0a21', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:05 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0dd93a84-5d12-464e-ad25-111b7670f0d8 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e7a0e83-1153-4ab8-8616-8d6ad67ce531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:05 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0dd93a84-5d12-464e-ad25-111b7670f0d8 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e7a0e83-1153-4ab8-8616-8d6ad67ce531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:05 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0dd93a84-5d12-464e-ad25-111b7670f0d8 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c82e67a7-f4d9-4a4c-9cf4-ea48873ec61d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:05 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-0dd93a84-5d12-464e-ad25-111b7670f0d8 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Volume 5c4e2f28-71d6-4bdc-96e5-a8cb992e0a21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c4e2f28-71d6-4bdc-96e5-a8cb992e0a21', 'volume_size': 1} Sep 04 22:52:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-0dd93a84-5d12-464e-ad25-111b7670f0d8 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:52:05 devstack sudo[103210]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-7eb6a23f-6b5a-4898-9e77-771ffe6143a2 tempest-CreateVolumesFromSnapshotTest-1164552097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-ed560e7f-32d2-4cf4-bb3d-54b9a105cba2" returned: 0 in 0.369s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:05 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-7eb6a23f-6b5a-4898-9e77-771ffe6143a2 tempest-CreateVolumesFromSnapshotTest-1164552097 None] <== create_volume: return (1231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:52:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-7eb6a23f-6b5a-4898-9e77-771ffe6143a2 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.235s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:52:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-93bd4037-aef0-4ec8-beab-7581ea2fe94e tempest-CreateVolumesFromSnapshotTest-1164552097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.768s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:52:05 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-93bd4037-aef0-4ec8-beab-7581ea2fe94e tempest-CreateVolumesFromSnapshotTest-1164552097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:52:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1809096826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cbd1d77-af30-42d3-97ed-53cc29df0c21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1ceb202c69547779d948bffee611b1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:52:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:52:05Z,use_quota=True,user_id='3b210220cfcd4683816590ba21914e4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:52:05 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-93bd4037-aef0-4ec8-beab-7581ea2fe94e tempest-CreateVolumesFromSnapshotTest-1164552097 None] Creating volume 8cbd1d77-af30-42d3-97ed-53cc29df0c21 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:52:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-93bd4037-aef0-4ec8-beab-7581ea2fe94e tempest-CreateVolumesFromSnapshotTest-1164552097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:52:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-93bd4037-aef0-4ec8-beab-7581ea2fe94e tempest-CreateVolumesFromSnapshotTest-1164552097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:52:05 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-93bd4037-aef0-4ec8-beab-7581ea2fe94e tempest-CreateVolumesFromSnapshotTest-1164552097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:52:05 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-93bd4037-aef0-4ec8-beab-7581ea2fe94e tempest-CreateVolumesFromSnapshotTest-1164552097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:52:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-93bd4037-aef0-4ec8-beab-7581ea2fe94e tempest-CreateVolumesFromSnapshotTest-1164552097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:52:05 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-93bd4037-aef0-4ec8-beab-7581ea2fe94e tempest-CreateVolumesFromSnapshotTest-1164552097 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:52:05 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-93bd4037-aef0-4ec8-beab-7581ea2fe94e tempest-CreateVolumesFromSnapshotTest-1164552097 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:52:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-93bd4037-aef0-4ec8-beab-7581ea2fe94e tempest-CreateVolumesFromSnapshotTest-1164552097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-8cbd1d77-af30-42d3-97ed-53cc29df0c21 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:05 devstack sudo[103213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-8cbd1d77-af30-42d3-97ed-53cc29df0c21 1073741824 Sep 04 22:52:05 devstack sudo[103213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:05 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-7eb6a23f-6b5a-4898-9e77-771ffe6143a2 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26d60274-08bd-468a-aaaa-3ba15003afb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed560e7f-32d2-4cf4-bb3d-54b9a105cba2', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:05 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-7eb6a23f-6b5a-4898-9e77-771ffe6143a2 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13a67b0a-abe5-468c-9648-584df6e35338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:05 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-7eb6a23f-6b5a-4898-9e77-771ffe6143a2 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Volume volume-ed560e7f-32d2-4cf4-bb3d-54b9a105cba2 (ed560e7f-32d2-4cf4-bb3d-54b9a105cba2): created successfully Sep 04 22:52:05 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-7eb6a23f-6b5a-4898-9e77-771ffe6143a2 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13a67b0a-abe5-468c-9648-584df6e35338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:05 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-7eb6a23f-6b5a-4898-9e77-771ffe6143a2 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Flow 'volume_create_manager' (b39b20e8-bb1c-4505-8d3e-0b2b7a640d10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:52:05 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-7eb6a23f-6b5a-4898-9e77-771ffe6143a2 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Created volume successfully. Sep 04 22:52:06 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-47d819a6-9b37-451b-80c7-79d49a54354a tempest-CreateVolumesFromSnapshotTest-1164552097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:52:06 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-47d819a6-9b37-451b-80c7-79d49a54354a tempest-CreateVolumesFromSnapshotTest-1164552097 None] Flow 'volume_create_manager' (ab297643-77ad-48aa-90be-672b3dea0fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:52:06 devstack sudo[103213]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:06 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-47d819a6-9b37-451b-80c7-79d49a54354a tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79b79fec-2189-4e08-9946-e85f3160ae1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-93bd4037-aef0-4ec8-beab-7581ea2fe94e tempest-CreateVolumesFromSnapshotTest-1164552097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-8cbd1d77-af30-42d3-97ed-53cc29df0c21 1073741824" returned: 0 in 0.612s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:06 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-47d819a6-9b37-451b-80c7-79d49a54354a tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79b79fec-2189-4e08-9946-e85f3160ae1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:52:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-926585503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa0d32cd-e524-4514-bdb0-887e5dfab9c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1ceb202c69547779d948bffee611b1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:52:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:52:06Z,use_quota=True,user_id='3b210220cfcd4683816590ba21914e4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:06 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-47d819a6-9b37-451b-80c7-79d49a54354a tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52eaec09-8d48-4a45-8056-2a1ee0e1eb4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:06 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-47d819a6-9b37-451b-80c7-79d49a54354a tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52eaec09-8d48-4a45-8056-2a1ee0e1eb4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:06 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-47d819a6-9b37-451b-80c7-79d49a54354a tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59a03951-ba47-4d1a-ab1c-22b775b8dda9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:06 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-47d819a6-9b37-451b-80c7-79d49a54354a tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59a03951-ba47-4d1a-ab1c-22b775b8dda9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa0d32cd-e524-4514-bdb0-887e5dfab9c3', 'volume_name': 'volume-fa0d32cd-e524-4514-bdb0-887e5dfab9c3', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:06 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-47d819a6-9b37-451b-80c7-79d49a54354a tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44e3ca18-cf10-4e62-b856-84b8270e4a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:06 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-47d819a6-9b37-451b-80c7-79d49a54354a tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44e3ca18-cf10-4e62-b856-84b8270e4a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:06 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-47d819a6-9b37-451b-80c7-79d49a54354a tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccf2ab74-796b-47cb-aa0d-65695fdee86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:06 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-47d819a6-9b37-451b-80c7-79d49a54354a tempest-CreateVolumesFromSnapshotTest-1164552097 None] Volume fa0d32cd-e524-4514-bdb0-887e5dfab9c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa0d32cd-e524-4514-bdb0-887e5dfab9c3', 'volume_size': 1} Sep 04 22:52:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-47d819a6-9b37-451b-80c7-79d49a54354a tempest-CreateVolumesFromSnapshotTest-1164552097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:52:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-93bd4037-aef0-4ec8-beab-7581ea2fe94e tempest-CreateVolumesFromSnapshotTest-1164552097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-8cbd1d77-af30-42d3-97ed-53cc29df0c21 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:06 devstack sudo[103220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-8cbd1d77-af30-42d3-97ed-53cc29df0c21 Sep 04 22:52:06 devstack sudo[103220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:06 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-e727d8e4-37d5-4f5a-9f15-4058626fbee5 tempest-VolumesSnapshotListTestJSON-1583136945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:52:06 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-e727d8e4-37d5-4f5a-9f15-4058626fbee5 tempest-VolumesSnapshotListTestJSON-1583136945 None] Flow 'volume_create_manager' (35057512-c76b-4633-81c7-69abedc18bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:52:06 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-e727d8e4-37d5-4f5a-9f15-4058626fbee5 tempest-VolumesSnapshotListTestJSON-1583136945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd4e88be-ff24-4819-a943-549b78fbc8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:06 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-e727d8e4-37d5-4f5a-9f15-4058626fbee5 tempest-VolumesSnapshotListTestJSON-1583136945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd4e88be-ff24-4819-a943-549b78fbc8b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:52:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1524228764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e482056-bd21-4ada-8e2e-bf9c92fff158,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35d4bedbca5e43049b2bbc0d4bb392e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:52:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:52:06Z,use_quota=True,user_id='d05bdc82d3714b1a8d173a9c3db90f1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:06 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-e727d8e4-37d5-4f5a-9f15-4058626fbee5 tempest-VolumesSnapshotListTestJSON-1583136945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17a09d49-f014-42d3-893b-2f21276c17c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:06 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-e727d8e4-37d5-4f5a-9f15-4058626fbee5 tempest-VolumesSnapshotListTestJSON-1583136945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17a09d49-f014-42d3-893b-2f21276c17c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:06 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-e727d8e4-37d5-4f5a-9f15-4058626fbee5 tempest-VolumesSnapshotListTestJSON-1583136945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba80ace9-5c45-45ae-a0ee-90e5ef8aafee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:06 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-e727d8e4-37d5-4f5a-9f15-4058626fbee5 tempest-VolumesSnapshotListTestJSON-1583136945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba80ace9-5c45-45ae-a0ee-90e5ef8aafee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e482056-bd21-4ada-8e2e-bf9c92fff158', 'volume_name': 'volume-6e482056-bd21-4ada-8e2e-bf9c92fff158', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:06 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-e727d8e4-37d5-4f5a-9f15-4058626fbee5 tempest-VolumesSnapshotListTestJSON-1583136945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fcb5dae-3953-41b9-b50a-00be59820ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:06 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-e727d8e4-37d5-4f5a-9f15-4058626fbee5 tempest-VolumesSnapshotListTestJSON-1583136945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fcb5dae-3953-41b9-b50a-00be59820ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:06 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-e727d8e4-37d5-4f5a-9f15-4058626fbee5 tempest-VolumesSnapshotListTestJSON-1583136945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0603ea9-58b9-401f-8b94-9306f4e32d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:06 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-e727d8e4-37d5-4f5a-9f15-4058626fbee5 tempest-VolumesSnapshotListTestJSON-1583136945 None] Volume 6e482056-bd21-4ada-8e2e-bf9c92fff158: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e482056-bd21-4ada-8e2e-bf9c92fff158', 'volume_size': 1} Sep 04 22:52:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-e727d8e4-37d5-4f5a-9f15-4058626fbee5 tempest-VolumesSnapshotListTestJSON-1583136945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:52:06 devstack sudo[103220]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-93bd4037-aef0-4ec8-beab-7581ea2fe94e tempest-CreateVolumesFromSnapshotTest-1164552097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-8cbd1d77-af30-42d3-97ed-53cc29df0c21" returned: 0 in 0.250s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:06 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-93bd4037-aef0-4ec8-beab-7581ea2fe94e tempest-CreateVolumesFromSnapshotTest-1164552097 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:52:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-93bd4037-aef0-4ec8-beab-7581ea2fe94e tempest-CreateVolumesFromSnapshotTest-1164552097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:52:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-0dd93a84-5d12-464e-ad25-111b7670f0d8 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.077s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:52:06 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-0dd93a84-5d12-464e-ad25-111b7670f0d8 tempest-CreateVolumesFromSnapshotTest-1164552097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:52:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-169490344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c4e2f28-71d6-4bdc-96e5-a8cb992e0a21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1ceb202c69547779d948bffee611b1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:52:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:52:05Z,use_quota=True,user_id='3b210220cfcd4683816590ba21914e4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:52:06 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-0dd93a84-5d12-464e-ad25-111b7670f0d8 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Creating volume 5c4e2f28-71d6-4bdc-96e5-a8cb992e0a21 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:52:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-0dd93a84-5d12-464e-ad25-111b7670f0d8 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:52:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-0dd93a84-5d12-464e-ad25-111b7670f0d8 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:52:06 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-0dd93a84-5d12-464e-ad25-111b7670f0d8 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:52:06 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-0dd93a84-5d12-464e-ad25-111b7670f0d8 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:52:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-0dd93a84-5d12-464e-ad25-111b7670f0d8 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:52:06 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-0dd93a84-5d12-464e-ad25-111b7670f0d8 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:52:06 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-0dd93a84-5d12-464e-ad25-111b7670f0d8 tempest-CreateVolumesFromSnapshotTest-1164552097 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:52:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0dd93a84-5d12-464e-ad25-111b7670f0d8 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5c4e2f28-71d6-4bdc-96e5-a8cb992e0a21 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:06 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-03e68f8a-f4ae-416e-883b-cac7f468adb5 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:52:06 devstack sudo[103223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5c4e2f28-71d6-4bdc-96e5-a8cb992e0a21 1073741824 Sep 04 22:52:06 devstack sudo[103223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:06 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-03e68f8a-f4ae-416e-883b-cac7f468adb5 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Flow 'volume_create_manager' (361bfe68-809a-4dbf-a39a-6ebcf1646e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:52:06 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-03e68f8a-f4ae-416e-883b-cac7f468adb5 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6563591-d975-4723-8a49-8f62311f6a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:06 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-03e68f8a-f4ae-416e-883b-cac7f468adb5 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6563591-d975-4723-8a49-8f62311f6a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:52:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1460547625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2113e05-64b5-4ca5-803b-e3ac9a5fdd0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1ceb202c69547779d948bffee611b1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:52:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:52:07Z,use_quota=True,user_id='3b210220cfcd4683816590ba21914e4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:06 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-03e68f8a-f4ae-416e-883b-cac7f468adb5 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05fc8d26-d442-43e7-9fb4-486cd4e016ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:06 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-03e68f8a-f4ae-416e-883b-cac7f468adb5 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05fc8d26-d442-43e7-9fb4-486cd4e016ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:06 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-03e68f8a-f4ae-416e-883b-cac7f468adb5 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38268642-0032-4f69-8089-b42a9244b926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:06 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-03e68f8a-f4ae-416e-883b-cac7f468adb5 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38268642-0032-4f69-8089-b42a9244b926) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2113e05-64b5-4ca5-803b-e3ac9a5fdd0f', 'volume_name': 'volume-c2113e05-64b5-4ca5-803b-e3ac9a5fdd0f', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:06 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-03e68f8a-f4ae-416e-883b-cac7f468adb5 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1fbc786-7343-4b95-80cf-e86319475b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:06 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-03e68f8a-f4ae-416e-883b-cac7f468adb5 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1fbc786-7343-4b95-80cf-e86319475b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:06 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-03e68f8a-f4ae-416e-883b-cac7f468adb5 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8b0475d-0a13-4991-8f97-1d40419fa66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:06 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-03e68f8a-f4ae-416e-883b-cac7f468adb5 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Volume c2113e05-64b5-4ca5-803b-e3ac9a5fdd0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2113e05-64b5-4ca5-803b-e3ac9a5fdd0f', 'volume_size': 1} Sep 04 22:52:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-03e68f8a-f4ae-416e-883b-cac7f468adb5 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:52:06 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-93bd4037-aef0-4ec8-beab-7581ea2fe94e tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d857ec6d-5a22-4e47-b987-8809319c5b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cbd1d77-af30-42d3-97ed-53cc29df0c21', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:06 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-93bd4037-aef0-4ec8-beab-7581ea2fe94e tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a065b91-455a-4cc5-8c33-6c457e4f5b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:06 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-93bd4037-aef0-4ec8-beab-7581ea2fe94e tempest-CreateVolumesFromSnapshotTest-1164552097 None] Volume volume-8cbd1d77-af30-42d3-97ed-53cc29df0c21 (8cbd1d77-af30-42d3-97ed-53cc29df0c21): created successfully Sep 04 22:52:06 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-93bd4037-aef0-4ec8-beab-7581ea2fe94e tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a065b91-455a-4cc5-8c33-6c457e4f5b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:06 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-93bd4037-aef0-4ec8-beab-7581ea2fe94e tempest-CreateVolumesFromSnapshotTest-1164552097 None] Flow 'volume_create_manager' (b18616ce-570e-42c5-b119-fc475aa0fd09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:52:06 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-93bd4037-aef0-4ec8-beab-7581ea2fe94e tempest-CreateVolumesFromSnapshotTest-1164552097 None] Created volume successfully. Sep 04 22:52:07 devstack sudo[103223]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0dd93a84-5d12-464e-ad25-111b7670f0d8 tempest-CreateVolumesFromSnapshotTest-1164552097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5c4e2f28-71d6-4bdc-96e5-a8cb992e0a21 1073741824" returned: 0 in 0.457s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0dd93a84-5d12-464e-ad25-111b7670f0d8 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5c4e2f28-71d6-4bdc-96e5-a8cb992e0a21 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:07 devstack sudo[103229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5c4e2f28-71d6-4bdc-96e5-a8cb992e0a21 Sep 04 22:52:07 devstack sudo[103229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:07 devstack sudo[103229]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0dd93a84-5d12-464e-ad25-111b7670f0d8 tempest-CreateVolumesFromSnapshotTest-1164552097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5c4e2f28-71d6-4bdc-96e5-a8cb992e0a21" returned: 0 in 0.306s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:07 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-0dd93a84-5d12-464e-ad25-111b7670f0d8 tempest-CreateVolumesFromSnapshotTest-1164552097 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:52:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-0dd93a84-5d12-464e-ad25-111b7670f0d8 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:52:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-47d819a6-9b37-451b-80c7-79d49a54354a tempest-CreateVolumesFromSnapshotTest-1164552097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.093s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:52:07 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-47d819a6-9b37-451b-80c7-79d49a54354a tempest-CreateVolumesFromSnapshotTest-1164552097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:52:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-926585503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa0d32cd-e524-4514-bdb0-887e5dfab9c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1ceb202c69547779d948bffee611b1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:52:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:52:06Z,use_quota=True,user_id='3b210220cfcd4683816590ba21914e4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:52:07 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-47d819a6-9b37-451b-80c7-79d49a54354a tempest-CreateVolumesFromSnapshotTest-1164552097 None] Creating volume fa0d32cd-e524-4514-bdb0-887e5dfab9c3 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:52:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-47d819a6-9b37-451b-80c7-79d49a54354a tempest-CreateVolumesFromSnapshotTest-1164552097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:52:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-47d819a6-9b37-451b-80c7-79d49a54354a tempest-CreateVolumesFromSnapshotTest-1164552097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:52:07 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-47d819a6-9b37-451b-80c7-79d49a54354a tempest-CreateVolumesFromSnapshotTest-1164552097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:52:07 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-47d819a6-9b37-451b-80c7-79d49a54354a tempest-CreateVolumesFromSnapshotTest-1164552097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:52:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-47d819a6-9b37-451b-80c7-79d49a54354a tempest-CreateVolumesFromSnapshotTest-1164552097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:52:07 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-47d819a6-9b37-451b-80c7-79d49a54354a tempest-CreateVolumesFromSnapshotTest-1164552097 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:52:07 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-47d819a6-9b37-451b-80c7-79d49a54354a tempest-CreateVolumesFromSnapshotTest-1164552097 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:52:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-47d819a6-9b37-451b-80c7-79d49a54354a tempest-CreateVolumesFromSnapshotTest-1164552097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fa0d32cd-e524-4514-bdb0-887e5dfab9c3 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:07 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0dd93a84-5d12-464e-ad25-111b7670f0d8 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c82e67a7-f4d9-4a4c-9cf4-ea48873ec61d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c4e2f28-71d6-4bdc-96e5-a8cb992e0a21', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:07 devstack sudo[103232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fa0d32cd-e524-4514-bdb0-887e5dfab9c3 1073741824 Sep 04 22:52:07 devstack sudo[103232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:07 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0dd93a84-5d12-464e-ad25-111b7670f0d8 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf019b48-780f-4b2a-9f8c-17cc20381e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:07 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-0dd93a84-5d12-464e-ad25-111b7670f0d8 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Volume volume-5c4e2f28-71d6-4bdc-96e5-a8cb992e0a21 (5c4e2f28-71d6-4bdc-96e5-a8cb992e0a21): created successfully Sep 04 22:52:07 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0dd93a84-5d12-464e-ad25-111b7670f0d8 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf019b48-780f-4b2a-9f8c-17cc20381e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:07 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0dd93a84-5d12-464e-ad25-111b7670f0d8 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Flow 'volume_create_manager' (ae11817d-077d-4de0-9ad0-04cb2370dd32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:52:07 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-0dd93a84-5d12-464e-ad25-111b7670f0d8 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Created volume successfully. Sep 04 22:52:07 devstack sudo[103232]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-47d819a6-9b37-451b-80c7-79d49a54354a tempest-CreateVolumesFromSnapshotTest-1164552097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fa0d32cd-e524-4514-bdb0-887e5dfab9c3 1073741824" returned: 0 in 0.440s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-47d819a6-9b37-451b-80c7-79d49a54354a tempest-CreateVolumesFromSnapshotTest-1164552097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fa0d32cd-e524-4514-bdb0-887e5dfab9c3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:08 devstack sudo[103238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fa0d32cd-e524-4514-bdb0-887e5dfab9c3 Sep 04 22:52:08 devstack sudo[103238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:08 devstack sudo[103238]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-47d819a6-9b37-451b-80c7-79d49a54354a tempest-CreateVolumesFromSnapshotTest-1164552097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fa0d32cd-e524-4514-bdb0-887e5dfab9c3" returned: 0 in 0.270s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:08 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-47d819a6-9b37-451b-80c7-79d49a54354a tempest-CreateVolumesFromSnapshotTest-1164552097 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:52:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-47d819a6-9b37-451b-80c7-79d49a54354a tempest-CreateVolumesFromSnapshotTest-1164552097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:52:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-e727d8e4-37d5-4f5a-9f15-4058626fbee5 tempest-VolumesSnapshotListTestJSON-1583136945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.582s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:52:08 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-e727d8e4-37d5-4f5a-9f15-4058626fbee5 tempest-VolumesSnapshotListTestJSON-1583136945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:52:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1524228764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e482056-bd21-4ada-8e2e-bf9c92fff158,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35d4bedbca5e43049b2bbc0d4bb392e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:52:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:52:06Z,use_quota=True,user_id='d05bdc82d3714b1a8d173a9c3db90f1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:52:08 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-e727d8e4-37d5-4f5a-9f15-4058626fbee5 tempest-VolumesSnapshotListTestJSON-1583136945 None] Creating volume 6e482056-bd21-4ada-8e2e-bf9c92fff158 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:52:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-e727d8e4-37d5-4f5a-9f15-4058626fbee5 tempest-VolumesSnapshotListTestJSON-1583136945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:52:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-e727d8e4-37d5-4f5a-9f15-4058626fbee5 tempest-VolumesSnapshotListTestJSON-1583136945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:52:08 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-e727d8e4-37d5-4f5a-9f15-4058626fbee5 tempest-VolumesSnapshotListTestJSON-1583136945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:52:08 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-e727d8e4-37d5-4f5a-9f15-4058626fbee5 tempest-VolumesSnapshotListTestJSON-1583136945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:52:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-e727d8e4-37d5-4f5a-9f15-4058626fbee5 tempest-VolumesSnapshotListTestJSON-1583136945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:52:08 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-e727d8e4-37d5-4f5a-9f15-4058626fbee5 tempest-VolumesSnapshotListTestJSON-1583136945 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:52:08 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-e727d8e4-37d5-4f5a-9f15-4058626fbee5 tempest-VolumesSnapshotListTestJSON-1583136945 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:52:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e727d8e4-37d5-4f5a-9f15-4058626fbee5 tempest-VolumesSnapshotListTestJSON-1583136945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:08 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-47d819a6-9b37-451b-80c7-79d49a54354a tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccf2ab74-796b-47cb-aa0d-65695fdee86b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa0d32cd-e524-4514-bdb0-887e5dfab9c3', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:08 devstack sudo[103241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158 1073741824 Sep 04 22:52:08 devstack sudo[103241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:08 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-47d819a6-9b37-451b-80c7-79d49a54354a tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54d79101-078a-4da3-8b5c-73b08a8a48c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:08 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-47d819a6-9b37-451b-80c7-79d49a54354a tempest-CreateVolumesFromSnapshotTest-1164552097 None] Volume volume-fa0d32cd-e524-4514-bdb0-887e5dfab9c3 (fa0d32cd-e524-4514-bdb0-887e5dfab9c3): created successfully Sep 04 22:52:08 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-47d819a6-9b37-451b-80c7-79d49a54354a tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54d79101-078a-4da3-8b5c-73b08a8a48c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:08 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-47d819a6-9b37-451b-80c7-79d49a54354a tempest-CreateVolumesFromSnapshotTest-1164552097 None] Flow 'volume_create_manager' (ab297643-77ad-48aa-90be-672b3dea0fcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:52:08 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-47d819a6-9b37-451b-80c7-79d49a54354a tempest-CreateVolumesFromSnapshotTest-1164552097 None] Created volume successfully. Sep 04 22:52:08 devstack sudo[103241]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e727d8e4-37d5-4f5a-9f15-4058626fbee5 tempest-VolumesSnapshotListTestJSON-1583136945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158 1073741824" returned: 0 in 0.467s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e727d8e4-37d5-4f5a-9f15-4058626fbee5 tempest-VolumesSnapshotListTestJSON-1583136945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:08 devstack sudo[103247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158 Sep 04 22:52:08 devstack sudo[103247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:09 devstack sudo[103247]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e727d8e4-37d5-4f5a-9f15-4058626fbee5 tempest-VolumesSnapshotListTestJSON-1583136945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158" returned: 0 in 0.249s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:09 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-e727d8e4-37d5-4f5a-9f15-4058626fbee5 tempest-VolumesSnapshotListTestJSON-1583136945 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:52:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-e727d8e4-37d5-4f5a-9f15-4058626fbee5 tempest-VolumesSnapshotListTestJSON-1583136945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:52:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-03e68f8a-f4ae-416e-883b-cac7f468adb5 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.232s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:52:09 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-03e68f8a-f4ae-416e-883b-cac7f468adb5 tempest-CreateVolumesFromSnapshotTest-1164552097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:52:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1460547625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2113e05-64b5-4ca5-803b-e3ac9a5fdd0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1ceb202c69547779d948bffee611b1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:52:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:52:07Z,use_quota=True,user_id='3b210220cfcd4683816590ba21914e4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:52:09 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-03e68f8a-f4ae-416e-883b-cac7f468adb5 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Creating volume c2113e05-64b5-4ca5-803b-e3ac9a5fdd0f {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:52:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-03e68f8a-f4ae-416e-883b-cac7f468adb5 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:52:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-03e68f8a-f4ae-416e-883b-cac7f468adb5 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:52:09 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-03e68f8a-f4ae-416e-883b-cac7f468adb5 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:52:09 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-03e68f8a-f4ae-416e-883b-cac7f468adb5 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:52:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-03e68f8a-f4ae-416e-883b-cac7f468adb5 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:52:09 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-03e68f8a-f4ae-416e-883b-cac7f468adb5 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:52:09 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-03e68f8a-f4ae-416e-883b-cac7f468adb5 tempest-CreateVolumesFromSnapshotTest-1164552097 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:52:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-03e68f8a-f4ae-416e-883b-cac7f468adb5 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c2113e05-64b5-4ca5-803b-e3ac9a5fdd0f 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:09 devstack cinder-volume[87576]: DEBUG dbcounter [-] [87576] Writing DB stats cinder:SELECT=136,cinder:UPDATE=161,cinder:INSERT=48,cinder:DELETE=15 {{(pid=87576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 22:52:09 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-e727d8e4-37d5-4f5a-9f15-4058626fbee5 tempest-VolumesSnapshotListTestJSON-1583136945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0603ea9-58b9-401f-8b94-9306f4e32d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e482056-bd21-4ada-8e2e-bf9c92fff158', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:09 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-e727d8e4-37d5-4f5a-9f15-4058626fbee5 tempest-VolumesSnapshotListTestJSON-1583136945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feac7bb1-aace-48ea-930d-bbaa74b85470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:09 devstack cinder-volume[87576]: DEBUG dbcounter [-] [87576] Writing DB stats cinder:SELECT=167,cinder:UPDATE=171,cinder:INSERT=34,cinder:DELETE=13 {{(pid=87576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 22:52:09 devstack sudo[103250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c2113e05-64b5-4ca5-803b-e3ac9a5fdd0f 1073741824 Sep 04 22:52:09 devstack sudo[103250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:09 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-e727d8e4-37d5-4f5a-9f15-4058626fbee5 tempest-VolumesSnapshotListTestJSON-1583136945 None] Volume volume-6e482056-bd21-4ada-8e2e-bf9c92fff158 (6e482056-bd21-4ada-8e2e-bf9c92fff158): created successfully Sep 04 22:52:09 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-e727d8e4-37d5-4f5a-9f15-4058626fbee5 tempest-VolumesSnapshotListTestJSON-1583136945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feac7bb1-aace-48ea-930d-bbaa74b85470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:09 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-e727d8e4-37d5-4f5a-9f15-4058626fbee5 tempest-VolumesSnapshotListTestJSON-1583136945 None] Flow 'volume_create_manager' (35057512-c76b-4633-81c7-69abedc18bd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:52:09 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-e727d8e4-37d5-4f5a-9f15-4058626fbee5 tempest-VolumesSnapshotListTestJSON-1583136945 None] Created volume successfully. Sep 04 22:52:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-86411532-cf2e-4eb0-8feb-4fdcfdc19e46 tempest-VolumesSnapshotListTestJSON-1583136945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:52:09 devstack sudo[103250]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-03e68f8a-f4ae-416e-883b-cac7f468adb5 tempest-CreateVolumesFromSnapshotTest-1164552097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c2113e05-64b5-4ca5-803b-e3ac9a5fdd0f 1073741824" returned: 0 in 0.541s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-03e68f8a-f4ae-416e-883b-cac7f468adb5 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c2113e05-64b5-4ca5-803b-e3ac9a5fdd0f {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:09 devstack sudo[103256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c2113e05-64b5-4ca5-803b-e3ac9a5fdd0f Sep 04 22:52:09 devstack sudo[103256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:09 devstack sudo[103256]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-03e68f8a-f4ae-416e-883b-cac7f468adb5 tempest-CreateVolumesFromSnapshotTest-1164552097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c2113e05-64b5-4ca5-803b-e3ac9a5fdd0f" returned: 0 in 0.273s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:09 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-03e68f8a-f4ae-416e-883b-cac7f468adb5 tempest-CreateVolumesFromSnapshotTest-1164552097 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:52:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-03e68f8a-f4ae-416e-883b-cac7f468adb5 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:52:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-86411532-cf2e-4eb0-8feb-4fdcfdc19e46 tempest-VolumesSnapshotListTestJSON-1583136945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.401s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:52:09 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-03e68f8a-f4ae-416e-883b-cac7f468adb5 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8b0475d-0a13-4991-8f97-1d40419fa66a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2113e05-64b5-4ca5-803b-e3ac9a5fdd0f', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:09 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-03e68f8a-f4ae-416e-883b-cac7f468adb5 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb19efa8-b895-40a1-8e77-e7ca016ec253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:09 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-86411532-cf2e-4eb0-8feb-4fdcfdc19e46 tempest-VolumesSnapshotListTestJSON-1583136945 None] Creating offline snapshot afa48c77-cb1e-4812-a6fe-d777557ddf08 of volume 6e482056-bd21-4ada-8e2e-bf9c92fff158 {{(pid=87576) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 22:52:09 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-03e68f8a-f4ae-416e-883b-cac7f468adb5 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Volume volume-c2113e05-64b5-4ca5-803b-e3ac9a5fdd0f (c2113e05-64b5-4ca5-803b-e3ac9a5fdd0f): created successfully Sep 04 22:52:09 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-03e68f8a-f4ae-416e-883b-cac7f468adb5 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb19efa8-b895-40a1-8e77-e7ca016ec253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:10 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-03e68f8a-f4ae-416e-883b-cac7f468adb5 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Flow 'volume_create_manager' (361bfe68-809a-4dbf-a39a-6ebcf1646e11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:52:10 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[fddecc03-4ffc-4efc-90f9-20274416be54]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:52:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-86411532-cf2e-4eb0-8feb-4fdcfdc19e46 tempest-VolumesSnapshotListTestJSON-1583136945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:10 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-03e68f8a-f4ae-416e-883b-cac7f468adb5 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Created volume successfully. Sep 04 22:52:10 devstack sudo[103259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158 Sep 04 22:52:10 devstack sudo[103259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:10 devstack sudo[103259]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-86411532-cf2e-4eb0-8feb-4fdcfdc19e46 tempest-VolumesSnapshotListTestJSON-1583136945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158" returned: 0 in 0.400s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-86411532-cf2e-4eb0-8feb-4fdcfdc19e46 tempest-VolumesSnapshotListTestJSON-1583136945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.afa48c77-cb1e-4812-a6fe-d777557ddf08 1G {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:10 devstack sudo[103264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.afa48c77-cb1e-4812-a6fe-d777557ddf08 1G Sep 04 22:52:10 devstack sudo[103264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:10 devstack sudo[103264]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-86411532-cf2e-4eb0-8feb-4fdcfdc19e46 tempest-VolumesSnapshotListTestJSON-1583136945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.afa48c77-cb1e-4812-a6fe-d777557ddf08 1G" returned: 0 in 0.389s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-86411532-cf2e-4eb0-8feb-4fdcfdc19e46 tempest-VolumesSnapshotListTestJSON-1583136945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e482056-bd21-4ada-8e2e-bf9c92fff158 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.afa48c77-cb1e-4812-a6fe-d777557ddf08 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:10 devstack sudo[103270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e482056-bd21-4ada-8e2e-bf9c92fff158 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.afa48c77-cb1e-4812-a6fe-d777557ddf08 Sep 04 22:52:10 devstack sudo[103270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:11 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-8c65deda-829d-49f4-9a70-6f254fdff354 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Acquiring lock "cinder-c2113e05-64b5-4ca5-803b-e3ac9a5fdd0f-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:52:11 devstack sudo[103270]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-86411532-cf2e-4eb0-8feb-4fdcfdc19e46 tempest-VolumesSnapshotListTestJSON-1583136945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e482056-bd21-4ada-8e2e-bf9c92fff158 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.afa48c77-cb1e-4812-a6fe-d777557ddf08" returned: 0 in 0.309s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:11 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-86411532-cf2e-4eb0-8feb-4fdcfdc19e46 tempest-VolumesSnapshotListTestJSON-1583136945 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.afa48c77-cb1e-4812-a6fe-d777557ddf08 is being set with open permissions: ugo+rw Sep 04 22:52:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-86411532-cf2e-4eb0-8feb-4fdcfdc19e46 tempest-VolumesSnapshotListTestJSON-1583136945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.afa48c77-cb1e-4812-a6fe-d777557ddf08 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:11 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-8c65deda-829d-49f4-9a70-6f254fdff354 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Lock "cinder-c2113e05-64b5-4ca5-803b-e3ac9a5fdd0f-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:52:11 devstack sudo[103275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.afa48c77-cb1e-4812-a6fe-d777557ddf08 Sep 04 22:52:11 devstack sudo[103275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:11 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-8c65deda-829d-49f4-9a70-6f254fdff354 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Acquiring lock "cinder-quobyte-c2113e05-64b5-4ca5-803b-e3ac9a5fdd0f" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:52:11 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-8c65deda-829d-49f4-9a70-6f254fdff354 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Lock "cinder-quobyte-c2113e05-64b5-4ca5-803b-e3ac9a5fdd0f" acquired by "delete_volume" :: waited 0.016s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:52:11 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f97c1f-c7bb-42a4-b395-0389b41a54e3]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:52:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-8c65deda-829d-49f4-9a70-6f254fdff354 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c2113e05-64b5-4ca5-803b-e3ac9a5fdd0f {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:11 devstack sudo[103277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c2113e05-64b5-4ca5-803b-e3ac9a5fdd0f Sep 04 22:52:11 devstack sudo[103277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:11 devstack sudo[103275]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-86411532-cf2e-4eb0-8feb-4fdcfdc19e46 tempest-VolumesSnapshotListTestJSON-1583136945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.afa48c77-cb1e-4812-a6fe-d777557ddf08" returned: 0 in 0.277s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-86411532-cf2e-4eb0-8feb-4fdcfdc19e46 tempest-VolumesSnapshotListTestJSON-1583136945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:11 devstack sudo[103280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.info Sep 04 22:52:11 devstack sudo[103280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:11 devstack sudo[103277]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-8c65deda-829d-49f4-9a70-6f254fdff354 tempest-CreateVolumesFromSnapshotTest-1164552097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c2113e05-64b5-4ca5-803b-e3ac9a5fdd0f" returned: 0 in 0.422s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-8c65deda-829d-49f4-9a70-6f254fdff354 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c2113e05-64b5-4ca5-803b-e3ac9a5fdd0f {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:11 devstack sudo[103286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c2113e05-64b5-4ca5-803b-e3ac9a5fdd0f Sep 04 22:52:11 devstack sudo[103286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:11 devstack sudo[103280]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-86411532-cf2e-4eb0-8feb-4fdcfdc19e46 tempest-VolumesSnapshotListTestJSON-1583136945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.info" returned: 0 in 0.260s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:11 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-86411532-cf2e-4eb0-8feb-4fdcfdc19e46 tempest-VolumesSnapshotListTestJSON-1583136945 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.info is being set with open permissions: ugo+rw Sep 04 22:52:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-86411532-cf2e-4eb0-8feb-4fdcfdc19e46 tempest-VolumesSnapshotListTestJSON-1583136945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:11 devstack sudo[103288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.info Sep 04 22:52:11 devstack sudo[103288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:11 devstack cinder-volume[87576]: DEBUG oslo_service.periodic_task [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87576) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 22:52:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:52:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:52:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:52:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:52:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:52:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:11 devstack sudo[103290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:52:11 devstack sudo[103290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:11 devstack sudo[103286]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-8c65deda-829d-49f4-9a70-6f254fdff354 tempest-CreateVolumesFromSnapshotTest-1164552097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c2113e05-64b5-4ca5-803b-e3ac9a5fdd0f" returned: 0 in 0.282s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:11 devstack sudo[103288]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:11 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-8c65deda-829d-49f4-9a70-6f254fdff354 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Lock "cinder-quobyte-c2113e05-64b5-4ca5-803b-e3ac9a5fdd0f" released by "delete_volume" :: held 0.761s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:52:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-86411532-cf2e-4eb0-8feb-4fdcfdc19e46 tempest-VolumesSnapshotListTestJSON-1583136945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.info" returned: 0 in 0.261s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-86411532-cf2e-4eb0-8feb-4fdcfdc19e46 tempest-VolumesSnapshotListTestJSON-1583136945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.023s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:52:12 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-86411532-cf2e-4eb0-8feb-4fdcfdc19e46 tempest-VolumesSnapshotListTestJSON-1583136945 None] Create snapshot completed successfully Sep 04 22:52:12 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-8c65deda-829d-49f4-9a70-6f254fdff354 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Created reservations ['76c7bb2c-9b9f-47b3-8823-1c18f89e19d2', 'f1e6cc83-55cc-4253-a796-038c560f7dd0', '95f1eda8-688b-43a1-95bb-95ed394eb976', '24d88621-2ba1-4b1f-a23d-30ebdd03a0a0'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:52:12 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-dc252bf3-665f-476d-ae1e-1aab0e3e6330 tempest-BackendsCapabilitiesAdminTestsJSON-1952969762 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7158851623535, 'free_capacity_gb': 1773.7158851623535, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87576) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 04 22:52:12 devstack sudo[103290]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.288s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:12 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:52:12 devstack cinder-volume[87576]: DEBUG oslo_service.periodic_task [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Running periodic task VolumeManager._thread_info {{(pid=87576) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 22:52:12 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] thread count: 28 {{(pid=87576) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 22:52:12 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] thread info: [<_MainThread(MainThread, started 125730416963712)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87576) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 22:52:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-8c65deda-829d-49f4-9a70-6f254fdff354 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:52:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-8c65deda-829d-49f4-9a70-6f254fdff354 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:52:12 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-8c65deda-829d-49f4-9a70-6f254fdff354 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:52:12 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-8c65deda-829d-49f4-9a70-6f254fdff354 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:52:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-8c65deda-829d-49f4-9a70-6f254fdff354 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:52:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-8c65deda-829d-49f4-9a70-6f254fdff354 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:12 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-14c87eba-a8fe-473f-bfd7-9ac7280c8458 tempest-BackendsCapabilitiesAdminTestsJSON-1952969762 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7158851623535, 'free_capacity_gb': 1773.7158851623535, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87576) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 04 22:52:12 devstack sudo[103295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:52:12 devstack sudo[103295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:12 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c1692c51-d762-4a13-9091-492d4e5c9b78 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Acquiring lock "cinder-fa0d32cd-e524-4514-bdb0-887e5dfab9c3-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:52:12 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c1692c51-d762-4a13-9091-492d4e5c9b78 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Lock "cinder-fa0d32cd-e524-4514-bdb0-887e5dfab9c3-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:52:12 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c1692c51-d762-4a13-9091-492d4e5c9b78 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Acquiring lock "cinder-quobyte-fa0d32cd-e524-4514-bdb0-887e5dfab9c3" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:52:12 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c1692c51-d762-4a13-9091-492d4e5c9b78 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Lock "cinder-quobyte-fa0d32cd-e524-4514-bdb0-887e5dfab9c3" acquired by "delete_volume" :: waited 0.017s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:52:12 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b7cbbf-c9b9-4ee4-93e7-5197ee8f87fa]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:52:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c1692c51-d762-4a13-9091-492d4e5c9b78 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fa0d32cd-e524-4514-bdb0-887e5dfab9c3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:12 devstack sudo[103295]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-8c65deda-829d-49f4-9a70-6f254fdff354 tempest-CreateVolumesFromSnapshotTest-1164552097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.274s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:12 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-8c65deda-829d-49f4-9a70-6f254fdff354 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:52:12 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-8c65deda-829d-49f4-9a70-6f254fdff354 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Deleted volume successfully. Sep 04 22:52:12 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-8c65deda-829d-49f4-9a70-6f254fdff354 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Lock "cinder-c2113e05-64b5-4ca5-803b-e3ac9a5fdd0f-delete_volume" released by "delete_volume" :: held 1.345s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:52:12 devstack sudo[103298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fa0d32cd-e524-4514-bdb0-887e5dfab9c3 Sep 04 22:52:12 devstack sudo[103298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:12 devstack sudo[103298]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c1692c51-d762-4a13-9091-492d4e5c9b78 tempest-CreateVolumesFromSnapshotTest-1164552097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fa0d32cd-e524-4514-bdb0-887e5dfab9c3" returned: 0 in 0.418s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c1692c51-d762-4a13-9091-492d4e5c9b78 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fa0d32cd-e524-4514-bdb0-887e5dfab9c3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:12 devstack sudo[103303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fa0d32cd-e524-4514-bdb0-887e5dfab9c3 Sep 04 22:52:12 devstack sudo[103303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-efd9c262-baf1-4e11-a747-370b7467ce66 tempest-VolumesSnapshotListTestJSON-1583136945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:52:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-efd9c262-baf1-4e11-a747-370b7467ce66 tempest-VolumesSnapshotListTestJSON-1583136945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:52:12 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-efd9c262-baf1-4e11-a747-370b7467ce66 tempest-VolumesSnapshotListTestJSON-1583136945 None] Creating offline snapshot 9fd00b1d-1bdf-4b60-b650-6e59a4c8a60f of volume 6e482056-bd21-4ada-8e2e-bf9c92fff158 {{(pid=87576) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 22:52:12 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad2e3b9-ff8e-4ecd-8555-865939067bfa]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:52:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-efd9c262-baf1-4e11-a747-370b7467ce66 tempest-VolumesSnapshotListTestJSON-1583136945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.afa48c77-cb1e-4812-a6fe-d777557ddf08 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:13 devstack sudo[103306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.afa48c77-cb1e-4812-a6fe-d777557ddf08 Sep 04 22:52:13 devstack sudo[103306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:13 devstack sudo[103303]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c1692c51-d762-4a13-9091-492d4e5c9b78 tempest-CreateVolumesFromSnapshotTest-1164552097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fa0d32cd-e524-4514-bdb0-887e5dfab9c3" returned: 0 in 0.286s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:13 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c1692c51-d762-4a13-9091-492d4e5c9b78 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Lock "cinder-quobyte-fa0d32cd-e524-4514-bdb0-887e5dfab9c3" released by "delete_volume" :: held 0.751s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:52:13 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-c1692c51-d762-4a13-9091-492d4e5c9b78 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Created reservations ['a2d3a363-2128-40ff-8e7f-1bda076fe961', 'f354ebb2-cbc6-4874-9625-53897fa179b8', 'b01cbf7d-7c90-418e-92b9-c5461a0bce5a', '53ce24eb-a911-4313-b726-e592208f92c7'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:52:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-c1692c51-d762-4a13-9091-492d4e5c9b78 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:52:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-c1692c51-d762-4a13-9091-492d4e5c9b78 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:52:13 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-c1692c51-d762-4a13-9091-492d4e5c9b78 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:52:13 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-c1692c51-d762-4a13-9091-492d4e5c9b78 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:52:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-c1692c51-d762-4a13-9091-492d4e5c9b78 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:52:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c1692c51-d762-4a13-9091-492d4e5c9b78 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:13 devstack sudo[103311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:52:13 devstack sudo[103311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:13 devstack sudo[103306]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-efd9c262-baf1-4e11-a747-370b7467ce66 tempest-VolumesSnapshotListTestJSON-1583136945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.afa48c77-cb1e-4812-a6fe-d777557ddf08" returned: 0 in 0.401s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:13 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-efd9c262-baf1-4e11-a747-370b7467ce66 tempest-VolumesSnapshotListTestJSON-1583136945 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e482056-bd21-4ada-8e2e-bf9c92fff158(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 22:52:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-efd9c262-baf1-4e11-a747-370b7467ce66 tempest-VolumesSnapshotListTestJSON-1583136945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.afa48c77-cb1e-4812-a6fe-d777557ddf08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.9fd00b1d-1bdf-4b60-b650-6e59a4c8a60f 1G {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:13 devstack sudo[103315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.afa48c77-cb1e-4812-a6fe-d777557ddf08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.9fd00b1d-1bdf-4b60-b650-6e59a4c8a60f 1G Sep 04 22:52:13 devstack sudo[103315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:13 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-45d7b4b6-679d-451a-9330-b30d32217d60 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Acquiring lock "cinder-5c4e2f28-71d6-4bdc-96e5-a8cb992e0a21-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:52:13 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-45d7b4b6-679d-451a-9330-b30d32217d60 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Lock "cinder-5c4e2f28-71d6-4bdc-96e5-a8cb992e0a21-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:52:13 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-45d7b4b6-679d-451a-9330-b30d32217d60 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Acquiring lock "cinder-quobyte-5c4e2f28-71d6-4bdc-96e5-a8cb992e0a21" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:52:13 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-45d7b4b6-679d-451a-9330-b30d32217d60 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Lock "cinder-quobyte-5c4e2f28-71d6-4bdc-96e5-a8cb992e0a21" acquired by "delete_volume" :: waited 0.021s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:52:13 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c34af01-ebf8-45de-84cc-fe502083e1e8]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:52:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-45d7b4b6-679d-451a-9330-b30d32217d60 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5c4e2f28-71d6-4bdc-96e5-a8cb992e0a21 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:13 devstack sudo[103311]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c1692c51-d762-4a13-9091-492d4e5c9b78 tempest-CreateVolumesFromSnapshotTest-1164552097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.346s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:13 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-c1692c51-d762-4a13-9091-492d4e5c9b78 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:52:13 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-c1692c51-d762-4a13-9091-492d4e5c9b78 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Deleted volume successfully. Sep 04 22:52:13 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c1692c51-d762-4a13-9091-492d4e5c9b78 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Lock "cinder-fa0d32cd-e524-4514-bdb0-887e5dfab9c3-delete_volume" released by "delete_volume" :: held 1.332s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:52:13 devstack sudo[103318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5c4e2f28-71d6-4bdc-96e5-a8cb992e0a21 Sep 04 22:52:13 devstack sudo[103318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:13 devstack sudo[103315]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-efd9c262-baf1-4e11-a747-370b7467ce66 tempest-VolumesSnapshotListTestJSON-1583136945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.afa48c77-cb1e-4812-a6fe-d777557ddf08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.9fd00b1d-1bdf-4b60-b650-6e59a4c8a60f 1G" returned: 0 in 0.614s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-efd9c262-baf1-4e11-a747-370b7467ce66 tempest-VolumesSnapshotListTestJSON-1583136945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.afa48c77-cb1e-4812-a6fe-d777557ddf08 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.9fd00b1d-1bdf-4b60-b650-6e59a4c8a60f {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:14 devstack sudo[103318]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:14 devstack sudo[103327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.afa48c77-cb1e-4812-a6fe-d777557ddf08 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.9fd00b1d-1bdf-4b60-b650-6e59a4c8a60f Sep 04 22:52:14 devstack sudo[103327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-45d7b4b6-679d-451a-9330-b30d32217d60 tempest-CreateVolumesFromSnapshotTest-1164552097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5c4e2f28-71d6-4bdc-96e5-a8cb992e0a21" returned: 0 in 0.432s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-45d7b4b6-679d-451a-9330-b30d32217d60 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5c4e2f28-71d6-4bdc-96e5-a8cb992e0a21 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:14 devstack sudo[103329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5c4e2f28-71d6-4bdc-96e5-a8cb992e0a21 Sep 04 22:52:14 devstack sudo[103329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:14 devstack sudo[103329]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-45d7b4b6-679d-451a-9330-b30d32217d60 tempest-CreateVolumesFromSnapshotTest-1164552097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5c4e2f28-71d6-4bdc-96e5-a8cb992e0a21" returned: 0 in 0.276s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:14 devstack sudo[103327]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-efd9c262-baf1-4e11-a747-370b7467ce66 tempest-VolumesSnapshotListTestJSON-1583136945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.afa48c77-cb1e-4812-a6fe-d777557ddf08 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.9fd00b1d-1bdf-4b60-b650-6e59a4c8a60f" returned: 0 in 0.324s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:14 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-efd9c262-baf1-4e11-a747-370b7467ce66 tempest-VolumesSnapshotListTestJSON-1583136945 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.9fd00b1d-1bdf-4b60-b650-6e59a4c8a60f is being set with open permissions: ugo+rw Sep 04 22:52:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-efd9c262-baf1-4e11-a747-370b7467ce66 tempest-VolumesSnapshotListTestJSON-1583136945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.9fd00b1d-1bdf-4b60-b650-6e59a4c8a60f {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:14 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-45d7b4b6-679d-451a-9330-b30d32217d60 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Lock "cinder-quobyte-5c4e2f28-71d6-4bdc-96e5-a8cb992e0a21" released by "delete_volume" :: held 0.772s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:52:14 devstack sudo[103335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.9fd00b1d-1bdf-4b60-b650-6e59a4c8a60f Sep 04 22:52:14 devstack sudo[103335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:14 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-45d7b4b6-679d-451a-9330-b30d32217d60 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Created reservations ['96ba5e59-c77b-493d-984a-a4d363eab392', '2976458a-3e97-469a-9c97-1f6037b97f84', '33d1a0e1-54f1-420c-a239-2113809be7bb', 'b5b5ac80-cead-46ae-8859-fe88d14405b6'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:52:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-45d7b4b6-679d-451a-9330-b30d32217d60 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:52:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-45d7b4b6-679d-451a-9330-b30d32217d60 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:52:14 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-45d7b4b6-679d-451a-9330-b30d32217d60 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:52:14 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-45d7b4b6-679d-451a-9330-b30d32217d60 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:52:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-45d7b4b6-679d-451a-9330-b30d32217d60 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:52:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-45d7b4b6-679d-451a-9330-b30d32217d60 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:14 devstack sudo[103337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:52:14 devstack sudo[103337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:14 devstack sudo[103335]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-efd9c262-baf1-4e11-a747-370b7467ce66 tempest-VolumesSnapshotListTestJSON-1583136945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.9fd00b1d-1bdf-4b60-b650-6e59a4c8a60f" returned: 0 in 0.295s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-efd9c262-baf1-4e11-a747-370b7467ce66 tempest-VolumesSnapshotListTestJSON-1583136945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.773s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:52:14 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-af9d976d-52e0-4066-b769-075fdbd6c91c tempest-CreateVolumesFromSnapshotTest-1164552097 None] Acquiring lock "cinder-8cbd1d77-af30-42d3-97ed-53cc29df0c21-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:52:14 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-af9d976d-52e0-4066-b769-075fdbd6c91c tempest-CreateVolumesFromSnapshotTest-1164552097 None] Lock "cinder-8cbd1d77-af30-42d3-97ed-53cc29df0c21-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:52:14 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-efd9c262-baf1-4e11-a747-370b7467ce66 tempest-VolumesSnapshotListTestJSON-1583136945 None] Create snapshot completed successfully Sep 04 22:52:14 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-af9d976d-52e0-4066-b769-075fdbd6c91c tempest-CreateVolumesFromSnapshotTest-1164552097 None] Acquiring lock "cinder-quobyte-8cbd1d77-af30-42d3-97ed-53cc29df0c21" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:52:14 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-af9d976d-52e0-4066-b769-075fdbd6c91c tempest-CreateVolumesFromSnapshotTest-1164552097 None] Lock "cinder-quobyte-8cbd1d77-af30-42d3-97ed-53cc29df0c21" acquired by "delete_volume" :: waited 0.018s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:52:14 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[78814def-271b-41bc-ad8f-6c51c3c245bf]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:52:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-af9d976d-52e0-4066-b769-075fdbd6c91c tempest-CreateVolumesFromSnapshotTest-1164552097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-8cbd1d77-af30-42d3-97ed-53cc29df0c21 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:14 devstack sudo[103337]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-45d7b4b6-679d-451a-9330-b30d32217d60 tempest-CreateVolumesFromSnapshotTest-1164552097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.336s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:14 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-45d7b4b6-679d-451a-9330-b30d32217d60 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:52:14 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-45d7b4b6-679d-451a-9330-b30d32217d60 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Deleted volume successfully. Sep 04 22:52:14 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-45d7b4b6-679d-451a-9330-b30d32217d60 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Lock "cinder-5c4e2f28-71d6-4bdc-96e5-a8cb992e0a21-delete_volume" released by "delete_volume" :: held 1.382s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:52:14 devstack sudo[103341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-8cbd1d77-af30-42d3-97ed-53cc29df0c21 Sep 04 22:52:14 devstack sudo[103341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-5c59f015-dd8e-438d-a3ae-8fc94cf86614 tempest-VolumesSnapshotListTestJSON-1583136945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:52:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-5c59f015-dd8e-438d-a3ae-8fc94cf86614 tempest-VolumesSnapshotListTestJSON-1583136945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:52:15 devstack sudo[103341]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:15 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-5c59f015-dd8e-438d-a3ae-8fc94cf86614 tempest-VolumesSnapshotListTestJSON-1583136945 None] Creating offline snapshot e245b56f-1655-4a63-9fb6-8d4b92e64ef1 of volume 6e482056-bd21-4ada-8e2e-bf9c92fff158 {{(pid=87576) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 22:52:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-af9d976d-52e0-4066-b769-075fdbd6c91c tempest-CreateVolumesFromSnapshotTest-1164552097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-8cbd1d77-af30-42d3-97ed-53cc29df0c21" returned: 0 in 0.515s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-af9d976d-52e0-4066-b769-075fdbd6c91c tempest-CreateVolumesFromSnapshotTest-1164552097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-8cbd1d77-af30-42d3-97ed-53cc29df0c21 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:15 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b8f4a1-d548-436b-822c-ffe375189be2]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:52:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5c59f015-dd8e-438d-a3ae-8fc94cf86614 tempest-VolumesSnapshotListTestJSON-1583136945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.9fd00b1d-1bdf-4b60-b650-6e59a4c8a60f {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:15 devstack sudo[103346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-8cbd1d77-af30-42d3-97ed-53cc29df0c21 Sep 04 22:52:15 devstack sudo[103346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:15 devstack sudo[103347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.9fd00b1d-1bdf-4b60-b650-6e59a4c8a60f Sep 04 22:52:15 devstack sudo[103347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:15 devstack sudo[103346]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-af9d976d-52e0-4066-b769-075fdbd6c91c tempest-CreateVolumesFromSnapshotTest-1164552097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-8cbd1d77-af30-42d3-97ed-53cc29df0c21" returned: 0 in 0.255s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:15 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-af9d976d-52e0-4066-b769-075fdbd6c91c tempest-CreateVolumesFromSnapshotTest-1164552097 None] Lock "cinder-quobyte-8cbd1d77-af30-42d3-97ed-53cc29df0c21" released by "delete_volume" :: held 0.817s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:52:15 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-af9d976d-52e0-4066-b769-075fdbd6c91c tempest-CreateVolumesFromSnapshotTest-1164552097 None] Created reservations ['d21e39f0-464c-4e88-bfc1-f0917e31f586', '8530d51b-a5cf-468c-b655-1dca0a8a5b81', '748ff00b-5935-423e-aae4-85a0c6e00286', '5b83fa76-2389-4812-b724-0b10300f60d6'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:52:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-af9d976d-52e0-4066-b769-075fdbd6c91c tempest-CreateVolumesFromSnapshotTest-1164552097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:52:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-af9d976d-52e0-4066-b769-075fdbd6c91c tempest-CreateVolumesFromSnapshotTest-1164552097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:52:15 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-af9d976d-52e0-4066-b769-075fdbd6c91c tempest-CreateVolumesFromSnapshotTest-1164552097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:52:15 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-af9d976d-52e0-4066-b769-075fdbd6c91c tempest-CreateVolumesFromSnapshotTest-1164552097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:52:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-af9d976d-52e0-4066-b769-075fdbd6c91c tempest-CreateVolumesFromSnapshotTest-1164552097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:52:15 devstack sudo[103347]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-af9d976d-52e0-4066-b769-075fdbd6c91c tempest-CreateVolumesFromSnapshotTest-1164552097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5c59f015-dd8e-438d-a3ae-8fc94cf86614 tempest-VolumesSnapshotListTestJSON-1583136945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.9fd00b1d-1bdf-4b60-b650-6e59a4c8a60f" returned: 0 in 0.411s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:15 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-5c59f015-dd8e-438d-a3ae-8fc94cf86614 tempest-VolumesSnapshotListTestJSON-1583136945 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e482056-bd21-4ada-8e2e-bf9c92fff158(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 22:52:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5c59f015-dd8e-438d-a3ae-8fc94cf86614 tempest-VolumesSnapshotListTestJSON-1583136945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.9fd00b1d-1bdf-4b60-b650-6e59a4c8a60f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.e245b56f-1655-4a63-9fb6-8d4b92e64ef1 1G {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:15 devstack sudo[103355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:52:15 devstack sudo[103355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:15 devstack sudo[103356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.9fd00b1d-1bdf-4b60-b650-6e59a4c8a60f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.e245b56f-1655-4a63-9fb6-8d4b92e64ef1 1G Sep 04 22:52:15 devstack sudo[103356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:15 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-6e76b78f-dfd9-4fe2-b461-42b412cefc1c tempest-CreateVolumesFromSnapshotTest-1164552097 None] Acquiring lock "cinder-ed560e7f-32d2-4cf4-bb3d-54b9a105cba2-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:52:15 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-6e76b78f-dfd9-4fe2-b461-42b412cefc1c tempest-CreateVolumesFromSnapshotTest-1164552097 None] Lock "cinder-ed560e7f-32d2-4cf4-bb3d-54b9a105cba2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:52:15 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-6e76b78f-dfd9-4fe2-b461-42b412cefc1c tempest-CreateVolumesFromSnapshotTest-1164552097 None] Acquiring lock "cinder-quobyte-ed560e7f-32d2-4cf4-bb3d-54b9a105cba2" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:52:15 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-6e76b78f-dfd9-4fe2-b461-42b412cefc1c tempest-CreateVolumesFromSnapshotTest-1164552097 None] Lock "cinder-quobyte-ed560e7f-32d2-4cf4-bb3d-54b9a105cba2" acquired by "delete_volume" :: waited 0.023s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:52:15 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c99f498-603e-447e-9d0e-8f0695116222]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:52:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-6e76b78f-dfd9-4fe2-b461-42b412cefc1c tempest-CreateVolumesFromSnapshotTest-1164552097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-ed560e7f-32d2-4cf4-bb3d-54b9a105cba2 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:16 devstack sudo[103355]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:16 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-af9d976d-52e0-4066-b769-075fdbd6c91c tempest-CreateVolumesFromSnapshotTest-1164552097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.330s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:16 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-af9d976d-52e0-4066-b769-075fdbd6c91c tempest-CreateVolumesFromSnapshotTest-1164552097 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:52:16 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-af9d976d-52e0-4066-b769-075fdbd6c91c tempest-CreateVolumesFromSnapshotTest-1164552097 None] Deleted volume successfully. Sep 04 22:52:16 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-af9d976d-52e0-4066-b769-075fdbd6c91c tempest-CreateVolumesFromSnapshotTest-1164552097 None] Lock "cinder-8cbd1d77-af30-42d3-97ed-53cc29df0c21-delete_volume" released by "delete_volume" :: held 1.418s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:52:16 devstack sudo[103359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-ed560e7f-32d2-4cf4-bb3d-54b9a105cba2 Sep 04 22:52:16 devstack sudo[103359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:16 devstack sudo[103356]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:16 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5c59f015-dd8e-438d-a3ae-8fc94cf86614 tempest-VolumesSnapshotListTestJSON-1583136945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.9fd00b1d-1bdf-4b60-b650-6e59a4c8a60f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.e245b56f-1655-4a63-9fb6-8d4b92e64ef1 1G" returned: 0 in 0.587s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:16 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5c59f015-dd8e-438d-a3ae-8fc94cf86614 tempest-VolumesSnapshotListTestJSON-1583136945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.9fd00b1d-1bdf-4b60-b650-6e59a4c8a60f -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.e245b56f-1655-4a63-9fb6-8d4b92e64ef1 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:16 devstack sudo[103366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.9fd00b1d-1bdf-4b60-b650-6e59a4c8a60f -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.e245b56f-1655-4a63-9fb6-8d4b92e64ef1 Sep 04 22:52:16 devstack sudo[103366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:16 devstack sudo[103359]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:16 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-6e76b78f-dfd9-4fe2-b461-42b412cefc1c tempest-CreateVolumesFromSnapshotTest-1164552097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-ed560e7f-32d2-4cf4-bb3d-54b9a105cba2" returned: 0 in 0.435s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:16 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-6e76b78f-dfd9-4fe2-b461-42b412cefc1c tempest-CreateVolumesFromSnapshotTest-1164552097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-ed560e7f-32d2-4cf4-bb3d-54b9a105cba2 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:16 devstack sudo[103371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-ed560e7f-32d2-4cf4-bb3d-54b9a105cba2 Sep 04 22:52:16 devstack sudo[103371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:16 devstack sudo[103366]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:16 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5c59f015-dd8e-438d-a3ae-8fc94cf86614 tempest-VolumesSnapshotListTestJSON-1583136945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.9fd00b1d-1bdf-4b60-b650-6e59a4c8a60f -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.e245b56f-1655-4a63-9fb6-8d4b92e64ef1" returned: 0 in 0.326s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:16 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-5c59f015-dd8e-438d-a3ae-8fc94cf86614 tempest-VolumesSnapshotListTestJSON-1583136945 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.e245b56f-1655-4a63-9fb6-8d4b92e64ef1 is being set with open permissions: ugo+rw Sep 04 22:52:16 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5c59f015-dd8e-438d-a3ae-8fc94cf86614 tempest-VolumesSnapshotListTestJSON-1583136945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.e245b56f-1655-4a63-9fb6-8d4b92e64ef1 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:16 devstack sudo[103377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.e245b56f-1655-4a63-9fb6-8d4b92e64ef1 Sep 04 22:52:16 devstack sudo[103377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:16 devstack sudo[103371]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:16 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-6e76b78f-dfd9-4fe2-b461-42b412cefc1c tempest-CreateVolumesFromSnapshotTest-1164552097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-ed560e7f-32d2-4cf4-bb3d-54b9a105cba2" returned: 0 in 0.274s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:16 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-6e76b78f-dfd9-4fe2-b461-42b412cefc1c tempest-CreateVolumesFromSnapshotTest-1164552097 None] Lock "cinder-quobyte-ed560e7f-32d2-4cf4-bb3d-54b9a105cba2" released by "delete_volume" :: held 0.767s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:52:16 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-6e76b78f-dfd9-4fe2-b461-42b412cefc1c tempest-CreateVolumesFromSnapshotTest-1164552097 None] Created reservations ['96132f5d-598a-43a9-a13e-9d8962debf5d', '0eba48b7-1a58-4853-ae53-0cdc6c20dd5b', 'c8faf74f-7b20-444d-87e0-2ac4b618f7cd', 'f61638f8-b3fd-4599-81a1-8d9669a09814'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:52:16 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-6e76b78f-dfd9-4fe2-b461-42b412cefc1c tempest-CreateVolumesFromSnapshotTest-1164552097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:52:16 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-6e76b78f-dfd9-4fe2-b461-42b412cefc1c tempest-CreateVolumesFromSnapshotTest-1164552097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:52:16 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-6e76b78f-dfd9-4fe2-b461-42b412cefc1c tempest-CreateVolumesFromSnapshotTest-1164552097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:52:16 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-6e76b78f-dfd9-4fe2-b461-42b412cefc1c tempest-CreateVolumesFromSnapshotTest-1164552097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:52:16 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-6e76b78f-dfd9-4fe2-b461-42b412cefc1c tempest-CreateVolumesFromSnapshotTest-1164552097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:52:16 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-6e76b78f-dfd9-4fe2-b461-42b412cefc1c tempest-CreateVolumesFromSnapshotTest-1164552097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:16 devstack sudo[103379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:52:16 devstack sudo[103379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:16 devstack sudo[103377]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:16 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5c59f015-dd8e-438d-a3ae-8fc94cf86614 tempest-VolumesSnapshotListTestJSON-1583136945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.e245b56f-1655-4a63-9fb6-8d4b92e64ef1" returned: 0 in 0.288s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:16 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-5c59f015-dd8e-438d-a3ae-8fc94cf86614 tempest-VolumesSnapshotListTestJSON-1583136945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.731s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:52:17 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-5c59f015-dd8e-438d-a3ae-8fc94cf86614 tempest-VolumesSnapshotListTestJSON-1583136945 None] Create snapshot completed successfully Sep 04 22:52:17 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-abe45dfa-64e8-4ab4-8076-494ecd538355 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Acquiring lock "cinder-04898c2a-1ca7-4bfa-b018-09ed6df7ba19-delete_snapshot" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:52:17 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-abe45dfa-64e8-4ab4-8076-494ecd538355 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Lock "cinder-04898c2a-1ca7-4bfa-b018-09ed6df7ba19-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:52:17 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-abe45dfa-64e8-4ab4-8076-494ecd538355 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Acquiring lock "cinder-quobyte-6fed7560-9258-44e6-9c76-007969022b90" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:52:17 devstack sudo[103379]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-6e76b78f-dfd9-4fe2-b461-42b412cefc1c tempest-CreateVolumesFromSnapshotTest-1164552097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.271s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:17 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-6e76b78f-dfd9-4fe2-b461-42b412cefc1c tempest-CreateVolumesFromSnapshotTest-1164552097 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:52:17 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-6e76b78f-dfd9-4fe2-b461-42b412cefc1c tempest-CreateVolumesFromSnapshotTest-1164552097 None] Deleted volume successfully. Sep 04 22:52:17 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-abe45dfa-64e8-4ab4-8076-494ecd538355 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Lock "cinder-quobyte-6fed7560-9258-44e6-9c76-007969022b90" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:52:17 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-abe45dfa-64e8-4ab4-8076-494ecd538355 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Acquiring lock "cinder-quobyte-04898c2a-1ca7-4bfa-b018-09ed6df7ba19" by "_delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:52:17 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-abe45dfa-64e8-4ab4-8076-494ecd538355 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Lock "cinder-quobyte-04898c2a-1ca7-4bfa-b018-09ed6df7ba19" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:52:17 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-abe45dfa-64e8-4ab4-8076-494ecd538355 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Deleting offline snapshot 04898c2a-1ca7-4bfa-b018-09ed6df7ba19 of volume 6fed7560-9258-44e6-9c76-007969022b90 {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 22:52:17 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-abe45dfa-64e8-4ab4-8076-494ecd538355 tempest-CreateVolumesFromSnapshotTest-1164552097 None] snapshot_file for this snap is: volume-6fed7560-9258-44e6-9c76-007969022b90.04898c2a-1ca7-4bfa-b018-09ed6df7ba19 {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 22:52:17 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-6e76b78f-dfd9-4fe2-b461-42b412cefc1c tempest-CreateVolumesFromSnapshotTest-1164552097 None] Lock "cinder-ed560e7f-32d2-4cf4-bb3d-54b9a105cba2-delete_volume" released by "delete_volume" :: held 1.281s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:52:17 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a9e4f2-a19f-433f-9874-92fed00bcc7e]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:52:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-abe45dfa-64e8-4ab4-8076-494ecd538355 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6fed7560-9258-44e6-9c76-007969022b90.04898c2a-1ca7-4bfa-b018-09ed6df7ba19 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:17 devstack sudo[103383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6fed7560-9258-44e6-9c76-007969022b90.04898c2a-1ca7-4bfa-b018-09ed6df7ba19 Sep 04 22:52:17 devstack sudo[103383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:17 devstack sudo[103383]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-abe45dfa-64e8-4ab4-8076-494ecd538355 tempest-CreateVolumesFromSnapshotTest-1164552097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6fed7560-9258-44e6-9c76-007969022b90.04898c2a-1ca7-4bfa-b018-09ed6df7ba19" returned: 0 in 0.427s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:17 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-abe45dfa-64e8-4ab4-8076-494ecd538355 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6fed7560-9258-44e6-9c76-007969022b90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 22:52:17 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c769438-5bc1-4304-8e6e-d5f8aa7dbdc9]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:52:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-abe45dfa-64e8-4ab4-8076-494ecd538355 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6fed7560-9258-44e6-9c76-007969022b90 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:17 devstack sudo[103389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6fed7560-9258-44e6-9c76-007969022b90 Sep 04 22:52:17 devstack sudo[103389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:17 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-cf2c1b35-c884-4d85-af28-cd5677fb6e22 tempest-GroupSnapshotsV319Test-128159412 None] Group tempest-GroupSnapshotsV319Test-Group-1360994218: creating Sep 04 22:52:17 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-cf2c1b35-c884-4d85-af28-cd5677fb6e22 tempest-GroupSnapshotsV319Test-128159412 None] Group tempest-GroupSnapshotsV319Test-Group-1360994218: created successfully Sep 04 22:52:17 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-cf2c1b35-c884-4d85-af28-cd5677fb6e22 tempest-GroupSnapshotsV319Test-128159412 None] Create group completed successfully. Sep 04 22:52:18 devstack sudo[103389]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-abe45dfa-64e8-4ab4-8076-494ecd538355 tempest-CreateVolumesFromSnapshotTest-1164552097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6fed7560-9258-44e6-9c76-007969022b90" returned: 0 in 0.414s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-abe45dfa-64e8-4ab4-8076-494ecd538355 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6fed7560-9258-44e6-9c76-007969022b90.04898c2a-1ca7-4bfa-b018-09ed6df7ba19 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:18 devstack sudo[103394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6fed7560-9258-44e6-9c76-007969022b90.04898c2a-1ca7-4bfa-b018-09ed6df7ba19 Sep 04 22:52:18 devstack sudo[103394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:18 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-e718d0df-c9c0-47e3-a443-85bd2c81281d tempest-VolumesSnapshotListTestJSON-1583136945 None] Acquiring lock "cinder-e245b56f-1655-4a63-9fb6-8d4b92e64ef1-delete_snapshot" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:52:18 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-e718d0df-c9c0-47e3-a443-85bd2c81281d tempest-VolumesSnapshotListTestJSON-1583136945 None] Lock "cinder-e245b56f-1655-4a63-9fb6-8d4b92e64ef1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:52:18 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-e718d0df-c9c0-47e3-a443-85bd2c81281d tempest-VolumesSnapshotListTestJSON-1583136945 None] Acquiring lock "cinder-quobyte-6e482056-bd21-4ada-8e2e-bf9c92fff158" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:52:18 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-e718d0df-c9c0-47e3-a443-85bd2c81281d tempest-VolumesSnapshotListTestJSON-1583136945 None] Lock "cinder-quobyte-6e482056-bd21-4ada-8e2e-bf9c92fff158" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:52:18 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-e718d0df-c9c0-47e3-a443-85bd2c81281d tempest-VolumesSnapshotListTestJSON-1583136945 None] Acquiring lock "cinder-quobyte-e245b56f-1655-4a63-9fb6-8d4b92e64ef1" by "_delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:52:18 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-e718d0df-c9c0-47e3-a443-85bd2c81281d tempest-VolumesSnapshotListTestJSON-1583136945 None] Lock "cinder-quobyte-e245b56f-1655-4a63-9fb6-8d4b92e64ef1" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:52:18 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-e718d0df-c9c0-47e3-a443-85bd2c81281d tempest-VolumesSnapshotListTestJSON-1583136945 None] Deleting offline snapshot e245b56f-1655-4a63-9fb6-8d4b92e64ef1 of volume 6e482056-bd21-4ada-8e2e-bf9c92fff158 {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 22:52:18 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-e718d0df-c9c0-47e3-a443-85bd2c81281d tempest-VolumesSnapshotListTestJSON-1583136945 None] snapshot_file for this snap is: volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.e245b56f-1655-4a63-9fb6-8d4b92e64ef1 {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 22:52:18 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[717ddbc9-8dc4-4da6-a8f5-e697f8549835]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:52:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e718d0df-c9c0-47e3-a443-85bd2c81281d tempest-VolumesSnapshotListTestJSON-1583136945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.e245b56f-1655-4a63-9fb6-8d4b92e64ef1 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:18 devstack sudo[103396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.e245b56f-1655-4a63-9fb6-8d4b92e64ef1 Sep 04 22:52:18 devstack sudo[103396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:18 devstack sudo[103394]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-abe45dfa-64e8-4ab4-8076-494ecd538355 tempest-CreateVolumesFromSnapshotTest-1164552097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6fed7560-9258-44e6-9c76-007969022b90.04898c2a-1ca7-4bfa-b018-09ed6df7ba19" returned: 0 in 0.333s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-abe45dfa-64e8-4ab4-8076-494ecd538355 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6fed7560-9258-44e6-9c76-007969022b90.04898c2a-1ca7-4bfa-b018-09ed6df7ba19 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:18 devstack sudo[103401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6fed7560-9258-44e6-9c76-007969022b90.04898c2a-1ca7-4bfa-b018-09ed6df7ba19 Sep 04 22:52:18 devstack sudo[103401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:18 devstack sudo[103396]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e718d0df-c9c0-47e3-a443-85bd2c81281d tempest-VolumesSnapshotListTestJSON-1583136945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.e245b56f-1655-4a63-9fb6-8d4b92e64ef1" returned: 0 in 0.372s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:18 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-e718d0df-c9c0-47e3-a443-85bd2c81281d tempest-VolumesSnapshotListTestJSON-1583136945 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e482056-bd21-4ada-8e2e-bf9c92fff158(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 22:52:18 devstack sudo[103401]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-abe45dfa-64e8-4ab4-8076-494ecd538355 tempest-CreateVolumesFromSnapshotTest-1164552097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6fed7560-9258-44e6-9c76-007969022b90.04898c2a-1ca7-4bfa-b018-09ed6df7ba19" returned: 0 in 0.242s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:18 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f65681-3711-475d-8703-470483f4fbbc]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:52:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e718d0df-c9c0-47e3-a443-85bd2c81281d tempest-VolumesSnapshotListTestJSON-1583136945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.9fd00b1d-1bdf-4b60-b650-6e59a4c8a60f {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:18 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-abe45dfa-64e8-4ab4-8076-494ecd538355 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Lock "cinder-quobyte-04898c2a-1ca7-4bfa-b018-09ed6df7ba19" released by "_delete_snapshot" :: held 1.544s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:52:18 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-abe45dfa-64e8-4ab4-8076-494ecd538355 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Lock "cinder-quobyte-6fed7560-9258-44e6-9c76-007969022b90" released by "delete_snapshot" :: held 1.568s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:52:18 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-abe45dfa-64e8-4ab4-8076-494ecd538355 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Created reservations ['3aaaf433-ac64-4f46-9aca-5cbe2ad52ed8', 'eb5e1670-0bfe-4517-8dfb-7f188b9ecdba', 'cb95913e-3148-482f-bff4-6c84440b88ac', 'e202dae4-bef2-4825-b555-f3c60876662b'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:52:18 devstack sudo[103407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.9fd00b1d-1bdf-4b60-b650-6e59a4c8a60f Sep 04 22:52:18 devstack sudo[103407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:18 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-abe45dfa-64e8-4ab4-8076-494ecd538355 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Delete snapshot completed successfully. Sep 04 22:52:18 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-abe45dfa-64e8-4ab4-8076-494ecd538355 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Lock "cinder-04898c2a-1ca7-4bfa-b018-09ed6df7ba19-delete_snapshot" released by "delete_snapshot" :: held 1.723s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:52:19 devstack sudo[103407]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:19 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e718d0df-c9c0-47e3-a443-85bd2c81281d tempest-VolumesSnapshotListTestJSON-1583136945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.9fd00b1d-1bdf-4b60-b650-6e59a4c8a60f" returned: 0 in 0.362s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:19 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-e718d0df-c9c0-47e3-a443-85bd2c81281d tempest-VolumesSnapshotListTestJSON-1583136945 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e482056-bd21-4ada-8e2e-bf9c92fff158(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 22:52:19 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e718d0df-c9c0-47e3-a443-85bd2c81281d tempest-VolumesSnapshotListTestJSON-1583136945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.e245b56f-1655-4a63-9fb6-8d4b92e64ef1 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:19 devstack sudo[103412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.e245b56f-1655-4a63-9fb6-8d4b92e64ef1 Sep 04 22:52:19 devstack sudo[103412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:19 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-83b9e9bc-9c36-4bf8-bad8-294f894715f4 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Acquiring lock "cinder-6fed7560-9258-44e6-9c76-007969022b90-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:52:19 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-83b9e9bc-9c36-4bf8-bad8-294f894715f4 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Lock "cinder-6fed7560-9258-44e6-9c76-007969022b90-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:52:19 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-83b9e9bc-9c36-4bf8-bad8-294f894715f4 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Acquiring lock "cinder-quobyte-6fed7560-9258-44e6-9c76-007969022b90" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:52:19 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-83b9e9bc-9c36-4bf8-bad8-294f894715f4 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Lock "cinder-quobyte-6fed7560-9258-44e6-9c76-007969022b90" acquired by "delete_volume" :: waited 0.021s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:52:19 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[092f1889-cd7b-4b70-8e64-7026c362229e]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:52:19 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-83b9e9bc-9c36-4bf8-bad8-294f894715f4 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6fed7560-9258-44e6-9c76-007969022b90 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:19 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-138b55f3-7244-404a-8bb0-bac9351435f1 tempest-GroupSnapshotsV319Test-128159412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:52:19 devstack sudo[103412]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:19 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-138b55f3-7244-404a-8bb0-bac9351435f1 tempest-GroupSnapshotsV319Test-128159412 None] Flow 'volume_create_manager' (beb682bf-af99-4b86-9c6d-bc440bf5050f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:52:19 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-138b55f3-7244-404a-8bb0-bac9351435f1 tempest-GroupSnapshotsV319Test-128159412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (975432dc-43a5-4876-8e2c-79ca088323a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:19 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e718d0df-c9c0-47e3-a443-85bd2c81281d tempest-VolumesSnapshotListTestJSON-1583136945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.e245b56f-1655-4a63-9fb6-8d4b92e64ef1" returned: 0 in 0.514s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:19 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e718d0df-c9c0-47e3-a443-85bd2c81281d tempest-VolumesSnapshotListTestJSON-1583136945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.e245b56f-1655-4a63-9fb6-8d4b92e64ef1 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:19 devstack sudo[103419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.e245b56f-1655-4a63-9fb6-8d4b92e64ef1 Sep 04 22:52:19 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-138b55f3-7244-404a-8bb0-bac9351435f1 tempest-GroupSnapshotsV319Test-128159412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (975432dc-43a5-4876-8e2c-79ca088323a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:52:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-717918747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7988a777-4a14-4b74-87dd-52361e6adc6a,host='devstack@QuobyteHD#QuobyteHD',id=509fb849-380c-423f-8ac9-20e4f4e1bd9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2de7581fa5bd4387a5d635fe565218c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:52:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:52:19Z,use_quota=True,user_id='68947911abce4a27b89aa73c4201be2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9095d196-07ef-4cff-a4e6-f807c9d48b8f),volume_type_id=9095d196-07ef-4cff-a4e6-f807c9d48b8f)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:19 devstack sudo[103419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:19 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-138b55f3-7244-404a-8bb0-bac9351435f1 tempest-GroupSnapshotsV319Test-128159412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (044e462e-df23-4970-8090-eddd0cf88a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:19 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-138b55f3-7244-404a-8bb0-bac9351435f1 tempest-GroupSnapshotsV319Test-128159412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (044e462e-df23-4970-8090-eddd0cf88a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:19 devstack sudo[103418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6fed7560-9258-44e6-9c76-007969022b90 Sep 04 22:52:19 devstack sudo[103418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:19 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-138b55f3-7244-404a-8bb0-bac9351435f1 tempest-GroupSnapshotsV319Test-128159412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0216a8c7-37e3-4b19-a61f-56c564db9f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:19 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-138b55f3-7244-404a-8bb0-bac9351435f1 tempest-GroupSnapshotsV319Test-128159412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0216a8c7-37e3-4b19-a61f-56c564db9f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '509fb849-380c-423f-8ac9-20e4f4e1bd9c', 'volume_name': 'volume-509fb849-380c-423f-8ac9-20e4f4e1bd9c', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:19 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-138b55f3-7244-404a-8bb0-bac9351435f1 tempest-GroupSnapshotsV319Test-128159412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66945524-afa3-44b4-b893-5f4204a36c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:19 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-138b55f3-7244-404a-8bb0-bac9351435f1 tempest-GroupSnapshotsV319Test-128159412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66945524-afa3-44b4-b893-5f4204a36c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:19 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-138b55f3-7244-404a-8bb0-bac9351435f1 tempest-GroupSnapshotsV319Test-128159412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fbb68bd-1760-4805-9867-eeaab82e8313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:19 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-138b55f3-7244-404a-8bb0-bac9351435f1 tempest-GroupSnapshotsV319Test-128159412 None] Volume 509fb849-380c-423f-8ac9-20e4f4e1bd9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-509fb849-380c-423f-8ac9-20e4f4e1bd9c', 'volume_size': 1} Sep 04 22:52:19 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-138b55f3-7244-404a-8bb0-bac9351435f1 tempest-GroupSnapshotsV319Test-128159412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:52:19 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-138b55f3-7244-404a-8bb0-bac9351435f1 tempest-GroupSnapshotsV319Test-128159412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:52:19 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-138b55f3-7244-404a-8bb0-bac9351435f1 tempest-GroupSnapshotsV319Test-128159412 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7988a777-4a14-4b74-87dd-52361e6adc6a,created_at=2026-09-04T20:52:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-717918747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7988a777-4a14-4b74-87dd-52361e6adc6a,host='devstack@QuobyteHD#QuobyteHD',id=509fb849-380c-423f-8ac9-20e4f4e1bd9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2de7581fa5bd4387a5d635fe565218c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:52:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:52:19Z,use_quota=True,user_id='68947911abce4a27b89aa73c4201be2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9095d196-07ef-4cff-a4e6-f807c9d48b8f),volume_type_id=9095d196-07ef-4cff-a4e6-f807c9d48b8f)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:52:19 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-138b55f3-7244-404a-8bb0-bac9351435f1 tempest-GroupSnapshotsV319Test-128159412 None] Creating volume 509fb849-380c-423f-8ac9-20e4f4e1bd9c {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:52:19 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-138b55f3-7244-404a-8bb0-bac9351435f1 tempest-GroupSnapshotsV319Test-128159412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:52:19 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-138b55f3-7244-404a-8bb0-bac9351435f1 tempest-GroupSnapshotsV319Test-128159412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:52:19 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-138b55f3-7244-404a-8bb0-bac9351435f1 tempest-GroupSnapshotsV319Test-128159412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:52:19 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-138b55f3-7244-404a-8bb0-bac9351435f1 tempest-GroupSnapshotsV319Test-128159412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:52:19 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-138b55f3-7244-404a-8bb0-bac9351435f1 tempest-GroupSnapshotsV319Test-128159412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:52:19 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-138b55f3-7244-404a-8bb0-bac9351435f1 tempest-GroupSnapshotsV319Test-128159412 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:52:19 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-138b55f3-7244-404a-8bb0-bac9351435f1 tempest-GroupSnapshotsV319Test-128159412 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:52:19 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-138b55f3-7244-404a-8bb0-bac9351435f1 tempest-GroupSnapshotsV319Test-128159412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-509fb849-380c-423f-8ac9-20e4f4e1bd9c 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:19 devstack sudo[103422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-509fb849-380c-423f-8ac9-20e4f4e1bd9c 1073741824 Sep 04 22:52:19 devstack sudo[103422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:19 devstack sudo[103419]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:19 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e718d0df-c9c0-47e3-a443-85bd2c81281d tempest-VolumesSnapshotListTestJSON-1583136945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.e245b56f-1655-4a63-9fb6-8d4b92e64ef1" returned: 0 in 0.249s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:19 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-e718d0df-c9c0-47e3-a443-85bd2c81281d tempest-VolumesSnapshotListTestJSON-1583136945 None] Lock "cinder-quobyte-e245b56f-1655-4a63-9fb6-8d4b92e64ef1" released by "_delete_snapshot" :: held 1.589s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:52:19 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-e718d0df-c9c0-47e3-a443-85bd2c81281d tempest-VolumesSnapshotListTestJSON-1583136945 None] Lock "cinder-quobyte-6e482056-bd21-4ada-8e2e-bf9c92fff158" released by "delete_snapshot" :: held 1.613s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:52:19 devstack sudo[103418]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:19 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-83b9e9bc-9c36-4bf8-bad8-294f894715f4 tempest-CreateVolumesFromSnapshotTest-1164552097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6fed7560-9258-44e6-9c76-007969022b90" returned: 0 in 0.394s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:19 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-83b9e9bc-9c36-4bf8-bad8-294f894715f4 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6fed7560-9258-44e6-9c76-007969022b90 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:19 devstack sudo[103431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6fed7560-9258-44e6-9c76-007969022b90 Sep 04 22:52:19 devstack sudo[103431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:19 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-e718d0df-c9c0-47e3-a443-85bd2c81281d tempest-VolumesSnapshotListTestJSON-1583136945 None] Created reservations ['ff187484-a4cf-4fcc-bd5f-33d69ed75722', 'acd57b0f-d949-4a6e-96d1-ac910d6c6d63', 'cff8d7fd-4d20-4f8f-b0bd-f369a35fc5c6', 'a6e4dc64-dd6e-463c-b75e-00a0f6873601'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:52:19 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-e718d0df-c9c0-47e3-a443-85bd2c81281d tempest-VolumesSnapshotListTestJSON-1583136945 None] Delete snapshot completed successfully. Sep 04 22:52:19 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-e718d0df-c9c0-47e3-a443-85bd2c81281d tempest-VolumesSnapshotListTestJSON-1583136945 None] Lock "cinder-e245b56f-1655-4a63-9fb6-8d4b92e64ef1-delete_snapshot" released by "delete_snapshot" :: held 1.776s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:52:20 devstack sudo[103422]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-138b55f3-7244-404a-8bb0-bac9351435f1 tempest-GroupSnapshotsV319Test-128159412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-509fb849-380c-423f-8ac9-20e4f4e1bd9c 1073741824" returned: 0 in 0.449s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-138b55f3-7244-404a-8bb0-bac9351435f1 tempest-GroupSnapshotsV319Test-128159412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-509fb849-380c-423f-8ac9-20e4f4e1bd9c {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:20 devstack sudo[103435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-509fb849-380c-423f-8ac9-20e4f4e1bd9c Sep 04 22:52:20 devstack sudo[103435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:20 devstack sudo[103431]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-83b9e9bc-9c36-4bf8-bad8-294f894715f4 tempest-CreateVolumesFromSnapshotTest-1164552097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6fed7560-9258-44e6-9c76-007969022b90" returned: 0 in 0.280s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:20 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-83b9e9bc-9c36-4bf8-bad8-294f894715f4 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Lock "cinder-quobyte-6fed7560-9258-44e6-9c76-007969022b90" released by "delete_volume" :: held 0.740s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:52:20 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-83b9e9bc-9c36-4bf8-bad8-294f894715f4 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Created reservations ['6cfabee1-0e8c-491d-81d3-6ade0a1e400b', '0f41450e-e2a1-43ba-aadb-cad53a1ca6b9', '1be8edca-1929-47e4-b5a1-deec942a6bb6', '218b8a80-9d60-4ef0-8cb9-460b56c6e0de'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:52:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-83b9e9bc-9c36-4bf8-bad8-294f894715f4 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:52:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-83b9e9bc-9c36-4bf8-bad8-294f894715f4 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:52:20 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-83b9e9bc-9c36-4bf8-bad8-294f894715f4 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:52:20 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-83b9e9bc-9c36-4bf8-bad8-294f894715f4 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:52:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-83b9e9bc-9c36-4bf8-bad8-294f894715f4 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:52:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-83b9e9bc-9c36-4bf8-bad8-294f894715f4 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:20 devstack sudo[103437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:52:20 devstack sudo[103437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:20 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-ad284ef0-1b69-421e-880e-d9e8c3b32699 tempest-VolumesSnapshotListTestJSON-1583136945 None] Acquiring lock "cinder-9fd00b1d-1bdf-4b60-b650-6e59a4c8a60f-delete_snapshot" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:52:20 devstack sudo[103435]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:20 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-ad284ef0-1b69-421e-880e-d9e8c3b32699 tempest-VolumesSnapshotListTestJSON-1583136945 None] Lock "cinder-9fd00b1d-1bdf-4b60-b650-6e59a4c8a60f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:52:20 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-ad284ef0-1b69-421e-880e-d9e8c3b32699 tempest-VolumesSnapshotListTestJSON-1583136945 None] Acquiring lock "cinder-quobyte-6e482056-bd21-4ada-8e2e-bf9c92fff158" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:52:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-138b55f3-7244-404a-8bb0-bac9351435f1 tempest-GroupSnapshotsV319Test-128159412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-509fb849-380c-423f-8ac9-20e4f4e1bd9c" returned: 0 in 0.277s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:20 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-138b55f3-7244-404a-8bb0-bac9351435f1 tempest-GroupSnapshotsV319Test-128159412 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:52:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-138b55f3-7244-404a-8bb0-bac9351435f1 tempest-GroupSnapshotsV319Test-128159412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:52:20 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-138b55f3-7244-404a-8bb0-bac9351435f1 tempest-GroupSnapshotsV319Test-128159412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fbb68bd-1760-4805-9867-eeaab82e8313) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-509fb849-380c-423f-8ac9-20e4f4e1bd9c', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:20 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-138b55f3-7244-404a-8bb0-bac9351435f1 tempest-GroupSnapshotsV319Test-128159412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (759ff1a7-8a7a-4742-ae50-daef301e26d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:20 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-ad284ef0-1b69-421e-880e-d9e8c3b32699 tempest-VolumesSnapshotListTestJSON-1583136945 None] Lock "cinder-quobyte-6e482056-bd21-4ada-8e2e-bf9c92fff158" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:52:20 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-ad284ef0-1b69-421e-880e-d9e8c3b32699 tempest-VolumesSnapshotListTestJSON-1583136945 None] Acquiring lock "cinder-quobyte-9fd00b1d-1bdf-4b60-b650-6e59a4c8a60f" by "_delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:52:20 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-138b55f3-7244-404a-8bb0-bac9351435f1 tempest-GroupSnapshotsV319Test-128159412 None] Volume volume-509fb849-380c-423f-8ac9-20e4f4e1bd9c (509fb849-380c-423f-8ac9-20e4f4e1bd9c): created successfully Sep 04 22:52:20 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-138b55f3-7244-404a-8bb0-bac9351435f1 tempest-GroupSnapshotsV319Test-128159412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (759ff1a7-8a7a-4742-ae50-daef301e26d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:20 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-138b55f3-7244-404a-8bb0-bac9351435f1 tempest-GroupSnapshotsV319Test-128159412 None] Flow 'volume_create_manager' (beb682bf-af99-4b86-9c6d-bc440bf5050f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:52:20 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-ad284ef0-1b69-421e-880e-d9e8c3b32699 tempest-VolumesSnapshotListTestJSON-1583136945 None] Lock "cinder-quobyte-9fd00b1d-1bdf-4b60-b650-6e59a4c8a60f" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:52:20 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-ad284ef0-1b69-421e-880e-d9e8c3b32699 tempest-VolumesSnapshotListTestJSON-1583136945 None] Deleting offline snapshot 9fd00b1d-1bdf-4b60-b650-6e59a4c8a60f of volume 6e482056-bd21-4ada-8e2e-bf9c92fff158 {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 22:52:20 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-ad284ef0-1b69-421e-880e-d9e8c3b32699 tempest-VolumesSnapshotListTestJSON-1583136945 None] snapshot_file for this snap is: volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.9fd00b1d-1bdf-4b60-b650-6e59a4c8a60f {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 22:52:20 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-138b55f3-7244-404a-8bb0-bac9351435f1 tempest-GroupSnapshotsV319Test-128159412 None] Created volume successfully. Sep 04 22:52:20 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8c1c2d-8115-4bcb-a34d-2b6e33a0db66]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:52:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ad284ef0-1b69-421e-880e-d9e8c3b32699 tempest-VolumesSnapshotListTestJSON-1583136945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.9fd00b1d-1bdf-4b60-b650-6e59a4c8a60f {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:20 devstack sudo[103437]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-83b9e9bc-9c36-4bf8-bad8-294f894715f4 tempest-CreateVolumesFromSnapshotTest-1164552097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.268s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:20 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-83b9e9bc-9c36-4bf8-bad8-294f894715f4 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:52:20 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-83b9e9bc-9c36-4bf8-bad8-294f894715f4 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Deleted volume successfully. Sep 04 22:52:20 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-83b9e9bc-9c36-4bf8-bad8-294f894715f4 tempest-CreateVolumesFromSnapshotTest-1164552097 None] Lock "cinder-6fed7560-9258-44e6-9c76-007969022b90-delete_volume" released by "delete_volume" :: held 1.219s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:52:20 devstack sudo[103441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.9fd00b1d-1bdf-4b60-b650-6e59a4c8a60f Sep 04 22:52:20 devstack sudo[103441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:20 devstack sudo[103441]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ad284ef0-1b69-421e-880e-d9e8c3b32699 tempest-VolumesSnapshotListTestJSON-1583136945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.9fd00b1d-1bdf-4b60-b650-6e59a4c8a60f" returned: 0 in 0.402s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:20 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-ad284ef0-1b69-421e-880e-d9e8c3b32699 tempest-VolumesSnapshotListTestJSON-1583136945 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e482056-bd21-4ada-8e2e-bf9c92fff158(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 22:52:20 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0ab560-2aa2-4f41-a285-63954a9ceeab]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:52:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ad284ef0-1b69-421e-880e-d9e8c3b32699 tempest-VolumesSnapshotListTestJSON-1583136945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.afa48c77-cb1e-4812-a6fe-d777557ddf08 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:20 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-1b8a9cec-7cdd-427f-9afb-9d9a3bdf6d53 tempest-GroupSnapshotsV319Test-128159412 None] GroupSnapshot 23a6f5ac-cb18-4886-9126-2b57ce13f2f2: creating. Sep 04 22:52:21 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-1b8a9cec-7cdd-427f-9afb-9d9a3bdf6d53 tempest-GroupSnapshotsV319Test-128159412 None] Group snapshot 23a6f5ac-cb18-4886-9126-2b57ce13f2f2: creating. {{(pid=87576) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 04 22:52:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-1b8a9cec-7cdd-427f-9afb-9d9a3bdf6d53 tempest-GroupSnapshotsV319Test-128159412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:52:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-1b8a9cec-7cdd-427f-9afb-9d9a3bdf6d53 tempest-GroupSnapshotsV319Test-128159412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:52:21 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-1b8a9cec-7cdd-427f-9afb-9d9a3bdf6d53 tempest-GroupSnapshotsV319Test-128159412 None] Creating offline snapshot 62860ef3-905b-451d-bd65-8974588fa7c6 of volume 509fb849-380c-423f-8ac9-20e4f4e1bd9c {{(pid=87576) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 22:52:21 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48ed9cc-802b-431d-a9b6-e28463a78cf5]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:52:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-1b8a9cec-7cdd-427f-9afb-9d9a3bdf6d53 tempest-GroupSnapshotsV319Test-128159412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-509fb849-380c-423f-8ac9-20e4f4e1bd9c {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:21 devstack sudo[103446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.afa48c77-cb1e-4812-a6fe-d777557ddf08 Sep 04 22:52:21 devstack sudo[103446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:21 devstack sudo[103447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-509fb849-380c-423f-8ac9-20e4f4e1bd9c Sep 04 22:52:21 devstack sudo[103447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:21 devstack sudo[103446]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ad284ef0-1b69-421e-880e-d9e8c3b32699 tempest-VolumesSnapshotListTestJSON-1583136945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.afa48c77-cb1e-4812-a6fe-d777557ddf08" returned: 0 in 0.474s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:21 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-ad284ef0-1b69-421e-880e-d9e8c3b32699 tempest-VolumesSnapshotListTestJSON-1583136945 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e482056-bd21-4ada-8e2e-bf9c92fff158(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 22:52:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ad284ef0-1b69-421e-880e-d9e8c3b32699 tempest-VolumesSnapshotListTestJSON-1583136945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.9fd00b1d-1bdf-4b60-b650-6e59a4c8a60f {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:21 devstack sudo[103457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.9fd00b1d-1bdf-4b60-b650-6e59a4c8a60f Sep 04 22:52:21 devstack sudo[103457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:21 devstack sudo[103447]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-1b8a9cec-7cdd-427f-9afb-9d9a3bdf6d53 tempest-GroupSnapshotsV319Test-128159412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-509fb849-380c-423f-8ac9-20e4f4e1bd9c" returned: 0 in 0.442s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-1b8a9cec-7cdd-427f-9afb-9d9a3bdf6d53 tempest-GroupSnapshotsV319Test-128159412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-509fb849-380c-423f-8ac9-20e4f4e1bd9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-509fb849-380c-423f-8ac9-20e4f4e1bd9c.62860ef3-905b-451d-bd65-8974588fa7c6 1G {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:21 devstack sudo[103459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-509fb849-380c-423f-8ac9-20e4f4e1bd9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-509fb849-380c-423f-8ac9-20e4f4e1bd9c.62860ef3-905b-451d-bd65-8974588fa7c6 1G Sep 04 22:52:21 devstack sudo[103459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:21 devstack sudo[103457]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ad284ef0-1b69-421e-880e-d9e8c3b32699 tempest-VolumesSnapshotListTestJSON-1583136945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.9fd00b1d-1bdf-4b60-b650-6e59a4c8a60f" returned: 0 in 0.438s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ad284ef0-1b69-421e-880e-d9e8c3b32699 tempest-VolumesSnapshotListTestJSON-1583136945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.9fd00b1d-1bdf-4b60-b650-6e59a4c8a60f {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:21 devstack sudo[103468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.9fd00b1d-1bdf-4b60-b650-6e59a4c8a60f Sep 04 22:52:21 devstack sudo[103468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:21 devstack sudo[103459]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-1b8a9cec-7cdd-427f-9afb-9d9a3bdf6d53 tempest-GroupSnapshotsV319Test-128159412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-509fb849-380c-423f-8ac9-20e4f4e1bd9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-509fb849-380c-423f-8ac9-20e4f4e1bd9c.62860ef3-905b-451d-bd65-8974588fa7c6 1G" returned: 0 in 0.479s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-1b8a9cec-7cdd-427f-9afb-9d9a3bdf6d53 tempest-GroupSnapshotsV319Test-128159412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-509fb849-380c-423f-8ac9-20e4f4e1bd9c -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-509fb849-380c-423f-8ac9-20e4f4e1bd9c.62860ef3-905b-451d-bd65-8974588fa7c6 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:22 devstack sudo[103470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-509fb849-380c-423f-8ac9-20e4f4e1bd9c -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-509fb849-380c-423f-8ac9-20e4f4e1bd9c.62860ef3-905b-451d-bd65-8974588fa7c6 Sep 04 22:52:22 devstack sudo[103470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:22 devstack sudo[103468]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ad284ef0-1b69-421e-880e-d9e8c3b32699 tempest-VolumesSnapshotListTestJSON-1583136945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.9fd00b1d-1bdf-4b60-b650-6e59a4c8a60f" returned: 0 in 0.269s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:22 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-ad284ef0-1b69-421e-880e-d9e8c3b32699 tempest-VolumesSnapshotListTestJSON-1583136945 None] Lock "cinder-quobyte-9fd00b1d-1bdf-4b60-b650-6e59a4c8a60f" released by "_delete_snapshot" :: held 1.700s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:52:22 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-ad284ef0-1b69-421e-880e-d9e8c3b32699 tempest-VolumesSnapshotListTestJSON-1583136945 None] Lock "cinder-quobyte-6e482056-bd21-4ada-8e2e-bf9c92fff158" released by "delete_snapshot" :: held 1.749s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:52:22 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-ad284ef0-1b69-421e-880e-d9e8c3b32699 tempest-VolumesSnapshotListTestJSON-1583136945 None] Created reservations ['3ec90f2f-baed-485b-8e52-38f4c977ff93', '9c1f3fb1-d16e-46a0-bf51-7473efee02b6', 'c3ceedd2-0191-4fa6-ac38-923c86655970', 'ae492cea-44ab-4060-b5f3-6ed581d56212'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:52:22 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-ad284ef0-1b69-421e-880e-d9e8c3b32699 tempest-VolumesSnapshotListTestJSON-1583136945 None] Delete snapshot completed successfully. Sep 04 22:52:22 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-ad284ef0-1b69-421e-880e-d9e8c3b32699 tempest-VolumesSnapshotListTestJSON-1583136945 None] Lock "cinder-9fd00b1d-1bdf-4b60-b650-6e59a4c8a60f-delete_snapshot" released by "delete_snapshot" :: held 1.923s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:52:22 devstack sudo[103470]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-1b8a9cec-7cdd-427f-9afb-9d9a3bdf6d53 tempest-GroupSnapshotsV319Test-128159412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-509fb849-380c-423f-8ac9-20e4f4e1bd9c -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-509fb849-380c-423f-8ac9-20e4f4e1bd9c.62860ef3-905b-451d-bd65-8974588fa7c6" returned: 0 in 0.362s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:22 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-1b8a9cec-7cdd-427f-9afb-9d9a3bdf6d53 tempest-GroupSnapshotsV319Test-128159412 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-509fb849-380c-423f-8ac9-20e4f4e1bd9c.62860ef3-905b-451d-bd65-8974588fa7c6 is being set with open permissions: ugo+rw: NotImplementedError Sep 04 22:52:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-1b8a9cec-7cdd-427f-9afb-9d9a3bdf6d53 tempest-GroupSnapshotsV319Test-128159412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-509fb849-380c-423f-8ac9-20e4f4e1bd9c.62860ef3-905b-451d-bd65-8974588fa7c6 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:22 devstack sudo[103477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-509fb849-380c-423f-8ac9-20e4f4e1bd9c.62860ef3-905b-451d-bd65-8974588fa7c6 Sep 04 22:52:22 devstack sudo[103477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:22 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-4c78f528-7564-474d-8354-c980f58da0c4 tempest-VolumesSnapshotListTestJSON-1583136945 None] Acquiring lock "cinder-afa48c77-cb1e-4812-a6fe-d777557ddf08-delete_snapshot" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:52:22 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-4c78f528-7564-474d-8354-c980f58da0c4 tempest-VolumesSnapshotListTestJSON-1583136945 None] Lock "cinder-afa48c77-cb1e-4812-a6fe-d777557ddf08-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:52:22 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-4c78f528-7564-474d-8354-c980f58da0c4 tempest-VolumesSnapshotListTestJSON-1583136945 None] Acquiring lock "cinder-quobyte-6e482056-bd21-4ada-8e2e-bf9c92fff158" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:52:22 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-4c78f528-7564-474d-8354-c980f58da0c4 tempest-VolumesSnapshotListTestJSON-1583136945 None] Lock "cinder-quobyte-6e482056-bd21-4ada-8e2e-bf9c92fff158" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:52:22 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-4c78f528-7564-474d-8354-c980f58da0c4 tempest-VolumesSnapshotListTestJSON-1583136945 None] Acquiring lock "cinder-quobyte-afa48c77-cb1e-4812-a6fe-d777557ddf08" by "_delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:52:22 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-4c78f528-7564-474d-8354-c980f58da0c4 tempest-VolumesSnapshotListTestJSON-1583136945 None] Lock "cinder-quobyte-afa48c77-cb1e-4812-a6fe-d777557ddf08" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:52:22 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-4c78f528-7564-474d-8354-c980f58da0c4 tempest-VolumesSnapshotListTestJSON-1583136945 None] Deleting offline snapshot afa48c77-cb1e-4812-a6fe-d777557ddf08 of volume 6e482056-bd21-4ada-8e2e-bf9c92fff158 {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 22:52:22 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-4c78f528-7564-474d-8354-c980f58da0c4 tempest-VolumesSnapshotListTestJSON-1583136945 None] snapshot_file for this snap is: volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.afa48c77-cb1e-4812-a6fe-d777557ddf08 {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 22:52:22 devstack sudo[103477]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:22 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cffc78c-18ea-4351-9843-8ff486c29a83]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:52:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4c78f528-7564-474d-8354-c980f58da0c4 tempest-VolumesSnapshotListTestJSON-1583136945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.afa48c77-cb1e-4812-a6fe-d777557ddf08 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-1b8a9cec-7cdd-427f-9afb-9d9a3bdf6d53 tempest-GroupSnapshotsV319Test-128159412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-509fb849-380c-423f-8ac9-20e4f4e1bd9c.62860ef3-905b-451d-bd65-8974588fa7c6" returned: 0 in 0.284s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-1b8a9cec-7cdd-427f-9afb-9d9a3bdf6d53 tempest-GroupSnapshotsV319Test-128159412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-509fb849-380c-423f-8ac9-20e4f4e1bd9c.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:22 devstack sudo[103481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-509fb849-380c-423f-8ac9-20e4f4e1bd9c.info Sep 04 22:52:22 devstack sudo[103481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:22 devstack sudo[103480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.afa48c77-cb1e-4812-a6fe-d777557ddf08 Sep 04 22:52:22 devstack sudo[103480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:22 devstack sudo[103481]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-1b8a9cec-7cdd-427f-9afb-9d9a3bdf6d53 tempest-GroupSnapshotsV319Test-128159412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-509fb849-380c-423f-8ac9-20e4f4e1bd9c.info" returned: 0 in 0.294s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:22 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-1b8a9cec-7cdd-427f-9afb-9d9a3bdf6d53 tempest-GroupSnapshotsV319Test-128159412 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-509fb849-380c-423f-8ac9-20e4f4e1bd9c.info is being set with open permissions: ugo+rw: NotImplementedError Sep 04 22:52:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-1b8a9cec-7cdd-427f-9afb-9d9a3bdf6d53 tempest-GroupSnapshotsV319Test-128159412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-509fb849-380c-423f-8ac9-20e4f4e1bd9c.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:22 devstack sudo[103487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-509fb849-380c-423f-8ac9-20e4f4e1bd9c.info Sep 04 22:52:22 devstack sudo[103487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:23 devstack sudo[103480]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4c78f528-7564-474d-8354-c980f58da0c4 tempest-VolumesSnapshotListTestJSON-1583136945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.afa48c77-cb1e-4812-a6fe-d777557ddf08" returned: 0 in 0.406s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:23 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-4c78f528-7564-474d-8354-c980f58da0c4 tempest-VolumesSnapshotListTestJSON-1583136945 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e482056-bd21-4ada-8e2e-bf9c92fff158(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 22:52:23 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bbcf26e-a3fa-4cf1-8798-0d9c1f88db96]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:52:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4c78f528-7564-474d-8354-c980f58da0c4 tempest-VolumesSnapshotListTestJSON-1583136945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:23 devstack sudo[103491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158 Sep 04 22:52:23 devstack sudo[103491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:23 devstack sudo[103487]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-1b8a9cec-7cdd-427f-9afb-9d9a3bdf6d53 tempest-GroupSnapshotsV319Test-128159412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-509fb849-380c-423f-8ac9-20e4f4e1bd9c.info" returned: 0 in 0.280s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-1b8a9cec-7cdd-427f-9afb-9d9a3bdf6d53 tempest-GroupSnapshotsV319Test-128159412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.234s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:52:23 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-1b8a9cec-7cdd-427f-9afb-9d9a3bdf6d53 tempest-GroupSnapshotsV319Test-128159412 None] group_snapshot 23a6f5ac-cb18-4886-9126-2b57ce13f2f2: created successfully Sep 04 22:52:23 devstack sudo[103491]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4c78f528-7564-474d-8354-c980f58da0c4 tempest-VolumesSnapshotListTestJSON-1583136945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158" returned: 0 in 0.383s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4c78f528-7564-474d-8354-c980f58da0c4 tempest-VolumesSnapshotListTestJSON-1583136945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.afa48c77-cb1e-4812-a6fe-d777557ddf08 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:23 devstack sudo[103497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.afa48c77-cb1e-4812-a6fe-d777557ddf08 Sep 04 22:52:23 devstack sudo[103497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:23 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9ad75fa-e8d1-45c2-a070-3f15cbce71dd tempest-VolumeDependencyTests-1382825298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:52:23 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-b9ad75fa-e8d1-45c2-a070-3f15cbce71dd tempest-VolumeDependencyTests-1382825298 None] Flow 'volume_create_manager' (3e2affaf-d045-4aa7-9370-a59e441bfce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:52:23 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-b9ad75fa-e8d1-45c2-a070-3f15cbce71dd tempest-VolumeDependencyTests-1382825298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1144bc6d-c1ce-4657-8308-fce98fcf85f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:23 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-b9ad75fa-e8d1-45c2-a070-3f15cbce71dd tempest-VolumeDependencyTests-1382825298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1144bc6d-c1ce-4657-8308-fce98fcf85f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:52:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-406044773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=160d58c8-9b90-4613-a490-5aa01789b981,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e90739a3bf24ca38750accd5b2e94ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:52:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:52:24Z,use_quota=True,user_id='66c0aa4c48d94fa2bbb9ea6af211f400',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:23 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-b9ad75fa-e8d1-45c2-a070-3f15cbce71dd tempest-VolumeDependencyTests-1382825298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b40e8b0-75fd-4c2e-a5d9-2badcee7cf4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:23 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-b9ad75fa-e8d1-45c2-a070-3f15cbce71dd tempest-VolumeDependencyTests-1382825298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b40e8b0-75fd-4c2e-a5d9-2badcee7cf4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:23 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-b9ad75fa-e8d1-45c2-a070-3f15cbce71dd tempest-VolumeDependencyTests-1382825298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb419cac-3c40-4104-a1d1-9bcd4c47413d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:23 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-b9ad75fa-e8d1-45c2-a070-3f15cbce71dd tempest-VolumeDependencyTests-1382825298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb419cac-3c40-4104-a1d1-9bcd4c47413d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '160d58c8-9b90-4613-a490-5aa01789b981', 'volume_name': 'volume-160d58c8-9b90-4613-a490-5aa01789b981', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:23 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-b9ad75fa-e8d1-45c2-a070-3f15cbce71dd tempest-VolumeDependencyTests-1382825298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f52e462-7115-4031-a8cd-f42a84e0a171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:23 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-b9ad75fa-e8d1-45c2-a070-3f15cbce71dd tempest-VolumeDependencyTests-1382825298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f52e462-7115-4031-a8cd-f42a84e0a171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:23 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-b9ad75fa-e8d1-45c2-a070-3f15cbce71dd tempest-VolumeDependencyTests-1382825298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b6d55f4-7e5e-4a0b-830e-2021381f2331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:23 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-b9ad75fa-e8d1-45c2-a070-3f15cbce71dd tempest-VolumeDependencyTests-1382825298 None] Volume 160d58c8-9b90-4613-a490-5aa01789b981: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-160d58c8-9b90-4613-a490-5aa01789b981', 'volume_size': 1} Sep 04 22:52:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-b9ad75fa-e8d1-45c2-a070-3f15cbce71dd tempest-VolumeDependencyTests-1382825298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:52:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-b9ad75fa-e8d1-45c2-a070-3f15cbce71dd tempest-VolumeDependencyTests-1382825298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:52:23 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-b9ad75fa-e8d1-45c2-a070-3f15cbce71dd tempest-VolumeDependencyTests-1382825298 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:52:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-406044773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=160d58c8-9b90-4613-a490-5aa01789b981,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e90739a3bf24ca38750accd5b2e94ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:52:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:52:24Z,use_quota=True,user_id='66c0aa4c48d94fa2bbb9ea6af211f400',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:52:23 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-b9ad75fa-e8d1-45c2-a070-3f15cbce71dd tempest-VolumeDependencyTests-1382825298 None] Creating volume 160d58c8-9b90-4613-a490-5aa01789b981 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:52:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-b9ad75fa-e8d1-45c2-a070-3f15cbce71dd tempest-VolumeDependencyTests-1382825298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:52:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-b9ad75fa-e8d1-45c2-a070-3f15cbce71dd tempest-VolumeDependencyTests-1382825298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:52:23 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-b9ad75fa-e8d1-45c2-a070-3f15cbce71dd tempest-VolumeDependencyTests-1382825298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:52:23 devstack sudo[103497]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:23 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-b9ad75fa-e8d1-45c2-a070-3f15cbce71dd tempest-VolumeDependencyTests-1382825298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:52:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-b9ad75fa-e8d1-45c2-a070-3f15cbce71dd tempest-VolumeDependencyTests-1382825298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:52:23 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-b9ad75fa-e8d1-45c2-a070-3f15cbce71dd tempest-VolumeDependencyTests-1382825298 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:52:23 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-b9ad75fa-e8d1-45c2-a070-3f15cbce71dd tempest-VolumeDependencyTests-1382825298 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:52:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b9ad75fa-e8d1-45c2-a070-3f15cbce71dd tempest-VolumeDependencyTests-1382825298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-160d58c8-9b90-4613-a490-5aa01789b981 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4c78f528-7564-474d-8354-c980f58da0c4 tempest-VolumesSnapshotListTestJSON-1583136945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.afa48c77-cb1e-4812-a6fe-d777557ddf08" returned: 0 in 0.352s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4c78f528-7564-474d-8354-c980f58da0c4 tempest-VolumesSnapshotListTestJSON-1583136945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.afa48c77-cb1e-4812-a6fe-d777557ddf08 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:23 devstack sudo[103503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-160d58c8-9b90-4613-a490-5aa01789b981 1073741824 Sep 04 22:52:23 devstack sudo[103503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:23 devstack sudo[103504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.afa48c77-cb1e-4812-a6fe-d777557ddf08 Sep 04 22:52:23 devstack sudo[103504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:24 devstack sudo[103504]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4c78f528-7564-474d-8354-c980f58da0c4 tempest-VolumesSnapshotListTestJSON-1583136945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158.afa48c77-cb1e-4812-a6fe-d777557ddf08" returned: 0 in 0.264s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:24 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-4c78f528-7564-474d-8354-c980f58da0c4 tempest-VolumesSnapshotListTestJSON-1583136945 None] Lock "cinder-quobyte-afa48c77-cb1e-4812-a6fe-d777557ddf08" released by "_delete_snapshot" :: held 1.511s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:52:24 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-4c78f528-7564-474d-8354-c980f58da0c4 tempest-VolumesSnapshotListTestJSON-1583136945 None] Lock "cinder-quobyte-6e482056-bd21-4ada-8e2e-bf9c92fff158" released by "delete_snapshot" :: held 1.539s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:52:24 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-4c78f528-7564-474d-8354-c980f58da0c4 tempest-VolumesSnapshotListTestJSON-1583136945 None] Created reservations ['18cf459b-df76-4220-a577-b2d6e064f7c9', 'db96cdff-f85d-4b4c-a547-8e5ef4bcbffb', '8b442897-69e8-4691-9caf-5b8f89cb5531', 'ff82eaa6-b43b-48f3-8577-f18bc08c620a'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:52:24 devstack sudo[103503]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b9ad75fa-e8d1-45c2-a070-3f15cbce71dd tempest-VolumeDependencyTests-1382825298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-160d58c8-9b90-4613-a490-5aa01789b981 1073741824" returned: 0 in 0.422s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:24 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-4c78f528-7564-474d-8354-c980f58da0c4 tempest-VolumesSnapshotListTestJSON-1583136945 None] Delete snapshot completed successfully. Sep 04 22:52:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b9ad75fa-e8d1-45c2-a070-3f15cbce71dd tempest-VolumeDependencyTests-1382825298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-160d58c8-9b90-4613-a490-5aa01789b981 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:24 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-4c78f528-7564-474d-8354-c980f58da0c4 tempest-VolumesSnapshotListTestJSON-1583136945 None] Lock "cinder-afa48c77-cb1e-4812-a6fe-d777557ddf08-delete_snapshot" released by "delete_snapshot" :: held 1.726s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:52:24 devstack sudo[103512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-160d58c8-9b90-4613-a490-5aa01789b981 Sep 04 22:52:24 devstack sudo[103512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:24 devstack sudo[103512]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b9ad75fa-e8d1-45c2-a070-3f15cbce71dd tempest-VolumeDependencyTests-1382825298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-160d58c8-9b90-4613-a490-5aa01789b981" returned: 0 in 0.255s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:24 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-b9ad75fa-e8d1-45c2-a070-3f15cbce71dd tempest-VolumeDependencyTests-1382825298 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:52:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-b9ad75fa-e8d1-45c2-a070-3f15cbce71dd tempest-VolumeDependencyTests-1382825298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:52:24 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-b9ad75fa-e8d1-45c2-a070-3f15cbce71dd tempest-VolumeDependencyTests-1382825298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b6d55f4-7e5e-4a0b-830e-2021381f2331) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-160d58c8-9b90-4613-a490-5aa01789b981', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:24 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-b9ad75fa-e8d1-45c2-a070-3f15cbce71dd tempest-VolumeDependencyTests-1382825298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edd526b3-d0f6-4d7c-a13e-cb9639d29c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:24 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-d4474e8b-93ba-43b9-9fd1-be38dbe11670 tempest-GroupSnapshotsV319Test-128159412 None] group_snapshot 23a6f5ac-cb18-4886-9126-2b57ce13f2f2: deleting Sep 04 22:52:24 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-b9ad75fa-e8d1-45c2-a070-3f15cbce71dd tempest-VolumeDependencyTests-1382825298 None] Volume volume-160d58c8-9b90-4613-a490-5aa01789b981 (160d58c8-9b90-4613-a490-5aa01789b981): created successfully Sep 04 22:52:24 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-b9ad75fa-e8d1-45c2-a070-3f15cbce71dd tempest-VolumeDependencyTests-1382825298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edd526b3-d0f6-4d7c-a13e-cb9639d29c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:24 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-b9ad75fa-e8d1-45c2-a070-3f15cbce71dd tempest-VolumeDependencyTests-1382825298 None] Flow 'volume_create_manager' (3e2affaf-d045-4aa7-9370-a59e441bfce9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:52:24 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-b9ad75fa-e8d1-45c2-a070-3f15cbce71dd tempest-VolumeDependencyTests-1382825298 None] Created volume successfully. Sep 04 22:52:24 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d4474e8b-93ba-43b9-9fd1-be38dbe11670 tempest-GroupSnapshotsV319Test-128159412 None] group_snapshot 23a6f5ac-cb18-4886-9126-2b57ce13f2f2: deleting {{(pid=87576) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 04 22:52:24 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d4474e8b-93ba-43b9-9fd1-be38dbe11670 tempest-GroupSnapshotsV319Test-128159412 None] Acquiring lock "cinder-quobyte-509fb849-380c-423f-8ac9-20e4f4e1bd9c" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:52:24 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d4474e8b-93ba-43b9-9fd1-be38dbe11670 tempest-GroupSnapshotsV319Test-128159412 None] Lock "cinder-quobyte-509fb849-380c-423f-8ac9-20e4f4e1bd9c" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:52:24 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d4474e8b-93ba-43b9-9fd1-be38dbe11670 tempest-GroupSnapshotsV319Test-128159412 None] Acquiring lock "cinder-quobyte-62860ef3-905b-451d-bd65-8974588fa7c6" by "_delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:52:24 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d4474e8b-93ba-43b9-9fd1-be38dbe11670 tempest-GroupSnapshotsV319Test-128159412 None] Lock "cinder-quobyte-62860ef3-905b-451d-bd65-8974588fa7c6" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:52:24 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-d4474e8b-93ba-43b9-9fd1-be38dbe11670 tempest-GroupSnapshotsV319Test-128159412 None] Deleting offline snapshot 62860ef3-905b-451d-bd65-8974588fa7c6 of volume 509fb849-380c-423f-8ac9-20e4f4e1bd9c {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 22:52:24 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-d4474e8b-93ba-43b9-9fd1-be38dbe11670 tempest-GroupSnapshotsV319Test-128159412 None] snapshot_file for this snap is: volume-509fb849-380c-423f-8ac9-20e4f4e1bd9c.62860ef3-905b-451d-bd65-8974588fa7c6 {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 22:52:24 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac856eb-aa9d-420c-8d78-59cbba5a4aae]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:52:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d4474e8b-93ba-43b9-9fd1-be38dbe11670 tempest-GroupSnapshotsV319Test-128159412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-509fb849-380c-423f-8ac9-20e4f4e1bd9c.62860ef3-905b-451d-bd65-8974588fa7c6 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:24 devstack sudo[103515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-509fb849-380c-423f-8ac9-20e4f4e1bd9c.62860ef3-905b-451d-bd65-8974588fa7c6 Sep 04 22:52:24 devstack sudo[103515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:24 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-fb006747-c928-4e10-882e-96544f30dd12 tempest-VolumesSnapshotListTestJSON-1583136945 None] Acquiring lock "cinder-6e482056-bd21-4ada-8e2e-bf9c92fff158-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:52:24 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-fb006747-c928-4e10-882e-96544f30dd12 tempest-VolumesSnapshotListTestJSON-1583136945 None] Lock "cinder-6e482056-bd21-4ada-8e2e-bf9c92fff158-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:52:24 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-fb006747-c928-4e10-882e-96544f30dd12 tempest-VolumesSnapshotListTestJSON-1583136945 None] Acquiring lock "cinder-quobyte-6e482056-bd21-4ada-8e2e-bf9c92fff158" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:52:24 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-fb006747-c928-4e10-882e-96544f30dd12 tempest-VolumesSnapshotListTestJSON-1583136945 None] Lock "cinder-quobyte-6e482056-bd21-4ada-8e2e-bf9c92fff158" acquired by "delete_volume" :: waited 0.035s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:52:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-c2481ed6-5028-4d1d-8dad-befd766269cb tempest-VolumeDependencyTests-1382825298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:52:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-c2481ed6-5028-4d1d-8dad-befd766269cb tempest-VolumeDependencyTests-1382825298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:52:24 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c493165-a6cd-47a8-92e4-2bb3c6ec0a88]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:52:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-fb006747-c928-4e10-882e-96544f30dd12 tempest-VolumesSnapshotListTestJSON-1583136945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:25 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-c2481ed6-5028-4d1d-8dad-befd766269cb tempest-VolumeDependencyTests-1382825298 None] Creating offline snapshot bd373473-c7c8-43cc-92a6-22db41062cfe of volume 160d58c8-9b90-4613-a490-5aa01789b981 {{(pid=87576) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 22:52:25 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[044a2d44-59c7-4f24-bd7d-bf1bfd5f8ed3]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:52:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c2481ed6-5028-4d1d-8dad-befd766269cb tempest-VolumeDependencyTests-1382825298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-160d58c8-9b90-4613-a490-5aa01789b981 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:25 devstack sudo[103517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158 Sep 04 22:52:25 devstack sudo[103517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:25 devstack sudo[103515]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d4474e8b-93ba-43b9-9fd1-be38dbe11670 tempest-GroupSnapshotsV319Test-128159412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-509fb849-380c-423f-8ac9-20e4f4e1bd9c.62860ef3-905b-451d-bd65-8974588fa7c6" returned: 0 in 0.449s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:25 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-d4474e8b-93ba-43b9-9fd1-be38dbe11670 tempest-GroupSnapshotsV319Test-128159412 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-509fb849-380c-423f-8ac9-20e4f4e1bd9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 22:52:25 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4596c0-765b-4b96-93d2-aa51ca8ad3a3]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:52:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d4474e8b-93ba-43b9-9fd1-be38dbe11670 tempest-GroupSnapshotsV319Test-128159412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-509fb849-380c-423f-8ac9-20e4f4e1bd9c {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:25 devstack sudo[103518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-160d58c8-9b90-4613-a490-5aa01789b981 Sep 04 22:52:25 devstack sudo[103518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:25 devstack sudo[103525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-509fb849-380c-423f-8ac9-20e4f4e1bd9c Sep 04 22:52:25 devstack sudo[103525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:25 devstack sudo[103517]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-fb006747-c928-4e10-882e-96544f30dd12 tempest-VolumesSnapshotListTestJSON-1583136945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158" returned: 0 in 0.387s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-fb006747-c928-4e10-882e-96544f30dd12 tempest-VolumesSnapshotListTestJSON-1583136945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:25 devstack sudo[103532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158 Sep 04 22:52:25 devstack sudo[103532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:25 devstack sudo[103518]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c2481ed6-5028-4d1d-8dad-befd766269cb tempest-VolumeDependencyTests-1382825298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-160d58c8-9b90-4613-a490-5aa01789b981" returned: 0 in 0.407s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c2481ed6-5028-4d1d-8dad-befd766269cb tempest-VolumeDependencyTests-1382825298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-160d58c8-9b90-4613-a490-5aa01789b981,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-160d58c8-9b90-4613-a490-5aa01789b981.bd373473-c7c8-43cc-92a6-22db41062cfe 1G {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:25 devstack sudo[103535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-160d58c8-9b90-4613-a490-5aa01789b981,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-160d58c8-9b90-4613-a490-5aa01789b981.bd373473-c7c8-43cc-92a6-22db41062cfe 1G Sep 04 22:52:25 devstack sudo[103535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:25 devstack sudo[103525]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d4474e8b-93ba-43b9-9fd1-be38dbe11670 tempest-GroupSnapshotsV319Test-128159412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-509fb849-380c-423f-8ac9-20e4f4e1bd9c" returned: 0 in 0.386s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d4474e8b-93ba-43b9-9fd1-be38dbe11670 tempest-GroupSnapshotsV319Test-128159412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-509fb849-380c-423f-8ac9-20e4f4e1bd9c.62860ef3-905b-451d-bd65-8974588fa7c6 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:25 devstack sudo[103540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-509fb849-380c-423f-8ac9-20e4f4e1bd9c.62860ef3-905b-451d-bd65-8974588fa7c6 Sep 04 22:52:25 devstack sudo[103540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:25 devstack sudo[103532]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-fb006747-c928-4e10-882e-96544f30dd12 tempest-VolumesSnapshotListTestJSON-1583136945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6e482056-bd21-4ada-8e2e-bf9c92fff158" returned: 0 in 0.280s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:25 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-fb006747-c928-4e10-882e-96544f30dd12 tempest-VolumesSnapshotListTestJSON-1583136945 None] Lock "cinder-quobyte-6e482056-bd21-4ada-8e2e-bf9c92fff158" released by "delete_volume" :: held 0.732s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:52:25 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-fb006747-c928-4e10-882e-96544f30dd12 tempest-VolumesSnapshotListTestJSON-1583136945 None] Created reservations ['4e9fe74b-d593-4aa4-acd1-b0b2d49b97e2', 'ac54ecfa-83bb-4728-91df-f40241427c13', '626fccc0-e114-4f57-9dfa-ec85ff2791fb', '21821ea2-05bf-4668-b5c0-e7d58a2991da'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:52:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-fb006747-c928-4e10-882e-96544f30dd12 tempest-VolumesSnapshotListTestJSON-1583136945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:52:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-fb006747-c928-4e10-882e-96544f30dd12 tempest-VolumesSnapshotListTestJSON-1583136945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:52:25 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-fb006747-c928-4e10-882e-96544f30dd12 tempest-VolumesSnapshotListTestJSON-1583136945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:52:25 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-fb006747-c928-4e10-882e-96544f30dd12 tempest-VolumesSnapshotListTestJSON-1583136945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:52:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-fb006747-c928-4e10-882e-96544f30dd12 tempest-VolumesSnapshotListTestJSON-1583136945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:52:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-fb006747-c928-4e10-882e-96544f30dd12 tempest-VolumesSnapshotListTestJSON-1583136945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:25 devstack sudo[103549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:52:25 devstack sudo[103549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:25 devstack sudo[103535]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c2481ed6-5028-4d1d-8dad-befd766269cb tempest-VolumeDependencyTests-1382825298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-160d58c8-9b90-4613-a490-5aa01789b981,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-160d58c8-9b90-4613-a490-5aa01789b981.bd373473-c7c8-43cc-92a6-22db41062cfe 1G" returned: 0 in 0.479s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c2481ed6-5028-4d1d-8dad-befd766269cb tempest-VolumeDependencyTests-1382825298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-160d58c8-9b90-4613-a490-5aa01789b981 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-160d58c8-9b90-4613-a490-5aa01789b981.bd373473-c7c8-43cc-92a6-22db41062cfe {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:25 devstack sudo[103552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-160d58c8-9b90-4613-a490-5aa01789b981 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-160d58c8-9b90-4613-a490-5aa01789b981.bd373473-c7c8-43cc-92a6-22db41062cfe Sep 04 22:52:25 devstack sudo[103552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:25 devstack sudo[103540]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d4474e8b-93ba-43b9-9fd1-be38dbe11670 tempest-GroupSnapshotsV319Test-128159412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-509fb849-380c-423f-8ac9-20e4f4e1bd9c.62860ef3-905b-451d-bd65-8974588fa7c6" returned: 0 in 0.417s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d4474e8b-93ba-43b9-9fd1-be38dbe11670 tempest-GroupSnapshotsV319Test-128159412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-509fb849-380c-423f-8ac9-20e4f4e1bd9c.62860ef3-905b-451d-bd65-8974588fa7c6 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:26 devstack sudo[103554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-509fb849-380c-423f-8ac9-20e4f4e1bd9c.62860ef3-905b-451d-bd65-8974588fa7c6 Sep 04 22:52:26 devstack sudo[103554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:26 devstack sudo[103549]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-fb006747-c928-4e10-882e-96544f30dd12 tempest-VolumesSnapshotListTestJSON-1583136945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.288s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:26 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-fb006747-c928-4e10-882e-96544f30dd12 tempest-VolumesSnapshotListTestJSON-1583136945 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:52:26 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-fb006747-c928-4e10-882e-96544f30dd12 tempest-VolumesSnapshotListTestJSON-1583136945 None] Deleted volume successfully. Sep 04 22:52:26 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-fb006747-c928-4e10-882e-96544f30dd12 tempest-VolumesSnapshotListTestJSON-1583136945 None] Lock "cinder-6e482056-bd21-4ada-8e2e-bf9c92fff158-delete_volume" released by "delete_volume" :: held 1.318s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:52:26 devstack sudo[103552]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c2481ed6-5028-4d1d-8dad-befd766269cb tempest-VolumeDependencyTests-1382825298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-160d58c8-9b90-4613-a490-5aa01789b981 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-160d58c8-9b90-4613-a490-5aa01789b981.bd373473-c7c8-43cc-92a6-22db41062cfe" returned: 0 in 0.370s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:26 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-c2481ed6-5028-4d1d-8dad-befd766269cb tempest-VolumeDependencyTests-1382825298 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-160d58c8-9b90-4613-a490-5aa01789b981.bd373473-c7c8-43cc-92a6-22db41062cfe is being set with open permissions: ugo+rw Sep 04 22:52:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c2481ed6-5028-4d1d-8dad-befd766269cb tempest-VolumeDependencyTests-1382825298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-160d58c8-9b90-4613-a490-5aa01789b981.bd373473-c7c8-43cc-92a6-22db41062cfe {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:26 devstack sudo[103554]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d4474e8b-93ba-43b9-9fd1-be38dbe11670 tempest-GroupSnapshotsV319Test-128159412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-509fb849-380c-423f-8ac9-20e4f4e1bd9c.62860ef3-905b-451d-bd65-8974588fa7c6" returned: 0 in 0.344s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:26 devstack sudo[103561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-160d58c8-9b90-4613-a490-5aa01789b981.bd373473-c7c8-43cc-92a6-22db41062cfe Sep 04 22:52:26 devstack sudo[103561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:26 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d4474e8b-93ba-43b9-9fd1-be38dbe11670 tempest-GroupSnapshotsV319Test-128159412 None] Lock "cinder-quobyte-62860ef3-905b-451d-bd65-8974588fa7c6" released by "_delete_snapshot" :: held 1.718s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:52:26 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d4474e8b-93ba-43b9-9fd1-be38dbe11670 tempest-GroupSnapshotsV319Test-128159412 None] Lock "cinder-quobyte-509fb849-380c-423f-8ac9-20e4f4e1bd9c" released by "delete_snapshot" :: held 1.745s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:52:26 devstack cinder-volume[87576]: WARNING cinder.quota [None req-d4474e8b-93ba-43b9-9fd1-be38dbe11670 tempest-GroupSnapshotsV319Test-128159412 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-836260854 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-836260854, it is now deprecated. Please use the default quota class for default quota. Sep 04 22:52:26 devstack cinder-volume[87576]: WARNING cinder.quota [None req-d4474e8b-93ba-43b9-9fd1-be38dbe11670 tempest-GroupSnapshotsV319Test-128159412 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-836260854 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-836260854, it is now deprecated. Please use the default quota class for default quota. Sep 04 22:52:26 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-d4474e8b-93ba-43b9-9fd1-be38dbe11670 tempest-GroupSnapshotsV319Test-128159412 None] Created reservations ['d1dd593d-07a3-4f68-8a23-45b1a4522544', '8e3851ee-aaa1-4cbe-b1a1-d07a8837a998', '994fc1bf-7e43-4e12-a20f-32557f97a967', '85b82e25-ea85-47bf-8a0d-d4f4faea54c8'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:52:26 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-d4474e8b-93ba-43b9-9fd1-be38dbe11670 tempest-GroupSnapshotsV319Test-128159412 None] group_snapshot 23a6f5ac-cb18-4886-9126-2b57ce13f2f2: deleted successfully Sep 04 22:52:26 devstack sudo[103561]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c2481ed6-5028-4d1d-8dad-befd766269cb tempest-VolumeDependencyTests-1382825298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-160d58c8-9b90-4613-a490-5aa01789b981.bd373473-c7c8-43cc-92a6-22db41062cfe" returned: 0 in 0.271s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c2481ed6-5028-4d1d-8dad-befd766269cb tempest-VolumeDependencyTests-1382825298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-160d58c8-9b90-4613-a490-5aa01789b981.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:26 devstack sudo[103564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-160d58c8-9b90-4613-a490-5aa01789b981.info Sep 04 22:52:26 devstack sudo[103564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:26 devstack sudo[103564]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c2481ed6-5028-4d1d-8dad-befd766269cb tempest-VolumeDependencyTests-1382825298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-160d58c8-9b90-4613-a490-5aa01789b981.info" returned: 0 in 0.263s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:26 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-c2481ed6-5028-4d1d-8dad-befd766269cb tempest-VolumeDependencyTests-1382825298 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-160d58c8-9b90-4613-a490-5aa01789b981.info is being set with open permissions: ugo+rw Sep 04 22:52:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c2481ed6-5028-4d1d-8dad-befd766269cb tempest-VolumeDependencyTests-1382825298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-160d58c8-9b90-4613-a490-5aa01789b981.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:26 devstack sudo[103567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-160d58c8-9b90-4613-a490-5aa01789b981.info Sep 04 22:52:26 devstack sudo[103567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:27 devstack sudo[103567]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:27 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c2481ed6-5028-4d1d-8dad-befd766269cb tempest-VolumeDependencyTests-1382825298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-160d58c8-9b90-4613-a490-5aa01789b981.info" returned: 0 in 0.274s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:27 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-c2481ed6-5028-4d1d-8dad-befd766269cb tempest-VolumeDependencyTests-1382825298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.171s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:52:27 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-c2481ed6-5028-4d1d-8dad-befd766269cb tempest-VolumeDependencyTests-1382825298 None] Create snapshot completed successfully Sep 04 22:52:27 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-edefe92c-bf3e-4bff-a588-4e777c559535 tempest-GroupSnapshotsV319Test-128159412 None] Acquiring lock "cinder-quobyte-509fb849-380c-423f-8ac9-20e4f4e1bd9c" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:52:27 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-edefe92c-bf3e-4bff-a588-4e777c559535 tempest-GroupSnapshotsV319Test-128159412 None] Lock "cinder-quobyte-509fb849-380c-423f-8ac9-20e4f4e1bd9c" acquired by "delete_volume" :: waited 0.016s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:52:27 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68b5edc-d832-47d3-85ec-0f20f3186e31]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:52:27 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-edefe92c-bf3e-4bff-a588-4e777c559535 tempest-GroupSnapshotsV319Test-128159412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-509fb849-380c-423f-8ac9-20e4f4e1bd9c {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:27 devstack sudo[103570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-509fb849-380c-423f-8ac9-20e4f4e1bd9c Sep 04 22:52:27 devstack sudo[103570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:27 devstack sudo[103570]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:27 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-edefe92c-bf3e-4bff-a588-4e777c559535 tempest-GroupSnapshotsV319Test-128159412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-509fb849-380c-423f-8ac9-20e4f4e1bd9c" returned: 0 in 0.381s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:27 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-edefe92c-bf3e-4bff-a588-4e777c559535 tempest-GroupSnapshotsV319Test-128159412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-509fb849-380c-423f-8ac9-20e4f4e1bd9c {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:27 devstack sudo[103575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-509fb849-380c-423f-8ac9-20e4f4e1bd9c Sep 04 22:52:27 devstack sudo[103575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:27 devstack sudo[103575]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:27 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-edefe92c-bf3e-4bff-a588-4e777c559535 tempest-GroupSnapshotsV319Test-128159412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-509fb849-380c-423f-8ac9-20e4f4e1bd9c" returned: 0 in 0.243s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:27 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-edefe92c-bf3e-4bff-a588-4e777c559535 tempest-GroupSnapshotsV319Test-128159412 None] Lock "cinder-quobyte-509fb849-380c-423f-8ac9-20e4f4e1bd9c" released by "delete_volume" :: held 0.680s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:52:28 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-edefe92c-bf3e-4bff-a588-4e777c559535 tempest-GroupSnapshotsV319Test-128159412 None] Created reservations ['bfdceb34-4a4f-4605-a89d-12cc04b5dd6c'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:52:28 devstack cinder-volume[87576]: WARNING cinder.quota [None req-edefe92c-bf3e-4bff-a588-4e777c559535 tempest-GroupSnapshotsV319Test-128159412 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-836260854 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-836260854, it is now deprecated. Please use the default quota class for default quota. Sep 04 22:52:28 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-edefe92c-bf3e-4bff-a588-4e777c559535 tempest-GroupSnapshotsV319Test-128159412 None] Created reservations ['267087c6-aaf8-495c-9a85-078ec625ca6c', 'a690104a-a859-472e-ab56-d2abddcf8119', '2aab9be3-b6bc-4895-a17a-67015ddfae26', '7f8e5dd5-25fc-4f36-b8b4-e0abd380d984'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:52:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-edefe92c-bf3e-4bff-a588-4e777c559535 tempest-GroupSnapshotsV319Test-128159412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:52:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-edefe92c-bf3e-4bff-a588-4e777c559535 tempest-GroupSnapshotsV319Test-128159412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:52:28 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-edefe92c-bf3e-4bff-a588-4e777c559535 tempest-GroupSnapshotsV319Test-128159412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:52:28 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-edefe92c-bf3e-4bff-a588-4e777c559535 tempest-GroupSnapshotsV319Test-128159412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:52:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-edefe92c-bf3e-4bff-a588-4e777c559535 tempest-GroupSnapshotsV319Test-128159412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:52:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-edefe92c-bf3e-4bff-a588-4e777c559535 tempest-GroupSnapshotsV319Test-128159412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:28 devstack sudo[103578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:52:28 devstack sudo[103578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:28 devstack sudo[103578]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-edefe92c-bf3e-4bff-a588-4e777c559535 tempest-GroupSnapshotsV319Test-128159412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.304s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:28 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-edefe92c-bf3e-4bff-a588-4e777c559535 tempest-GroupSnapshotsV319Test-128159412 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:52:28 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-edefe92c-bf3e-4bff-a588-4e777c559535 tempest-GroupSnapshotsV319Test-128159412 None] Delete group completed successfully. Sep 04 22:52:28 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-75721d4d-de61-427f-b075-5f7c18659b46 tempest-VolumeDependencyTests-1382825298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:52:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-75721d4d-de61-427f-b075-5f7c18659b46 tempest-VolumeDependencyTests-1382825298 None] Flow 'volume_create_manager' (52a7a673-fe19-4cc3-96a0-f78c380f2108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:52:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-75721d4d-de61-427f-b075-5f7c18659b46 tempest-VolumeDependencyTests-1382825298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7bcb15c-b92a-4ef6-9e20-7d4646c278dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-75721d4d-de61-427f-b075-5f7c18659b46 tempest-VolumeDependencyTests-1382825298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7bcb15c-b92a-4ef6-9e20-7d4646c278dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:52:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-833483063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=841cc3bf-e9fb-4254-9f61-4f9f4138f494,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e90739a3bf24ca38750accd5b2e94ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:52:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bd373473-c7c8-43cc-92a6-22db41062cfe,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:52:29Z,use_quota=True,user_id='66c0aa4c48d94fa2bbb9ea6af211f400',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-75721d4d-de61-427f-b075-5f7c18659b46 tempest-VolumeDependencyTests-1382825298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b68c81f-29fe-4cc8-a77d-4ed31ca3f625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-75721d4d-de61-427f-b075-5f7c18659b46 tempest-VolumeDependencyTests-1382825298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b68c81f-29fe-4cc8-a77d-4ed31ca3f625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-75721d4d-de61-427f-b075-5f7c18659b46 tempest-VolumeDependencyTests-1382825298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87510f04-87e6-435b-abca-e9d2b3ed3711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-75721d4d-de61-427f-b075-5f7c18659b46 tempest-VolumeDependencyTests-1382825298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87510f04-87e6-435b-abca-e9d2b3ed3711) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '841cc3bf-e9fb-4254-9f61-4f9f4138f494', 'volume_name': 'volume-841cc3bf-e9fb-4254-9f61-4f9f4138f494', 'volume_size': 1, 'snapshot_id': 'bd373473-c7c8-43cc-92a6-22db41062cfe'}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-75721d4d-de61-427f-b075-5f7c18659b46 tempest-VolumeDependencyTests-1382825298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da1132b2-eb3a-491b-810c-16eff922aa16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-75721d4d-de61-427f-b075-5f7c18659b46 tempest-VolumeDependencyTests-1382825298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da1132b2-eb3a-491b-810c-16eff922aa16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-75721d4d-de61-427f-b075-5f7c18659b46 tempest-VolumeDependencyTests-1382825298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68cc2738-2f67-41b9-8889-31af027de274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:28 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-75721d4d-de61-427f-b075-5f7c18659b46 tempest-VolumeDependencyTests-1382825298 None] Volume 841cc3bf-e9fb-4254-9f61-4f9f4138f494: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-841cc3bf-e9fb-4254-9f61-4f9f4138f494', 'volume_size': 1, 'snapshot_id': 'bd373473-c7c8-43cc-92a6-22db41062cfe'} Sep 04 22:52:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-75721d4d-de61-427f-b075-5f7c18659b46 tempest-VolumeDependencyTests-1382825298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:52:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-75721d4d-de61-427f-b075-5f7c18659b46 tempest-VolumeDependencyTests-1382825298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:52:28 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-75721d4d-de61-427f-b075-5f7c18659b46 tempest-VolumeDependencyTests-1382825298 None] Acquiring lock "cinder-quobyte-bd373473-c7c8-43cc-92a6-22db41062cfe-841cc3bf-e9fb-4254-9f61-4f9f4138f494" by "_create_volume_from_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:52:28 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-75721d4d-de61-427f-b075-5f7c18659b46 tempest-VolumeDependencyTests-1382825298 None] Lock "cinder-quobyte-bd373473-c7c8-43cc-92a6-22db41062cfe-841cc3bf-e9fb-4254-9f61-4f9f4138f494" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:52:28 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-75721d4d-de61-427f-b075-5f7c18659b46 tempest-VolumeDependencyTests-1382825298 None] Creating volume 841cc3bf-e9fb-4254-9f61-4f9f4138f494 from snapshot bd373473-c7c8-43cc-92a6-22db41062cfe {{(pid=87576) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 04 22:52:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-75721d4d-de61-427f-b075-5f7c18659b46 tempest-VolumeDependencyTests-1382825298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:52:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-75721d4d-de61-427f-b075-5f7c18659b46 tempest-VolumeDependencyTests-1382825298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:52:28 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-75721d4d-de61-427f-b075-5f7c18659b46 tempest-VolumeDependencyTests-1382825298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:52:28 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-75721d4d-de61-427f-b075-5f7c18659b46 tempest-VolumeDependencyTests-1382825298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:52:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-75721d4d-de61-427f-b075-5f7c18659b46 tempest-VolumeDependencyTests-1382825298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:52:28 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-75721d4d-de61-427f-b075-5f7c18659b46 tempest-VolumeDependencyTests-1382825298 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:52:28 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-75721d4d-de61-427f-b075-5f7c18659b46 tempest-VolumeDependencyTests-1382825298 None] Acquiring lock "cinder-quobyte-841cc3bf-e9fb-4254-9f61-4f9f4138f494" by "_copy_volume_from_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:52:28 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-75721d4d-de61-427f-b075-5f7c18659b46 tempest-VolumeDependencyTests-1382825298 None] Lock "cinder-quobyte-841cc3bf-e9fb-4254-9f61-4f9f4138f494" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:52:28 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-75721d4d-de61-427f-b075-5f7c18659b46 tempest-VolumeDependencyTests-1382825298 None] snapshot: bd373473-c7c8-43cc-92a6-22db41062cfe, volume: 841cc3bf-e9fb-4254-9f61-4f9f4138f494, {{(pid=87576) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 04 22:52:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-75721d4d-de61-427f-b075-5f7c18659b46 tempest-VolumeDependencyTests-1382825298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:52:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-75721d4d-de61-427f-b075-5f7c18659b46 tempest-VolumeDependencyTests-1382825298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:52:28 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-75721d4d-de61-427f-b075-5f7c18659b46 tempest-VolumeDependencyTests-1382825298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:52:29 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-75721d4d-de61-427f-b075-5f7c18659b46 tempest-VolumeDependencyTests-1382825298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:52:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-75721d4d-de61-427f-b075-5f7c18659b46 tempest-VolumeDependencyTests-1382825298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:52:29 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[f671e3c9-b769-42ac-accc-e91c7e0b6942]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:52:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-75721d4d-de61-427f-b075-5f7c18659b46 tempest-VolumeDependencyTests-1382825298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-160d58c8-9b90-4613-a490-5aa01789b981.bd373473-c7c8-43cc-92a6-22db41062cfe {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:29 devstack sudo[103581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-160d58c8-9b90-4613-a490-5aa01789b981.bd373473-c7c8-43cc-92a6-22db41062cfe Sep 04 22:52:29 devstack sudo[103581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:29 devstack sudo[103581]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-75721d4d-de61-427f-b075-5f7c18659b46 tempest-VolumeDependencyTests-1382825298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-160d58c8-9b90-4613-a490-5aa01789b981.bd373473-c7c8-43cc-92a6-22db41062cfe" returned: 0 in 0.410s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:29 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-75721d4d-de61-427f-b075-5f7c18659b46 tempest-VolumeDependencyTests-1382825298 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-160d58c8-9b90-4613-a490-5aa01789b981(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 22:52:29 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d90067-50b8-4161-a2b5-72840b63728e]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:52:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-75721d4d-de61-427f-b075-5f7c18659b46 tempest-VolumeDependencyTests-1382825298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-160d58c8-9b90-4613-a490-5aa01789b981 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:29 devstack sudo[103586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-160d58c8-9b90-4613-a490-5aa01789b981 Sep 04 22:52:29 devstack sudo[103586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:29 devstack sudo[103586]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-75721d4d-de61-427f-b075-5f7c18659b46 tempest-VolumeDependencyTests-1382825298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-160d58c8-9b90-4613-a490-5aa01789b981" returned: 0 in 0.421s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:29 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-75721d4d-de61-427f-b075-5f7c18659b46 tempest-VolumeDependencyTests-1382825298 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-160d58c8-9b90-4613-a490-5aa01789b981 {{(pid=87576) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 04 22:52:29 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-75721d4d-de61-427f-b075-5f7c18659b46 tempest-VolumeDependencyTests-1382825298 None] Creating direct copy from snapshot {{(pid=87576) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 04 22:52:29 devstack cinder-volume[87576]: DEBUG cinder.utils [None req-75721d4d-de61-427f-b075-5f7c18659b46 tempest-VolumeDependencyTests-1382825298 None] Path /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-841cc3bf-e9fb-4254-9f61-4f9f4138f494 not found in is_blk_device check {{(pid=87576) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 04 22:52:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-75721d4d-de61-427f-b075-5f7c18659b46 tempest-VolumeDependencyTests-1382825298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-160d58c8-9b90-4613-a490-5aa01789b981 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-841cc3bf-e9fb-4254-9f61-4f9f4138f494 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:29 devstack sudo[103592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-160d58c8-9b90-4613-a490-5aa01789b981 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-841cc3bf-e9fb-4254-9f61-4f9f4138f494 Sep 04 22:52:29 devstack sudo[103592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:35 devstack sudo[103592]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-75721d4d-de61-427f-b075-5f7c18659b46 tempest-VolumeDependencyTests-1382825298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-160d58c8-9b90-4613-a490-5aa01789b981 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-841cc3bf-e9fb-4254-9f61-4f9f4138f494" returned: 0 in 5.717s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:35 devstack cinder-volume[87576]: DEBUG cinder.image.image_utils [None req-75721d4d-de61-427f-b075-5f7c18659b46 tempest-VolumeDependencyTests-1382825298 None] Image conversion details: src /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-160d58c8-9b90-4613-a490-5aa01789b981, size 1024.00 MB, duration 5.72 sec, destination /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-841cc3bf-e9fb-4254-9f61-4f9f4138f494 {{(pid=87576) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 22:52:35 devstack cinder-volume[87576]: INFO cinder.image.image_utils [None req-75721d4d-de61-427f-b075-5f7c18659b46 tempest-VolumeDependencyTests-1382825298 None] Converted 1024.00 MB image at 179.08 MB/s Sep 04 22:52:35 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-75721d4d-de61-427f-b075-5f7c18659b46 tempest-VolumeDependencyTests-1382825298 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-841cc3bf-e9fb-4254-9f61-4f9f4138f494 is being set with open permissions: ugo+rw Sep 04 22:52:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-75721d4d-de61-427f-b075-5f7c18659b46 tempest-VolumeDependencyTests-1382825298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-841cc3bf-e9fb-4254-9f61-4f9f4138f494 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:35 devstack sudo[103645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-841cc3bf-e9fb-4254-9f61-4f9f4138f494 Sep 04 22:52:35 devstack sudo[103645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:35 devstack sudo[103645]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-75721d4d-de61-427f-b075-5f7c18659b46 tempest-VolumeDependencyTests-1382825298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-841cc3bf-e9fb-4254-9f61-4f9f4138f494" returned: 0 in 0.281s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:35 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-75721d4d-de61-427f-b075-5f7c18659b46 tempest-VolumeDependencyTests-1382825298 None] Lock "cinder-quobyte-841cc3bf-e9fb-4254-9f61-4f9f4138f494" released by "_copy_volume_from_snapshot" :: held 6.927s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:52:35 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-75721d4d-de61-427f-b075-5f7c18659b46 tempest-VolumeDependencyTests-1382825298 None] Lock "cinder-quobyte-bd373473-c7c8-43cc-92a6-22db41062cfe-841cc3bf-e9fb-4254-9f61-4f9f4138f494" released by "_create_volume_from_snapshot" :: held 7.007s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:52:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-75721d4d-de61-427f-b075-5f7c18659b46 tempest-VolumeDependencyTests-1382825298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.030s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:52:35 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-75721d4d-de61-427f-b075-5f7c18659b46 tempest-VolumeDependencyTests-1382825298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68cc2738-2f67-41b9-8889-31af027de274) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-841cc3bf-e9fb-4254-9f61-4f9f4138f494', 'volume_size': 1, 'snapshot_id': 'bd373473-c7c8-43cc-92a6-22db41062cfe'}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:35 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-75721d4d-de61-427f-b075-5f7c18659b46 tempest-VolumeDependencyTests-1382825298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26b0fa4a-16a8-44e1-b10a-0efef72309fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:35 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-75721d4d-de61-427f-b075-5f7c18659b46 tempest-VolumeDependencyTests-1382825298 None] Volume volume-841cc3bf-e9fb-4254-9f61-4f9f4138f494 (841cc3bf-e9fb-4254-9f61-4f9f4138f494): created successfully Sep 04 22:52:35 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-75721d4d-de61-427f-b075-5f7c18659b46 tempest-VolumeDependencyTests-1382825298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26b0fa4a-16a8-44e1-b10a-0efef72309fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:35 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-75721d4d-de61-427f-b075-5f7c18659b46 tempest-VolumeDependencyTests-1382825298 None] Flow 'volume_create_manager' (52a7a673-fe19-4cc3-96a0-f78c380f2108) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:52:36 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-75721d4d-de61-427f-b075-5f7c18659b46 tempest-VolumeDependencyTests-1382825298 None] Created volume successfully. Sep 04 22:52:36 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-280d701d-db75-4077-b171-a35c62ea7d76 tempest-VolumeDependencyTests-1382825298 None] Acquiring lock "cinder-bd373473-c7c8-43cc-92a6-22db41062cfe-delete_snapshot" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:52:36 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-280d701d-db75-4077-b171-a35c62ea7d76 tempest-VolumeDependencyTests-1382825298 None] Lock "cinder-bd373473-c7c8-43cc-92a6-22db41062cfe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:52:36 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-280d701d-db75-4077-b171-a35c62ea7d76 tempest-VolumeDependencyTests-1382825298 None] Acquiring lock "cinder-quobyte-160d58c8-9b90-4613-a490-5aa01789b981" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:52:36 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-280d701d-db75-4077-b171-a35c62ea7d76 tempest-VolumeDependencyTests-1382825298 None] Lock "cinder-quobyte-160d58c8-9b90-4613-a490-5aa01789b981" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:52:36 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-280d701d-db75-4077-b171-a35c62ea7d76 tempest-VolumeDependencyTests-1382825298 None] Acquiring lock "cinder-quobyte-bd373473-c7c8-43cc-92a6-22db41062cfe" by "_delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:52:36 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-280d701d-db75-4077-b171-a35c62ea7d76 tempest-VolumeDependencyTests-1382825298 None] Lock "cinder-quobyte-bd373473-c7c8-43cc-92a6-22db41062cfe" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:52:36 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-280d701d-db75-4077-b171-a35c62ea7d76 tempest-VolumeDependencyTests-1382825298 None] Deleting offline snapshot bd373473-c7c8-43cc-92a6-22db41062cfe of volume 160d58c8-9b90-4613-a490-5aa01789b981 {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 22:52:36 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-280d701d-db75-4077-b171-a35c62ea7d76 tempest-VolumeDependencyTests-1382825298 None] snapshot_file for this snap is: volume-160d58c8-9b90-4613-a490-5aa01789b981.bd373473-c7c8-43cc-92a6-22db41062cfe {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 22:52:36 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f01baf4-97cc-4834-9c89-0a81c0f8399a]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:52:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-280d701d-db75-4077-b171-a35c62ea7d76 tempest-VolumeDependencyTests-1382825298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-160d58c8-9b90-4613-a490-5aa01789b981.bd373473-c7c8-43cc-92a6-22db41062cfe {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:37 devstack sudo[103648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-160d58c8-9b90-4613-a490-5aa01789b981.bd373473-c7c8-43cc-92a6-22db41062cfe Sep 04 22:52:37 devstack sudo[103648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:37 devstack sudo[103648]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:37 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-280d701d-db75-4077-b171-a35c62ea7d76 tempest-VolumeDependencyTests-1382825298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-160d58c8-9b90-4613-a490-5aa01789b981.bd373473-c7c8-43cc-92a6-22db41062cfe" returned: 0 in 0.412s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:37 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-280d701d-db75-4077-b171-a35c62ea7d76 tempest-VolumeDependencyTests-1382825298 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-160d58c8-9b90-4613-a490-5aa01789b981(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 22:52:37 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ed8802-393d-46c2-b248-eb0b133f938e]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:52:37 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-280d701d-db75-4077-b171-a35c62ea7d76 tempest-VolumeDependencyTests-1382825298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-160d58c8-9b90-4613-a490-5aa01789b981 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:37 devstack sudo[103653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-160d58c8-9b90-4613-a490-5aa01789b981 Sep 04 22:52:37 devstack sudo[103653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:38 devstack sudo[103653]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:38 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-280d701d-db75-4077-b171-a35c62ea7d76 tempest-VolumeDependencyTests-1382825298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-160d58c8-9b90-4613-a490-5aa01789b981" returned: 0 in 0.618s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:38 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-280d701d-db75-4077-b171-a35c62ea7d76 tempest-VolumeDependencyTests-1382825298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-160d58c8-9b90-4613-a490-5aa01789b981.bd373473-c7c8-43cc-92a6-22db41062cfe {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:38 devstack sudo[103660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-160d58c8-9b90-4613-a490-5aa01789b981.bd373473-c7c8-43cc-92a6-22db41062cfe Sep 04 22:52:38 devstack sudo[103660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:38 devstack sudo[103660]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:38 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-280d701d-db75-4077-b171-a35c62ea7d76 tempest-VolumeDependencyTests-1382825298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-160d58c8-9b90-4613-a490-5aa01789b981.bd373473-c7c8-43cc-92a6-22db41062cfe" returned: 0 in 0.389s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:38 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-280d701d-db75-4077-b171-a35c62ea7d76 tempest-VolumeDependencyTests-1382825298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-160d58c8-9b90-4613-a490-5aa01789b981.bd373473-c7c8-43cc-92a6-22db41062cfe {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:38 devstack sudo[103665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-160d58c8-9b90-4613-a490-5aa01789b981.bd373473-c7c8-43cc-92a6-22db41062cfe Sep 04 22:52:38 devstack sudo[103665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:38 devstack sudo[103665]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:38 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-280d701d-db75-4077-b171-a35c62ea7d76 tempest-VolumeDependencyTests-1382825298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-160d58c8-9b90-4613-a490-5aa01789b981.bd373473-c7c8-43cc-92a6-22db41062cfe" returned: 0 in 0.275s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:38 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-280d701d-db75-4077-b171-a35c62ea7d76 tempest-VolumeDependencyTests-1382825298 None] Lock "cinder-quobyte-bd373473-c7c8-43cc-92a6-22db41062cfe" released by "_delete_snapshot" :: held 1.849s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:52:38 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-280d701d-db75-4077-b171-a35c62ea7d76 tempest-VolumeDependencyTests-1382825298 None] Lock "cinder-quobyte-160d58c8-9b90-4613-a490-5aa01789b981" released by "delete_snapshot" :: held 1.876s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:52:38 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-280d701d-db75-4077-b171-a35c62ea7d76 tempest-VolumeDependencyTests-1382825298 None] Created reservations ['7cd52f4b-01f5-40ce-b5d2-0fcdfcfd86db', 'b8ec803f-da25-4794-a2ff-8dce049f142c', 'cd883fc5-a12b-44a3-a2c0-a2f1ca78370c', '3683e6dc-42ae-4031-a673-aba0d7fc87eb'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:52:38 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-280d701d-db75-4077-b171-a35c62ea7d76 tempest-VolumeDependencyTests-1382825298 None] Delete snapshot completed successfully. Sep 04 22:52:38 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-280d701d-db75-4077-b171-a35c62ea7d76 tempest-VolumeDependencyTests-1382825298 None] Lock "cinder-bd373473-c7c8-43cc-92a6-22db41062cfe-delete_snapshot" released by "delete_snapshot" :: held 2.050s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:52:39 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c2d3b330-f909-4c51-bd12-9d0e4f7f61bf tempest-VolumeDependencyTests-1382825298 None] Acquiring lock "cinder-160d58c8-9b90-4613-a490-5aa01789b981-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:52:39 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c2d3b330-f909-4c51-bd12-9d0e4f7f61bf tempest-VolumeDependencyTests-1382825298 None] Lock "cinder-160d58c8-9b90-4613-a490-5aa01789b981-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:52:39 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c2d3b330-f909-4c51-bd12-9d0e4f7f61bf tempest-VolumeDependencyTests-1382825298 None] Acquiring lock "cinder-quobyte-160d58c8-9b90-4613-a490-5aa01789b981" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:52:39 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c2d3b330-f909-4c51-bd12-9d0e4f7f61bf tempest-VolumeDependencyTests-1382825298 None] Lock "cinder-quobyte-160d58c8-9b90-4613-a490-5aa01789b981" acquired by "delete_volume" :: waited 0.031s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:52:39 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae78582-d6aa-4643-a466-5eba68268e6c]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:52:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c2d3b330-f909-4c51-bd12-9d0e4f7f61bf tempest-VolumeDependencyTests-1382825298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-160d58c8-9b90-4613-a490-5aa01789b981 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:39 devstack sudo[103668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-160d58c8-9b90-4613-a490-5aa01789b981 Sep 04 22:52:39 devstack sudo[103668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:39 devstack sudo[103668]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c2d3b330-f909-4c51-bd12-9d0e4f7f61bf tempest-VolumeDependencyTests-1382825298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-160d58c8-9b90-4613-a490-5aa01789b981" returned: 0 in 0.438s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c2d3b330-f909-4c51-bd12-9d0e4f7f61bf tempest-VolumeDependencyTests-1382825298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-160d58c8-9b90-4613-a490-5aa01789b981 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:39 devstack sudo[103673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-160d58c8-9b90-4613-a490-5aa01789b981 Sep 04 22:52:39 devstack sudo[103673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:40 devstack sudo[103673]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c2d3b330-f909-4c51-bd12-9d0e4f7f61bf tempest-VolumeDependencyTests-1382825298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-160d58c8-9b90-4613-a490-5aa01789b981" returned: 0 in 0.303s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:40 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c2d3b330-f909-4c51-bd12-9d0e4f7f61bf tempest-VolumeDependencyTests-1382825298 None] Lock "cinder-quobyte-160d58c8-9b90-4613-a490-5aa01789b981" released by "delete_volume" :: held 0.836s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:52:40 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-c2d3b330-f909-4c51-bd12-9d0e4f7f61bf tempest-VolumeDependencyTests-1382825298 None] Created reservations ['2c5f8567-1c24-4797-89da-a9d635ad763a', '1e5ff102-0b06-4f95-a2e6-9813480f5e79', 'a47d230c-8020-4cd7-af0b-d39b98ead384', 'f9ef812e-7ef3-44c2-b33b-adcedce993d2'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:52:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-c2d3b330-f909-4c51-bd12-9d0e4f7f61bf tempest-VolumeDependencyTests-1382825298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:52:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-c2d3b330-f909-4c51-bd12-9d0e4f7f61bf tempest-VolumeDependencyTests-1382825298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:52:40 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-c2d3b330-f909-4c51-bd12-9d0e4f7f61bf tempest-VolumeDependencyTests-1382825298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:52:40 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-c2d3b330-f909-4c51-bd12-9d0e4f7f61bf tempest-VolumeDependencyTests-1382825298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:52:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-c2d3b330-f909-4c51-bd12-9d0e4f7f61bf tempest-VolumeDependencyTests-1382825298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:52:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c2d3b330-f909-4c51-bd12-9d0e4f7f61bf tempest-VolumeDependencyTests-1382825298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:40 devstack sudo[103676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:52:40 devstack sudo[103676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:40 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-359a8a51-a70c-4387-b954-4377f6c4ab5a tempest-VolumeDependencyTests-1382825298 None] Acquiring lock "cinder-841cc3bf-e9fb-4254-9f61-4f9f4138f494-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:52:40 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-359a8a51-a70c-4387-b954-4377f6c4ab5a tempest-VolumeDependencyTests-1382825298 None] Lock "cinder-841cc3bf-e9fb-4254-9f61-4f9f4138f494-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:52:40 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-359a8a51-a70c-4387-b954-4377f6c4ab5a tempest-VolumeDependencyTests-1382825298 None] Acquiring lock "cinder-quobyte-841cc3bf-e9fb-4254-9f61-4f9f4138f494" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:52:40 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-359a8a51-a70c-4387-b954-4377f6c4ab5a tempest-VolumeDependencyTests-1382825298 None] Lock "cinder-quobyte-841cc3bf-e9fb-4254-9f61-4f9f4138f494" acquired by "delete_volume" :: waited 0.026s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:52:40 devstack sudo[103676]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c2d3b330-f909-4c51-bd12-9d0e4f7f61bf tempest-VolumeDependencyTests-1382825298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.336s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:40 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-c2d3b330-f909-4c51-bd12-9d0e4f7f61bf tempest-VolumeDependencyTests-1382825298 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:52:40 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7384e7a-2d19-409e-8686-a576d20b1156]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:52:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-359a8a51-a70c-4387-b954-4377f6c4ab5a tempest-VolumeDependencyTests-1382825298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-841cc3bf-e9fb-4254-9f61-4f9f4138f494 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:40 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-c2d3b330-f909-4c51-bd12-9d0e4f7f61bf tempest-VolumeDependencyTests-1382825298 None] Deleted volume successfully. Sep 04 22:52:40 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c2d3b330-f909-4c51-bd12-9d0e4f7f61bf tempest-VolumeDependencyTests-1382825298 None] Lock "cinder-160d58c8-9b90-4613-a490-5aa01789b981-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:52:40 devstack sudo[103679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-841cc3bf-e9fb-4254-9f61-4f9f4138f494 Sep 04 22:52:40 devstack sudo[103679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:41 devstack sudo[103679]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-359a8a51-a70c-4387-b954-4377f6c4ab5a tempest-VolumeDependencyTests-1382825298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-841cc3bf-e9fb-4254-9f61-4f9f4138f494" returned: 0 in 0.424s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-359a8a51-a70c-4387-b954-4377f6c4ab5a tempest-VolumeDependencyTests-1382825298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-841cc3bf-e9fb-4254-9f61-4f9f4138f494 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:41 devstack sudo[103684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-841cc3bf-e9fb-4254-9f61-4f9f4138f494 Sep 04 22:52:41 devstack sudo[103684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:41 devstack sudo[103684]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-359a8a51-a70c-4387-b954-4377f6c4ab5a tempest-VolumeDependencyTests-1382825298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-841cc3bf-e9fb-4254-9f61-4f9f4138f494" returned: 0 in 0.274s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:41 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-359a8a51-a70c-4387-b954-4377f6c4ab5a tempest-VolumeDependencyTests-1382825298 None] Lock "cinder-quobyte-841cc3bf-e9fb-4254-9f61-4f9f4138f494" released by "delete_volume" :: held 0.768s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:52:41 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-359a8a51-a70c-4387-b954-4377f6c4ab5a tempest-VolumeDependencyTests-1382825298 None] Created reservations ['47e9c710-94ff-4981-95ea-e2a07904aaad', 'ee719b09-b4df-4d1f-88b5-d233babf5776', 'ad7b6c1e-3097-4d26-abd9-970c25338666', 'c073c3ae-e66a-4fed-87c4-31b46aad5081'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:52:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-359a8a51-a70c-4387-b954-4377f6c4ab5a tempest-VolumeDependencyTests-1382825298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:52:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-359a8a51-a70c-4387-b954-4377f6c4ab5a tempest-VolumeDependencyTests-1382825298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:52:41 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-359a8a51-a70c-4387-b954-4377f6c4ab5a tempest-VolumeDependencyTests-1382825298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:52:41 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-359a8a51-a70c-4387-b954-4377f6c4ab5a tempest-VolumeDependencyTests-1382825298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:52:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-359a8a51-a70c-4387-b954-4377f6c4ab5a tempest-VolumeDependencyTests-1382825298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:52:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-359a8a51-a70c-4387-b954-4377f6c4ab5a tempest-VolumeDependencyTests-1382825298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:41 devstack sudo[103687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:52:41 devstack sudo[103687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:41 devstack sudo[103687]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-359a8a51-a70c-4387-b954-4377f6c4ab5a tempest-VolumeDependencyTests-1382825298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.350s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:41 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-359a8a51-a70c-4387-b954-4377f6c4ab5a tempest-VolumeDependencyTests-1382825298 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:52:41 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-359a8a51-a70c-4387-b954-4377f6c4ab5a tempest-VolumeDependencyTests-1382825298 None] Deleted volume successfully. Sep 04 22:52:41 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-359a8a51-a70c-4387-b954-4377f6c4ab5a tempest-VolumeDependencyTests-1382825298 None] Lock "cinder-841cc3bf-e9fb-4254-9f61-4f9f4138f494-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:52:48 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:52:48 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] Flow 'volume_create_manager' (8f578c6c-9f35-437e-a19a-e4b7dbaf7895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:52:48 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f870bb56-3b9b-4606-876d-9affe21a7f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:48 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f870bb56-3b9b-4606-876d-9affe21a7f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:52:48Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e58013e-cf60-4679-a93b-c99b19e74e54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='475d8559f313480cbdb75620d84e4484',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:52:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:52:49Z,use_quota=True,user_id='4783de101f1f47bfa69b2408a5fec533',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:48 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1e6f89e-b79b-470e-997d-941c6a08ddf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:48 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1e6f89e-b79b-470e-997d-941c6a08ddf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:48 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3748acc1-18ba-43fe-b1bb-9e57447d01b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:48 devstack cinder-volume[87576]: DEBUG cinder.image.glance [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] Creating Keystone auth plugin from conf {{(pid=87576) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 04 22:52:49 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3748acc1-18ba-43fe-b1bb-9e57447d01b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9e58013e-cf60-4679-a93b-c99b19e74e54', 'volume_name': 'volume-9e58013e-cf60-4679-a93b-c99b19e74e54', 'volume_size': 1, 'image_id': '3aad163c-07df-444f-b879-3f61ff9f947d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3aad163c-07df-444f-b879-3f61ff9f947d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '38d9641ec0d5aec23788fffa399e321a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '475d8559f313480cbdb75620d84e4484', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b42430fca2756fc48926b3aba7d3f121f76459a0951ec6ea3db6cc7878d730b035f6a6f7d731e54dfa4bceba71912eb5a2598293a8e3ada04c0269a30ff62bf8', 'id': '3aad163c-07df-444f-b879-3f61ff9f947d', 'created_at': datetime.datetime(2026, 9, 4, 20, 52, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 20, 52, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3aad163c-07df-444f-b879-3f61ff9f947d/file', 'properties': {}}, 'image_service': }' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:49 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f7d82f6-e580-42ac-bf43-d5d679a735f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:49 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f7d82f6-e580-42ac-bf43-d5d679a735f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:49 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b47f6e66-cbc5-4d3b-9d9b-00504aa292f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:49 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] Volume 9e58013e-cf60-4679-a93b-c99b19e74e54: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9e58013e-cf60-4679-a93b-c99b19e74e54', 'volume_size': 1, 'image_id': '3aad163c-07df-444f-b879-3f61ff9f947d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3aad163c-07df-444f-b879-3f61ff9f947d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '38d9641ec0d5aec23788fffa399e321a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '475d8559f313480cbdb75620d84e4484', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b42430fca2756fc48926b3aba7d3f121f76459a0951ec6ea3db6cc7878d730b035f6a6f7d731e54dfa4bceba71912eb5a2598293a8e3ada04c0269a30ff62bf8', 'id': '3aad163c-07df-444f-b879-3f61ff9f947d', 'created_at': datetime.datetime(2026, 9, 4, 20, 52, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 20, 52, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3aad163c-07df-444f-b879-3f61ff9f947d/file', 'properties': {}}, 'image_service': } Sep 04 22:52:49 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] Trying to clone 9e58013e-cf60-4679-a93b-c99b19e74e54 from image 3aad163c-07df-444f-b879-3f61ff9f947d at location (None, [{'url': 'file:///opt/stack/data/glance/images/3aad163c-07df-444f-b879-3f61ff9f947d', 'metadata': {}}]). {{(pid=87576) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 04 22:52:49 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-11af10ee-183e-42d2-8698-d319f88e7b6d tempest-VolumeQuotasNegativeTestJSON-1380997400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:52:49 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-11af10ee-183e-42d2-8698-d319f88e7b6d tempest-VolumeQuotasNegativeTestJSON-1380997400 None] Flow 'volume_create_manager' (c62cd0f7-631e-42ab-a6d1-6ff260f46c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:52:49 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-11af10ee-183e-42d2-8698-d319f88e7b6d tempest-VolumeQuotasNegativeTestJSON-1380997400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3a1de6f-6769-4294-8290-cc336ef9b1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:49 devstack cinder-volume[87576]: DEBUG cinder.image.image_utils [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3aad163c-07df-444f-b879-3f61ff9f947d_6obaex_cdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87576) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 04 22:52:49 devstack cinder-volume[87576]: INFO cinder.image.image_utils [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] Image download 0.00 MB at 0.00 MB/s Sep 04 22:52:49 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-11af10ee-183e-42d2-8698-d319f88e7b6d tempest-VolumeQuotasNegativeTestJSON-1380997400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3a1de6f-6769-4294-8290-cc336ef9b1b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:52:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1741640197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95359b11-d505-4beb-968e-b6f74826e0cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6269c63bc3324f13900e564e061af1a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:52:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:52:50Z,use_quota=True,user_id='2de3bbd86a1d4191a4e37976ab91a5d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:49 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-11af10ee-183e-42d2-8698-d319f88e7b6d tempest-VolumeQuotasNegativeTestJSON-1380997400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b476a926-425b-4b44-9f3b-068fa5db0c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:49 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-11af10ee-183e-42d2-8698-d319f88e7b6d tempest-VolumeQuotasNegativeTestJSON-1380997400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b476a926-425b-4b44-9f3b-068fa5db0c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:49 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-11af10ee-183e-42d2-8698-d319f88e7b6d tempest-VolumeQuotasNegativeTestJSON-1380997400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6c410c2-c4e5-4f5d-8e06-8ff7f460ce8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:49 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-11af10ee-183e-42d2-8698-d319f88e7b6d tempest-VolumeQuotasNegativeTestJSON-1380997400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6c410c2-c4e5-4f5d-8e06-8ff7f460ce8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95359b11-d505-4beb-968e-b6f74826e0cd', 'volume_name': 'volume-95359b11-d505-4beb-968e-b6f74826e0cd', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:49 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-11af10ee-183e-42d2-8698-d319f88e7b6d tempest-VolumeQuotasNegativeTestJSON-1380997400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (447f20d2-b534-49c0-b12d-7a4b85caf671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:49 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-11af10ee-183e-42d2-8698-d319f88e7b6d tempest-VolumeQuotasNegativeTestJSON-1380997400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (447f20d2-b534-49c0-b12d-7a4b85caf671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:49 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-11af10ee-183e-42d2-8698-d319f88e7b6d tempest-VolumeQuotasNegativeTestJSON-1380997400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a22c80a6-8259-440a-9055-da9b934c0bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:49 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-11af10ee-183e-42d2-8698-d319f88e7b6d tempest-VolumeQuotasNegativeTestJSON-1380997400 None] Volume 95359b11-d505-4beb-968e-b6f74826e0cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95359b11-d505-4beb-968e-b6f74826e0cd', 'volume_size': 1} Sep 04 22:52:49 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-11af10ee-183e-42d2-8698-d319f88e7b6d tempest-VolumeQuotasNegativeTestJSON-1380997400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:52:49 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-11af10ee-183e-42d2-8698-d319f88e7b6d tempest-VolumeQuotasNegativeTestJSON-1380997400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:52:49 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-11af10ee-183e-42d2-8698-d319f88e7b6d tempest-VolumeQuotasNegativeTestJSON-1380997400 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:52:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1741640197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95359b11-d505-4beb-968e-b6f74826e0cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6269c63bc3324f13900e564e061af1a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:52:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:52:50Z,use_quota=True,user_id='2de3bbd86a1d4191a4e37976ab91a5d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:52:49 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-11af10ee-183e-42d2-8698-d319f88e7b6d tempest-VolumeQuotasNegativeTestJSON-1380997400 None] Creating volume 95359b11-d505-4beb-968e-b6f74826e0cd {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:52:49 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-11af10ee-183e-42d2-8698-d319f88e7b6d tempest-VolumeQuotasNegativeTestJSON-1380997400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:52:49 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-11af10ee-183e-42d2-8698-d319f88e7b6d tempest-VolumeQuotasNegativeTestJSON-1380997400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:52:49 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-11af10ee-183e-42d2-8698-d319f88e7b6d tempest-VolumeQuotasNegativeTestJSON-1380997400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:52:49 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-11af10ee-183e-42d2-8698-d319f88e7b6d tempest-VolumeQuotasNegativeTestJSON-1380997400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:52:49 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-11af10ee-183e-42d2-8698-d319f88e7b6d tempest-VolumeQuotasNegativeTestJSON-1380997400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:52:49 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-11af10ee-183e-42d2-8698-d319f88e7b6d tempest-VolumeQuotasNegativeTestJSON-1380997400 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:52:49 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-11af10ee-183e-42d2-8698-d319f88e7b6d tempest-VolumeQuotasNegativeTestJSON-1380997400 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:52:49 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-11af10ee-183e-42d2-8698-d319f88e7b6d tempest-VolumeQuotasNegativeTestJSON-1380997400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-95359b11-d505-4beb-968e-b6f74826e0cd 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:49 devstack sudo[103700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-95359b11-d505-4beb-968e-b6f74826e0cd 1073741824 Sep 04 22:52:49 devstack sudo[103700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:49 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ba1536-5da2-443f-8a01-ff05615bc0d9]: (4, 'raw') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:52:49 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3aad163c-07df-444f-b879-3f61ff9f947d_6obaex_cdevstack@QuobyteHD {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:49 devstack sudo[103702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3aad163c-07df-444f-b879-3f61ff9f947d_6obaex_cdevstack@QuobyteHD Sep 04 22:52:49 devstack sudo[103702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:50 devstack sudo[103702]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:50 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3aad163c-07df-444f-b879-3f61ff9f947d_6obaex_cdevstack@QuobyteHD" returned: 0 in 0.373s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:50 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3aad163c-07df-444f-b879-3f61ff9f947d_6obaex_cdevstack@QuobyteHD {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:50 devstack sudo[103700]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:50 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-11af10ee-183e-42d2-8698-d319f88e7b6d tempest-VolumeQuotasNegativeTestJSON-1380997400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-95359b11-d505-4beb-968e-b6f74826e0cd 1073741824" returned: 0 in 0.470s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:50 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-11af10ee-183e-42d2-8698-d319f88e7b6d tempest-VolumeQuotasNegativeTestJSON-1380997400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-95359b11-d505-4beb-968e-b6f74826e0cd {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:50 devstack sudo[103710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3aad163c-07df-444f-b879-3f61ff9f947d_6obaex_cdevstack@QuobyteHD Sep 04 22:52:50 devstack sudo[103710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:50 devstack sudo[103711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-95359b11-d505-4beb-968e-b6f74826e0cd Sep 04 22:52:50 devstack sudo[103711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:50 devstack sudo[103710]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:50 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3aad163c-07df-444f-b879-3f61ff9f947d_6obaex_cdevstack@QuobyteHD" returned: 1 in 0.359s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:50 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3aad163c-07df-444f-b879-3f61ff9f947d_6obaex_cdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 22:52:50 devstack cinder-volume[87576]: DEBUG cinder.image.image_utils [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] Temporary image 3aad163c-07df-444f-b879-3f61ff9f947d is fetched for user 4783de101f1f47bfa69b2408a5fec533. {{(pid=87576) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 04 22:52:50 devstack sudo[103711]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:50 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-11af10ee-183e-42d2-8698-d319f88e7b6d tempest-VolumeQuotasNegativeTestJSON-1380997400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-95359b11-d505-4beb-968e-b6f74826e0cd" returned: 0 in 0.275s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:50 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-11af10ee-183e-42d2-8698-d319f88e7b6d tempest-VolumeQuotasNegativeTestJSON-1380997400 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:52:50 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-11af10ee-183e-42d2-8698-d319f88e7b6d tempest-VolumeQuotasNegativeTestJSON-1380997400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:52:50 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-11af10ee-183e-42d2-8698-d319f88e7b6d tempest-VolumeQuotasNegativeTestJSON-1380997400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a22c80a6-8259-440a-9055-da9b934c0bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95359b11-d505-4beb-968e-b6f74826e0cd', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:50 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-11af10ee-183e-42d2-8698-d319f88e7b6d tempest-VolumeQuotasNegativeTestJSON-1380997400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86006b54-a355-46ed-a0ba-21fef19d2efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:50 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-11af10ee-183e-42d2-8698-d319f88e7b6d tempest-VolumeQuotasNegativeTestJSON-1380997400 None] Volume volume-95359b11-d505-4beb-968e-b6f74826e0cd (95359b11-d505-4beb-968e-b6f74826e0cd): created successfully Sep 04 22:52:50 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-11af10ee-183e-42d2-8698-d319f88e7b6d tempest-VolumeQuotasNegativeTestJSON-1380997400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86006b54-a355-46ed-a0ba-21fef19d2efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:50 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-11af10ee-183e-42d2-8698-d319f88e7b6d tempest-VolumeQuotasNegativeTestJSON-1380997400 None] Flow 'volume_create_manager' (c62cd0f7-631e-42ab-a6d1-6ff260f46c2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:52:50 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-11af10ee-183e-42d2-8698-d319f88e7b6d tempest-VolumeQuotasNegativeTestJSON-1380997400 None] Created volume successfully. Sep 04 22:52:50 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9a5349-424e-4259-8183-d9d3d88bdeed]: (4, 'raw') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:52:50 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3aad163c-07df-444f-b879-3f61ff9f947d_6obaex_cdevstack@QuobyteHD {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:50 devstack sudo[103718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3aad163c-07df-444f-b879-3f61ff9f947d_6obaex_cdevstack@QuobyteHD Sep 04 22:52:50 devstack sudo[103718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:50 devstack sudo[103718]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:50 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3aad163c-07df-444f-b879-3f61ff9f947d_6obaex_cdevstack@QuobyteHD" returned: 0 in 0.363s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:50 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3aad163c-07df-444f-b879-3f61ff9f947d_6obaex_cdevstack@QuobyteHD {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:51 devstack sudo[103722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3aad163c-07df-444f-b879-3f61ff9f947d_6obaex_cdevstack@QuobyteHD Sep 04 22:52:51 devstack sudo[103722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:51 devstack sudo[103722]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:51 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3aad163c-07df-444f-b879-3f61ff9f947d_6obaex_cdevstack@QuobyteHD" returned: 1 in 0.345s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:51 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3aad163c-07df-444f-b879-3f61ff9f947d_6obaex_cdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 22:52:51 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:52:51 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:52:51 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:52:48Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e58013e-cf60-4679-a93b-c99b19e74e54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='475d8559f313480cbdb75620d84e4484',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:52:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:52:49Z,use_quota=True,user_id='4783de101f1f47bfa69b2408a5fec533',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:52:51 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] Creating volume 9e58013e-cf60-4679-a93b-c99b19e74e54 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:52:51 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:52:51 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:52:51 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:52:51 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:52:51 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:52:51 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:52:51 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:52:51 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9e58013e-cf60-4679-a93b-c99b19e74e54 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:51 devstack sudo[103727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9e58013e-cf60-4679-a93b-c99b19e74e54 1073741824 Sep 04 22:52:51 devstack sudo[103727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:51 devstack sudo[103727]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:51 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9e58013e-cf60-4679-a93b-c99b19e74e54 1073741824" returned: 0 in 0.516s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:51 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9e58013e-cf60-4679-a93b-c99b19e74e54 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:51 devstack sudo[103733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9e58013e-cf60-4679-a93b-c99b19e74e54 Sep 04 22:52:51 devstack sudo[103733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:52 devstack sudo[103733]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9e58013e-cf60-4679-a93b-c99b19e74e54" returned: 0 in 0.279s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:52 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:52:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:52:52 devstack cinder-volume[87576]: DEBUG cinder.volume.volume_utils [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] Attempting download of 3aad163c-07df-444f-b879-3f61ff9f947d ((None, [{'url': 'file:///opt/stack/data/glance/images/3aad163c-07df-444f-b879-3f61ff9f947d', 'metadata': {}}])) to volume 9e58013e-cf60-4679-a93b-c99b19e74e54. {{(pid=87576) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 04 22:52:52 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[821ed053-0562-4671-901f-90207c536ed8]: (4, 'raw') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:52:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3aad163c-07df-444f-b879-3f61ff9f947d_zbeh0kda {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:52 devstack sudo[103736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3aad163c-07df-444f-b879-3f61ff9f947d_zbeh0kda Sep 04 22:52:52 devstack sudo[103736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:52 devstack sudo[103736]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3aad163c-07df-444f-b879-3f61ff9f947d_zbeh0kda" returned: 0 in 0.328s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3aad163c-07df-444f-b879-3f61ff9f947d_zbeh0kda {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:52 devstack sudo[103740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3aad163c-07df-444f-b879-3f61ff9f947d_zbeh0kda Sep 04 22:52:52 devstack sudo[103740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:52 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-5c18eab2-dafe-4d16-88c8-9f93cdeb75c0 tempest-VolumeQuotasNegativeTestJSON-1380997400 None] Acquiring lock "cinder-95359b11-d505-4beb-968e-b6f74826e0cd-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:52:52 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-5c18eab2-dafe-4d16-88c8-9f93cdeb75c0 tempest-VolumeQuotasNegativeTestJSON-1380997400 None] Lock "cinder-95359b11-d505-4beb-968e-b6f74826e0cd-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:52:52 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-5c18eab2-dafe-4d16-88c8-9f93cdeb75c0 tempest-VolumeQuotasNegativeTestJSON-1380997400 None] Acquiring lock "cinder-quobyte-95359b11-d505-4beb-968e-b6f74826e0cd" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:52:52 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-5c18eab2-dafe-4d16-88c8-9f93cdeb75c0 tempest-VolumeQuotasNegativeTestJSON-1380997400 None] Lock "cinder-quobyte-95359b11-d505-4beb-968e-b6f74826e0cd" acquired by "delete_volume" :: waited 0.024s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:52:52 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88e248c-1c74-4239-b3c3-ecd2589b4b5b]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:52:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5c18eab2-dafe-4d16-88c8-9f93cdeb75c0 tempest-VolumeQuotasNegativeTestJSON-1380997400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-95359b11-d505-4beb-968e-b6f74826e0cd {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:52 devstack sudo[103740]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3aad163c-07df-444f-b879-3f61ff9f947d_zbeh0kda" returned: 1 in 0.412s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3aad163c-07df-444f-b879-3f61ff9f947d_zbeh0kda' failed. Not Retrying. {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 22:52:52 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1320b8-3572-4694-aa5d-2bcce91a166e]: (4, 'raw') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:52:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3aad163c-07df-444f-b879-3f61ff9f947d_6obaex_cdevstack@QuobyteHD {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:53 devstack sudo[103742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-95359b11-d505-4beb-968e-b6f74826e0cd Sep 04 22:52:53 devstack sudo[103742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:53 devstack sudo[103745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3aad163c-07df-444f-b879-3f61ff9f947d_6obaex_cdevstack@QuobyteHD Sep 04 22:52:53 devstack sudo[103745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:53 devstack sudo[103742]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:53 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5c18eab2-dafe-4d16-88c8-9f93cdeb75c0 tempest-VolumeQuotasNegativeTestJSON-1380997400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-95359b11-d505-4beb-968e-b6f74826e0cd" returned: 0 in 0.486s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:53 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5c18eab2-dafe-4d16-88c8-9f93cdeb75c0 tempest-VolumeQuotasNegativeTestJSON-1380997400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-95359b11-d505-4beb-968e-b6f74826e0cd {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:53 devstack sudo[103755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-95359b11-d505-4beb-968e-b6f74826e0cd Sep 04 22:52:53 devstack sudo[103745]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:53 devstack sudo[103755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:53 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3aad163c-07df-444f-b879-3f61ff9f947d_6obaex_cdevstack@QuobyteHD" returned: 0 in 0.452s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:53 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3aad163c-07df-444f-b879-3f61ff9f947d_6obaex_cdevstack@QuobyteHD {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:53 devstack sudo[103757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3aad163c-07df-444f-b879-3f61ff9f947d_6obaex_cdevstack@QuobyteHD Sep 04 22:52:53 devstack sudo[103757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:53 devstack sudo[103755]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:53 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5c18eab2-dafe-4d16-88c8-9f93cdeb75c0 tempest-VolumeQuotasNegativeTestJSON-1380997400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-95359b11-d505-4beb-968e-b6f74826e0cd" returned: 0 in 0.275s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:53 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-5c18eab2-dafe-4d16-88c8-9f93cdeb75c0 tempest-VolumeQuotasNegativeTestJSON-1380997400 None] Lock "cinder-quobyte-95359b11-d505-4beb-968e-b6f74826e0cd" released by "delete_volume" :: held 0.799s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:52:53 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-5c18eab2-dafe-4d16-88c8-9f93cdeb75c0 tempest-VolumeQuotasNegativeTestJSON-1380997400 None] Created reservations ['6864ef4a-c101-4795-86b3-f31f325cbbe2', 'b2136b1d-b3f4-4531-b6e7-e624f32a44e8', 'cbb63487-955b-4bd7-afeb-0e3445a18169', '87487498-df9e-44b5-909a-cdd00826143a'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:52:53 devstack sudo[103757]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:53 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3aad163c-07df-444f-b879-3f61ff9f947d_6obaex_cdevstack@QuobyteHD" returned: 1 in 0.402s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:53 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3aad163c-07df-444f-b879-3f61ff9f947d_6obaex_cdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 22:52:53 devstack cinder-volume[87576]: DEBUG cinder.image.image_utils [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] 3aad163c-07df-444f-b879-3f61ff9f947d was raw, converting to qcow2 {{(pid=87576) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 04 22:52:53 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3aad163c-07df-444f-b879-3f61ff9f947d_6obaex_cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9e58013e-cf60-4679-a93b-c99b19e74e54 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:53 devstack sudo[103763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3aad163c-07df-444f-b879-3f61ff9f947d_6obaex_cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9e58013e-cf60-4679-a93b-c99b19e74e54 Sep 04 22:52:53 devstack sudo[103763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:53 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-5c18eab2-dafe-4d16-88c8-9f93cdeb75c0 tempest-VolumeQuotasNegativeTestJSON-1380997400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:52:53 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-5c18eab2-dafe-4d16-88c8-9f93cdeb75c0 tempest-VolumeQuotasNegativeTestJSON-1380997400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:52:53 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-5c18eab2-dafe-4d16-88c8-9f93cdeb75c0 tempest-VolumeQuotasNegativeTestJSON-1380997400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:52:53 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-5c18eab2-dafe-4d16-88c8-9f93cdeb75c0 tempest-VolumeQuotasNegativeTestJSON-1380997400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:52:53 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-5c18eab2-dafe-4d16-88c8-9f93cdeb75c0 tempest-VolumeQuotasNegativeTestJSON-1380997400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:52:53 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5c18eab2-dafe-4d16-88c8-9f93cdeb75c0 tempest-VolumeQuotasNegativeTestJSON-1380997400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:53 devstack sudo[103765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:52:53 devstack sudo[103765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:54 devstack sudo[103765]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5c18eab2-dafe-4d16-88c8-9f93cdeb75c0 tempest-VolumeQuotasNegativeTestJSON-1380997400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.484s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:54 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-5c18eab2-dafe-4d16-88c8-9f93cdeb75c0 tempest-VolumeQuotasNegativeTestJSON-1380997400 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:52:54 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-5c18eab2-dafe-4d16-88c8-9f93cdeb75c0 tempest-VolumeQuotasNegativeTestJSON-1380997400 None] Deleted volume successfully. Sep 04 22:52:54 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-5c18eab2-dafe-4d16-88c8-9f93cdeb75c0 tempest-VolumeQuotasNegativeTestJSON-1380997400 None] Lock "cinder-95359b11-d505-4beb-968e-b6f74826e0cd-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:52:54 devstack sudo[103763]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3aad163c-07df-444f-b879-3f61ff9f947d_6obaex_cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9e58013e-cf60-4679-a93b-c99b19e74e54" returned: 0 in 0.817s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:54 devstack cinder-volume[87576]: DEBUG cinder.image.image_utils [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3aad163c-07df-444f-b879-3f61ff9f947d_6obaex_cdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9e58013e-cf60-4679-a93b-c99b19e74e54 {{(pid=87576) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 22:52:54 devstack cinder-volume[87576]: INFO cinder.image.image_utils [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] Converted 0.00 MB image at 0.00 MB/s Sep 04 22:52:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9e58013e-cf60-4679-a93b-c99b19e74e54 1G {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:54 devstack sudo[103772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9e58013e-cf60-4679-a93b-c99b19e74e54 1G Sep 04 22:52:54 devstack sudo[103772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:55 devstack sudo[103772]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9e58013e-cf60-4679-a93b-c99b19e74e54 1G" returned: 0 in 0.364s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:55 devstack cinder-volume[87576]: DEBUG cinder.volume.volume_utils [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] Downloaded image 3aad163c-07df-444f-b879-3f61ff9f947d ((None, [{'url': 'file:///opt/stack/data/glance/images/3aad163c-07df-444f-b879-3f61ff9f947d', 'metadata': {}}])) to volume 9e58013e-cf60-4679-a93b-c99b19e74e54 successfully. {{(pid=87576) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 04 22:52:55 devstack cinder-volume[87576]: DEBUG cinder.image.image_utils [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] Temporary image 3aad163c-07df-444f-b879-3f61ff9f947d for user 4783de101f1f47bfa69b2408a5fec533 is deleted. {{(pid=87576) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 04 22:52:55 devstack cinder-volume[87576]: DEBUG cinder.volume.volume_utils [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] Marking volume 9e58013e-cf60-4679-a93b-c99b19e74e54 as bootable. {{(pid=87576) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 04 22:52:55 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] Copying metadata from image 3aad163c-07df-444f-b879-3f61ff9f947d to 9e58013e-cf60-4679-a93b-c99b19e74e54. {{(pid=87576) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 04 22:52:55 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] Creating volume glance metadata for volume 9e58013e-cf60-4679-a93b-c99b19e74e54 backed by image 3aad163c-07df-444f-b879-3f61ff9f947d with: {'image_id': '3aad163c-07df-444f-b879-3f61ff9f947d', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '38d9641ec0d5aec23788fffa399e321a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87576) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 04 22:52:55 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b47f6e66-cbc5-4d3b-9d9b-00504aa292f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e58013e-cf60-4679-a93b-c99b19e74e54', 'volume_size': 1, 'image_id': '3aad163c-07df-444f-b879-3f61ff9f947d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3aad163c-07df-444f-b879-3f61ff9f947d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '38d9641ec0d5aec23788fffa399e321a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '475d8559f313480cbdb75620d84e4484', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b42430fca2756fc48926b3aba7d3f121f76459a0951ec6ea3db6cc7878d730b035f6a6f7d731e54dfa4bceba71912eb5a2598293a8e3ada04c0269a30ff62bf8', 'id': '3aad163c-07df-444f-b879-3f61ff9f947d', 'created_at': datetime.datetime(2026, 9, 4, 20, 52, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 20, 52, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3aad163c-07df-444f-b879-3f61ff9f947d/file', 'properties': {}}, 'image_service': }' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:55 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4329f982-8e41-4009-8a60-26ceef869cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:55 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] Volume volume-9e58013e-cf60-4679-a93b-c99b19e74e54 (9e58013e-cf60-4679-a93b-c99b19e74e54): created successfully Sep 04 22:52:55 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4329f982-8e41-4009-8a60-26ceef869cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:55 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] Flow 'volume_create_manager' (8f578c6c-9f35-437e-a19a-e4b7dbaf7895) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:52:55 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-5596312e-4363-48b6-987c-2864e7a9a1e8 tempest-VolumeImageDependencyTests-1533920725 None] Created volume successfully. Sep 04 22:52:55 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a58fd52-6f66-4098-864f-438a87557719 tempest-TestImageHashVerification-251265999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:52:55 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9a58fd52-6f66-4098-864f-438a87557719 tempest-TestImageHashVerification-251265999 None] Flow 'volume_create_manager' (32217a53-0022-43d7-ad1d-6c7ff5cd54ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:52:55 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9a58fd52-6f66-4098-864f-438a87557719 tempest-TestImageHashVerification-251265999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7469b1f6-e2d0-4afa-a4ca-753285f24887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:55 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9a58fd52-6f66-4098-864f-438a87557719 tempest-TestImageHashVerification-251265999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7469b1f6-e2d0-4afa-a4ca-753285f24887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:52:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-2135189206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb6790f1-36ed-4e31-9c8d-d17e91891999,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fbfa17194e7406c81cb2992a63deb13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:52:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:52:55Z,use_quota=True,user_id='01365ed7a2db49fcb2c2ef99489c53c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:55 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9a58fd52-6f66-4098-864f-438a87557719 tempest-TestImageHashVerification-251265999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (182581cd-acf7-437a-a8ee-3aaef8b5dae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:55 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9a58fd52-6f66-4098-864f-438a87557719 tempest-TestImageHashVerification-251265999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (182581cd-acf7-437a-a8ee-3aaef8b5dae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:55 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9a58fd52-6f66-4098-864f-438a87557719 tempest-TestImageHashVerification-251265999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c55cb8b-1b95-475a-918d-3afb7b8da296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:55 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9a58fd52-6f66-4098-864f-438a87557719 tempest-TestImageHashVerification-251265999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c55cb8b-1b95-475a-918d-3afb7b8da296) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb6790f1-36ed-4e31-9c8d-d17e91891999', 'volume_name': 'volume-fb6790f1-36ed-4e31-9c8d-d17e91891999', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:55 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9a58fd52-6f66-4098-864f-438a87557719 tempest-TestImageHashVerification-251265999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcbe927b-b62e-418d-9a8b-8e1071e4007b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:55 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9a58fd52-6f66-4098-864f-438a87557719 tempest-TestImageHashVerification-251265999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcbe927b-b62e-418d-9a8b-8e1071e4007b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:55 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9a58fd52-6f66-4098-864f-438a87557719 tempest-TestImageHashVerification-251265999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (596289f8-aa3a-463b-a7cd-3729ab7b1f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:55 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-9a58fd52-6f66-4098-864f-438a87557719 tempest-TestImageHashVerification-251265999 None] Volume fb6790f1-36ed-4e31-9c8d-d17e91891999: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb6790f1-36ed-4e31-9c8d-d17e91891999', 'volume_size': 1} Sep 04 22:52:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-9a58fd52-6f66-4098-864f-438a87557719 tempest-TestImageHashVerification-251265999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:52:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-9a58fd52-6f66-4098-864f-438a87557719 tempest-TestImageHashVerification-251265999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:52:55 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-9a58fd52-6f66-4098-864f-438a87557719 tempest-TestImageHashVerification-251265999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:52:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-2135189206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb6790f1-36ed-4e31-9c8d-d17e91891999,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fbfa17194e7406c81cb2992a63deb13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:52:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:52:55Z,use_quota=True,user_id='01365ed7a2db49fcb2c2ef99489c53c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:52:55 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-9a58fd52-6f66-4098-864f-438a87557719 tempest-TestImageHashVerification-251265999 None] Creating volume fb6790f1-36ed-4e31-9c8d-d17e91891999 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:52:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-9a58fd52-6f66-4098-864f-438a87557719 tempest-TestImageHashVerification-251265999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:52:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-9a58fd52-6f66-4098-864f-438a87557719 tempest-TestImageHashVerification-251265999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:52:55 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-9a58fd52-6f66-4098-864f-438a87557719 tempest-TestImageHashVerification-251265999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:52:55 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-9a58fd52-6f66-4098-864f-438a87557719 tempest-TestImageHashVerification-251265999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:52:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-9a58fd52-6f66-4098-864f-438a87557719 tempest-TestImageHashVerification-251265999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:52:55 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-9a58fd52-6f66-4098-864f-438a87557719 tempest-TestImageHashVerification-251265999 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:52:55 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-9a58fd52-6f66-4098-864f-438a87557719 tempest-TestImageHashVerification-251265999 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:52:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-9a58fd52-6f66-4098-864f-438a87557719 tempest-TestImageHashVerification-251265999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fb6790f1-36ed-4e31-9c8d-d17e91891999 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:55 devstack sudo[103777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fb6790f1-36ed-4e31-9c8d-d17e91891999 1073741824 Sep 04 22:52:55 devstack sudo[103777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:55 devstack sudo[103777]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-9a58fd52-6f66-4098-864f-438a87557719 tempest-TestImageHashVerification-251265999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fb6790f1-36ed-4e31-9c8d-d17e91891999 1073741824" returned: 0 in 0.451s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-9a58fd52-6f66-4098-864f-438a87557719 tempest-TestImageHashVerification-251265999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fb6790f1-36ed-4e31-9c8d-d17e91891999 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:55 devstack sudo[103782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fb6790f1-36ed-4e31-9c8d-d17e91891999 Sep 04 22:52:55 devstack sudo[103782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:56 devstack sudo[103782]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-9a58fd52-6f66-4098-864f-438a87557719 tempest-TestImageHashVerification-251265999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fb6790f1-36ed-4e31-9c8d-d17e91891999" returned: 0 in 0.269s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:56 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-9a58fd52-6f66-4098-864f-438a87557719 tempest-TestImageHashVerification-251265999 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:52:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-9a58fd52-6f66-4098-864f-438a87557719 tempest-TestImageHashVerification-251265999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:52:56 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9a58fd52-6f66-4098-864f-438a87557719 tempest-TestImageHashVerification-251265999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (596289f8-aa3a-463b-a7cd-3729ab7b1f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb6790f1-36ed-4e31-9c8d-d17e91891999', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:56 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9a58fd52-6f66-4098-864f-438a87557719 tempest-TestImageHashVerification-251265999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8d1ceef-8ae3-46c3-b545-8b76e14b6b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:52:56 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-9a58fd52-6f66-4098-864f-438a87557719 tempest-TestImageHashVerification-251265999 None] Volume volume-fb6790f1-36ed-4e31-9c8d-d17e91891999 (fb6790f1-36ed-4e31-9c8d-d17e91891999): created successfully Sep 04 22:52:56 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9a58fd52-6f66-4098-864f-438a87557719 tempest-TestImageHashVerification-251265999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8d1ceef-8ae3-46c3-b545-8b76e14b6b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:52:56 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9a58fd52-6f66-4098-864f-438a87557719 tempest-TestImageHashVerification-251265999 None] Flow 'volume_create_manager' (32217a53-0022-43d7-ad1d-6c7ff5cd54ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:52:56 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-9a58fd52-6f66-4098-864f-438a87557719 tempest-TestImageHashVerification-251265999 None] Created volume successfully. Sep 04 22:52:56 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d422f1a7-3e40-4bb1-8ada-9aa459bf27e7 tempest-VolumeImageDependencyTests-1533920725 None] Acquiring lock "cinder-9e58013e-cf60-4679-a93b-c99b19e74e54-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:52:56 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d422f1a7-3e40-4bb1-8ada-9aa459bf27e7 tempest-VolumeImageDependencyTests-1533920725 None] Lock "cinder-9e58013e-cf60-4679-a93b-c99b19e74e54-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:52:56 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d422f1a7-3e40-4bb1-8ada-9aa459bf27e7 tempest-VolumeImageDependencyTests-1533920725 None] Acquiring lock "cinder-quobyte-9e58013e-cf60-4679-a93b-c99b19e74e54" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:52:56 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d422f1a7-3e40-4bb1-8ada-9aa459bf27e7 tempest-VolumeImageDependencyTests-1533920725 None] Lock "cinder-quobyte-9e58013e-cf60-4679-a93b-c99b19e74e54" acquired by "delete_volume" :: waited 0.022s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:52:56 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3fd9d47-c148-479d-acdd-2d835b3676b4]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:52:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d422f1a7-3e40-4bb1-8ada-9aa459bf27e7 tempest-VolumeImageDependencyTests-1533920725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9e58013e-cf60-4679-a93b-c99b19e74e54 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:56 devstack sudo[103785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9e58013e-cf60-4679-a93b-c99b19e74e54 Sep 04 22:52:56 devstack sudo[103785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:56 devstack sudo[103785]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d422f1a7-3e40-4bb1-8ada-9aa459bf27e7 tempest-VolumeImageDependencyTests-1533920725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9e58013e-cf60-4679-a93b-c99b19e74e54" returned: 0 in 0.419s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d422f1a7-3e40-4bb1-8ada-9aa459bf27e7 tempest-VolumeImageDependencyTests-1533920725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9e58013e-cf60-4679-a93b-c99b19e74e54 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:57 devstack sudo[103791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9e58013e-cf60-4679-a93b-c99b19e74e54 Sep 04 22:52:57 devstack sudo[103791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:57 devstack sudo[103791]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d422f1a7-3e40-4bb1-8ada-9aa459bf27e7 tempest-VolumeImageDependencyTests-1533920725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9e58013e-cf60-4679-a93b-c99b19e74e54" returned: 0 in 0.310s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:57 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d422f1a7-3e40-4bb1-8ada-9aa459bf27e7 tempest-VolumeImageDependencyTests-1533920725 None] Lock "cinder-quobyte-9e58013e-cf60-4679-a93b-c99b19e74e54" released by "delete_volume" :: held 0.780s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:52:57 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-d422f1a7-3e40-4bb1-8ada-9aa459bf27e7 tempest-VolumeImageDependencyTests-1533920725 None] Created reservations ['cedd67d5-433b-4da7-bb11-ed3ac4e193aa', '1a8420a0-b617-444f-bc44-6514c533f504', 'ce6cab98-fe4c-4778-8e1c-ebaf65b2ecb3', '5e161784-c48a-4bd1-a5fd-10c2d1ae6e93'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:52:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-cf246266-09ee-42d7-8736-1c37b47dcf83 tempest-TestImageHashVerification-251265999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:52:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-cf246266-09ee-42d7-8736-1c37b47dcf83 tempest-TestImageHashVerification-251265999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:52:57 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da50cd7-9b32-43b7-a39e-cca0b516d5d9]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:52:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-cf246266-09ee-42d7-8736-1c37b47dcf83 tempest-TestImageHashVerification-251265999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fb6790f1-36ed-4e31-9c8d-d17e91891999 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-d422f1a7-3e40-4bb1-8ada-9aa459bf27e7 tempest-VolumeImageDependencyTests-1533920725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:52:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-d422f1a7-3e40-4bb1-8ada-9aa459bf27e7 tempest-VolumeImageDependencyTests-1533920725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:52:57 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-d422f1a7-3e40-4bb1-8ada-9aa459bf27e7 tempest-VolumeImageDependencyTests-1533920725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:52:57 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-d422f1a7-3e40-4bb1-8ada-9aa459bf27e7 tempest-VolumeImageDependencyTests-1533920725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:52:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-d422f1a7-3e40-4bb1-8ada-9aa459bf27e7 tempest-VolumeImageDependencyTests-1533920725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:52:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d422f1a7-3e40-4bb1-8ada-9aa459bf27e7 tempest-VolumeImageDependencyTests-1533920725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:57 devstack sudo[103795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:52:57 devstack sudo[103795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:57 devstack sudo[103794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fb6790f1-36ed-4e31-9c8d-d17e91891999 Sep 04 22:52:57 devstack sudo[103794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:57 devstack sudo[103795]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d422f1a7-3e40-4bb1-8ada-9aa459bf27e7 tempest-VolumeImageDependencyTests-1533920725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.319s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:57 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-d422f1a7-3e40-4bb1-8ada-9aa459bf27e7 tempest-VolumeImageDependencyTests-1533920725 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:52:57 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-d422f1a7-3e40-4bb1-8ada-9aa459bf27e7 tempest-VolumeImageDependencyTests-1533920725 None] Deleted volume successfully. Sep 04 22:52:57 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d422f1a7-3e40-4bb1-8ada-9aa459bf27e7 tempest-VolumeImageDependencyTests-1533920725 None] Lock "cinder-9e58013e-cf60-4679-a93b-c99b19e74e54-delete_volume" released by "delete_volume" :: held 1.388s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:52:57 devstack sudo[103794]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-cf246266-09ee-42d7-8736-1c37b47dcf83 tempest-TestImageHashVerification-251265999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fb6790f1-36ed-4e31-9c8d-d17e91891999" returned: 0 in 0.501s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:57 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[000e51cb-409e-4d51-ae83-245c973ff591]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:52:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-cf246266-09ee-42d7-8736-1c37b47dcf83 tempest-TestImageHashVerification-251265999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fb6790f1-36ed-4e31-9c8d-d17e91891999 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:58 devstack sudo[103803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fb6790f1-36ed-4e31-9c8d-d17e91891999 Sep 04 22:52:58 devstack sudo[103803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:52:58 devstack sudo[103803]: pam_unix(sudo:session): session closed for user root Sep 04 22:52:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-cf246266-09ee-42d7-8736-1c37b47dcf83 tempest-TestImageHashVerification-251265999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fb6790f1-36ed-4e31-9c8d-d17e91891999" returned: 0 in 0.408s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:52:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-cf246266-09ee-42d7-8736-1c37b47dcf83 tempest-TestImageHashVerification-251265999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fb6790f1-36ed-4e31-9c8d-d17e91891999 /opt/stack/data/cinder/conversion/fb6790f1-36ed-4e31-9c8d-d17e91891999.temp_image.cde615fd-dd99-48a4-9170-8b53a0ce497boz3tlf_5.img {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:52:58 devstack sudo[103809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fb6790f1-36ed-4e31-9c8d-d17e91891999 /opt/stack/data/cinder/conversion/fb6790f1-36ed-4e31-9c8d-d17e91891999.temp_image.cde615fd-dd99-48a4-9170-8b53a0ce497boz3tlf_5.img Sep 04 22:52:58 devstack sudo[103809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:53:03 devstack sudo[103809]: pam_unix(sudo:session): session closed for user root Sep 04 22:53:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-cf246266-09ee-42d7-8736-1c37b47dcf83 tempest-TestImageHashVerification-251265999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fb6790f1-36ed-4e31-9c8d-d17e91891999 /opt/stack/data/cinder/conversion/fb6790f1-36ed-4e31-9c8d-d17e91891999.temp_image.cde615fd-dd99-48a4-9170-8b53a0ce497boz3tlf_5.img" returned: 0 in 5.061s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:53:03 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56e4c3f-36ef-4aa6-868e-88045db1c0e9]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:53:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-cf246266-09ee-42d7-8736-1c37b47dcf83 tempest-TestImageHashVerification-251265999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fb6790f1-36ed-4e31-9c8d-d17e91891999 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:53:03 devstack sudo[103824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fb6790f1-36ed-4e31-9c8d-d17e91891999 Sep 04 22:53:03 devstack sudo[103824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:53:04 devstack sudo[103824]: pam_unix(sudo:session): session closed for user root Sep 04 22:53:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-cf246266-09ee-42d7-8736-1c37b47dcf83 tempest-TestImageHashVerification-251265999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fb6790f1-36ed-4e31-9c8d-d17e91891999" returned: 0 in 0.595s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:53:04 devstack cinder-volume[87576]: DEBUG cinder.image.image_utils [None req-cf246266-09ee-42d7-8736-1c37b47dcf83 tempest-TestImageHashVerification-251265999 None] Image conversion details: src /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fb6790f1-36ed-4e31-9c8d-d17e91891999, size 1024.00 MB, duration 5.06 sec, destination /opt/stack/data/cinder/conversion/fb6790f1-36ed-4e31-9c8d-d17e91891999.temp_image.cde615fd-dd99-48a4-9170-8b53a0ce497boz3tlf_5.img {{(pid=87576) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 22:53:04 devstack cinder-volume[87576]: INFO cinder.image.image_utils [None req-cf246266-09ee-42d7-8736-1c37b47dcf83 tempest-TestImageHashVerification-251265999 None] Converted 1024.00 MB image at 202.27 MB/s Sep 04 22:53:04 devstack cinder-volume[87576]: DEBUG cinder.image.image_utils [None req-cf246266-09ee-42d7-8736-1c37b47dcf83 tempest-TestImageHashVerification-251265999 None] cde615fd-dd99-48a4-9170-8b53a0ce497b was raw, no need to convert to raw {{(pid=87576) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 04 22:53:04 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc35d2ab-c33a-42eb-8295-9878dfde4ea5 tempest-VolumeTypesAccessTest-2122459474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:53:04 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-fc35d2ab-c33a-42eb-8295-9878dfde4ea5 tempest-VolumeTypesAccessTest-2122459474 None] Flow 'volume_create_manager' (cc9907c6-32b9-4c2c-8062-65f7ba078eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:53:04 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-fc35d2ab-c33a-42eb-8295-9878dfde4ea5 tempest-VolumeTypesAccessTest-2122459474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f53336b7-ca65-46c5-a14e-d7a1fefbe446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:53:04 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-fc35d2ab-c33a-42eb-8295-9878dfde4ea5 tempest-VolumeTypesAccessTest-2122459474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f53336b7-ca65-46c5-a14e-d7a1fefbe446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1457038666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9341cc8b-32a9-4840-bdef-ba04b6e0b519,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cdbb103e4d946d198bba197fae81f88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:53:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:53:04Z,use_quota=True,user_id='891db20c4c4b4a489ce89517565da39b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2898a389-2d11-4bcb-94a9-5b9be60c90dd),volume_type_id=2898a389-2d11-4bcb-94a9-5b9be60c90dd)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:53:04 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-fc35d2ab-c33a-42eb-8295-9878dfde4ea5 tempest-VolumeTypesAccessTest-2122459474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d80fd205-549e-4a08-b2db-f275fc1b2eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:53:04 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-fc35d2ab-c33a-42eb-8295-9878dfde4ea5 tempest-VolumeTypesAccessTest-2122459474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d80fd205-549e-4a08-b2db-f275fc1b2eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:53:04 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-fc35d2ab-c33a-42eb-8295-9878dfde4ea5 tempest-VolumeTypesAccessTest-2122459474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99c14121-9d27-4e8d-bfe0-215eb5a9f95e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:53:04 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-fc35d2ab-c33a-42eb-8295-9878dfde4ea5 tempest-VolumeTypesAccessTest-2122459474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99c14121-9d27-4e8d-bfe0-215eb5a9f95e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9341cc8b-32a9-4840-bdef-ba04b6e0b519', 'volume_name': 'volume-9341cc8b-32a9-4840-bdef-ba04b6e0b519', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:53:04 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-fc35d2ab-c33a-42eb-8295-9878dfde4ea5 tempest-VolumeTypesAccessTest-2122459474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd633d51-797b-4e61-b887-6e798f1fb36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:53:04 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-fc35d2ab-c33a-42eb-8295-9878dfde4ea5 tempest-VolumeTypesAccessTest-2122459474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd633d51-797b-4e61-b887-6e798f1fb36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:53:04 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-fc35d2ab-c33a-42eb-8295-9878dfde4ea5 tempest-VolumeTypesAccessTest-2122459474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (509fad3c-2f92-400b-8d30-bf29d3082ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:53:04 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-fc35d2ab-c33a-42eb-8295-9878dfde4ea5 tempest-VolumeTypesAccessTest-2122459474 None] Volume 9341cc8b-32a9-4840-bdef-ba04b6e0b519: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9341cc8b-32a9-4840-bdef-ba04b6e0b519', 'volume_size': 1} Sep 04 22:53:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-fc35d2ab-c33a-42eb-8295-9878dfde4ea5 tempest-VolumeTypesAccessTest-2122459474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:53:11 devstack cinder-volume[87576]: DEBUG oslo_service.periodic_task [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87576) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 22:53:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:53:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:53:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:53:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:53:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:53:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:53:11 devstack sudo[103829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:53:11 devstack sudo[103829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:53:12 devstack sudo[103829]: pam_unix(sudo:session): session closed for user root Sep 04 22:53:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.279s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:53:12 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:53:12 devstack cinder-volume[87576]: DEBUG oslo_service.periodic_task [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Running periodic task VolumeManager._thread_info {{(pid=87576) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 22:53:12 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] thread count: 28 {{(pid=87576) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 22:53:12 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] thread info: [<_MainThread(MainThread, started 125730416963712)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87576) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 22:53:14 devstack cinder-volume[87576]: DEBUG dbcounter [-] [87576] Writing DB stats cinder:UPDATE=154,cinder:DELETE=9,cinder:SELECT=150,cinder:INSERT=43 {{(pid=87576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 22:53:14 devstack cinder-volume[87576]: DEBUG dbcounter [-] [87576] Writing DB stats cinder:UPDATE=173,cinder:SELECT=125,cinder:INSERT=49,cinder:DELETE=14 {{(pid=87576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 22:53:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-cf246266-09ee-42d7-8736-1c37b47dcf83 tempest-TestImageHashVerification-251265999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.823s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:53:23 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-cf246266-09ee-42d7-8736-1c37b47dcf83 tempest-TestImageHashVerification-251265999 None] Uploaded volume to glance image-id: cde615fd-dd99-48a4-9170-8b53a0ce497b. {{(pid=87576) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 04 22:53:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-fc35d2ab-c33a-42eb-8295-9878dfde4ea5 tempest-VolumeTypesAccessTest-2122459474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.677s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:53:23 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-fc35d2ab-c33a-42eb-8295-9878dfde4ea5 tempest-VolumeTypesAccessTest-2122459474 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1457038666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9341cc8b-32a9-4840-bdef-ba04b6e0b519,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cdbb103e4d946d198bba197fae81f88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:53:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:53:04Z,use_quota=True,user_id='891db20c4c4b4a489ce89517565da39b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2898a389-2d11-4bcb-94a9-5b9be60c90dd),volume_type_id=2898a389-2d11-4bcb-94a9-5b9be60c90dd)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:53:23 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-fc35d2ab-c33a-42eb-8295-9878dfde4ea5 tempest-VolumeTypesAccessTest-2122459474 None] Creating volume 9341cc8b-32a9-4840-bdef-ba04b6e0b519 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:53:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-fc35d2ab-c33a-42eb-8295-9878dfde4ea5 tempest-VolumeTypesAccessTest-2122459474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:53:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-fc35d2ab-c33a-42eb-8295-9878dfde4ea5 tempest-VolumeTypesAccessTest-2122459474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:53:23 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-fc35d2ab-c33a-42eb-8295-9878dfde4ea5 tempest-VolumeTypesAccessTest-2122459474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:53:23 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-fc35d2ab-c33a-42eb-8295-9878dfde4ea5 tempest-VolumeTypesAccessTest-2122459474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:53:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-fc35d2ab-c33a-42eb-8295-9878dfde4ea5 tempest-VolumeTypesAccessTest-2122459474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:53:23 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-fc35d2ab-c33a-42eb-8295-9878dfde4ea5 tempest-VolumeTypesAccessTest-2122459474 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:53:23 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-fc35d2ab-c33a-42eb-8295-9878dfde4ea5 tempest-VolumeTypesAccessTest-2122459474 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:53:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-fc35d2ab-c33a-42eb-8295-9878dfde4ea5 tempest-VolumeTypesAccessTest-2122459474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9341cc8b-32a9-4840-bdef-ba04b6e0b519 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:53:23 devstack sudo[103835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9341cc8b-32a9-4840-bdef-ba04b6e0b519 1073741824 Sep 04 22:53:23 devstack sudo[103835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:53:23 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-cf246266-09ee-42d7-8736-1c37b47dcf83 tempest-TestImageHashVerification-251265999 None] Copy volume to image completed successfully. Sep 04 22:53:23 devstack sudo[103835]: pam_unix(sudo:session): session closed for user root Sep 04 22:53:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-fc35d2ab-c33a-42eb-8295-9878dfde4ea5 tempest-VolumeTypesAccessTest-2122459474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9341cc8b-32a9-4840-bdef-ba04b6e0b519 1073741824" returned: 0 in 0.445s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:53:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-fc35d2ab-c33a-42eb-8295-9878dfde4ea5 tempest-VolumeTypesAccessTest-2122459474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9341cc8b-32a9-4840-bdef-ba04b6e0b519 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:53:23 devstack sudo[103841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9341cc8b-32a9-4840-bdef-ba04b6e0b519 Sep 04 22:53:23 devstack sudo[103841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:53:23 devstack sudo[103841]: pam_unix(sudo:session): session closed for user root Sep 04 22:53:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-fc35d2ab-c33a-42eb-8295-9878dfde4ea5 tempest-VolumeTypesAccessTest-2122459474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9341cc8b-32a9-4840-bdef-ba04b6e0b519" returned: 0 in 0.252s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:53:23 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-fc35d2ab-c33a-42eb-8295-9878dfde4ea5 tempest-VolumeTypesAccessTest-2122459474 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:53:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-fc35d2ab-c33a-42eb-8295-9878dfde4ea5 tempest-VolumeTypesAccessTest-2122459474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:53:23 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f14d38d7-b511-4a0f-9ff1-7c2b0421e822 tempest-TestImageHashVerification-251265999 None] Acquiring lock "cinder-fb6790f1-36ed-4e31-9c8d-d17e91891999-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:53:24 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-fc35d2ab-c33a-42eb-8295-9878dfde4ea5 tempest-VolumeTypesAccessTest-2122459474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (509fad3c-2f92-400b-8d30-bf29d3082ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9341cc8b-32a9-4840-bdef-ba04b6e0b519', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:53:24 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-fc35d2ab-c33a-42eb-8295-9878dfde4ea5 tempest-VolumeTypesAccessTest-2122459474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04791fb8-4b0b-4f64-848a-47a16ef09915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:53:24 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f14d38d7-b511-4a0f-9ff1-7c2b0421e822 tempest-TestImageHashVerification-251265999 None] Lock "cinder-fb6790f1-36ed-4e31-9c8d-d17e91891999-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:53:24 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-fc35d2ab-c33a-42eb-8295-9878dfde4ea5 tempest-VolumeTypesAccessTest-2122459474 None] Volume volume-9341cc8b-32a9-4840-bdef-ba04b6e0b519 (9341cc8b-32a9-4840-bdef-ba04b6e0b519): created successfully Sep 04 22:53:24 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-fc35d2ab-c33a-42eb-8295-9878dfde4ea5 tempest-VolumeTypesAccessTest-2122459474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04791fb8-4b0b-4f64-848a-47a16ef09915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:53:24 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-fc35d2ab-c33a-42eb-8295-9878dfde4ea5 tempest-VolumeTypesAccessTest-2122459474 None] Flow 'volume_create_manager' (cc9907c6-32b9-4c2c-8062-65f7ba078eaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:53:24 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-fc35d2ab-c33a-42eb-8295-9878dfde4ea5 tempest-VolumeTypesAccessTest-2122459474 None] Created volume successfully. Sep 04 22:53:24 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f14d38d7-b511-4a0f-9ff1-7c2b0421e822 tempest-TestImageHashVerification-251265999 None] Acquiring lock "cinder-quobyte-fb6790f1-36ed-4e31-9c8d-d17e91891999" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:53:24 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f14d38d7-b511-4a0f-9ff1-7c2b0421e822 tempest-TestImageHashVerification-251265999 None] Lock "cinder-quobyte-fb6790f1-36ed-4e31-9c8d-d17e91891999" acquired by "delete_volume" :: waited 0.015s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:53:24 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[35cfce1a-05c9-41f4-915e-2b5cf3265513]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:53:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f14d38d7-b511-4a0f-9ff1-7c2b0421e822 tempest-TestImageHashVerification-251265999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fb6790f1-36ed-4e31-9c8d-d17e91891999 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:53:24 devstack sudo[103844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fb6790f1-36ed-4e31-9c8d-d17e91891999 Sep 04 22:53:24 devstack sudo[103844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:53:24 devstack sudo[103844]: pam_unix(sudo:session): session closed for user root Sep 04 22:53:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f14d38d7-b511-4a0f-9ff1-7c2b0421e822 tempest-TestImageHashVerification-251265999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fb6790f1-36ed-4e31-9c8d-d17e91891999" returned: 0 in 0.345s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:53:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f14d38d7-b511-4a0f-9ff1-7c2b0421e822 tempest-TestImageHashVerification-251265999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fb6790f1-36ed-4e31-9c8d-d17e91891999 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:53:24 devstack sudo[103849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fb6790f1-36ed-4e31-9c8d-d17e91891999 Sep 04 22:53:24 devstack sudo[103849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:53:24 devstack sudo[103849]: pam_unix(sudo:session): session closed for user root Sep 04 22:53:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f14d38d7-b511-4a0f-9ff1-7c2b0421e822 tempest-TestImageHashVerification-251265999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fb6790f1-36ed-4e31-9c8d-d17e91891999" returned: 0 in 0.253s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:53:24 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f14d38d7-b511-4a0f-9ff1-7c2b0421e822 tempest-TestImageHashVerification-251265999 None] Lock "cinder-quobyte-fb6790f1-36ed-4e31-9c8d-d17e91891999" released by "delete_volume" :: held 0.638s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:53:24 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-a78777d9-5a2d-4e99-ab03-88bd894a84b9 tempest-VolumeTypesAccessTest-2122459474 None] Acquiring lock "cinder-9341cc8b-32a9-4840-bdef-ba04b6e0b519-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:53:24 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-a78777d9-5a2d-4e99-ab03-88bd894a84b9 tempest-VolumeTypesAccessTest-2122459474 None] Lock "cinder-9341cc8b-32a9-4840-bdef-ba04b6e0b519-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:53:24 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-f14d38d7-b511-4a0f-9ff1-7c2b0421e822 tempest-TestImageHashVerification-251265999 None] Created reservations ['bce573ec-6485-439d-97c5-5452907f7832', '321fdb84-76fd-4acb-b9ce-fa9140397dad', 'a549aa43-cbf5-477c-90f2-4d480e2d9bf0', '8e0ef9ce-99de-419a-9815-2647ebf56a56'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:53:24 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-a78777d9-5a2d-4e99-ab03-88bd894a84b9 tempest-VolumeTypesAccessTest-2122459474 None] Acquiring lock "cinder-quobyte-9341cc8b-32a9-4840-bdef-ba04b6e0b519" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:53:24 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-a78777d9-5a2d-4e99-ab03-88bd894a84b9 tempest-VolumeTypesAccessTest-2122459474 None] Lock "cinder-quobyte-9341cc8b-32a9-4840-bdef-ba04b6e0b519" acquired by "delete_volume" :: waited 0.018s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:53:24 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[e006f10e-f3a5-4c69-9ff5-366e94ea9c26]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:53:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a78777d9-5a2d-4e99-ab03-88bd894a84b9 tempest-VolumeTypesAccessTest-2122459474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9341cc8b-32a9-4840-bdef-ba04b6e0b519 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:53:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f14d38d7-b511-4a0f-9ff1-7c2b0421e822 tempest-TestImageHashVerification-251265999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:53:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f14d38d7-b511-4a0f-9ff1-7c2b0421e822 tempest-TestImageHashVerification-251265999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:53:24 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-f14d38d7-b511-4a0f-9ff1-7c2b0421e822 tempest-TestImageHashVerification-251265999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:53:24 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-f14d38d7-b511-4a0f-9ff1-7c2b0421e822 tempest-TestImageHashVerification-251265999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:53:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f14d38d7-b511-4a0f-9ff1-7c2b0421e822 tempest-TestImageHashVerification-251265999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:53:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f14d38d7-b511-4a0f-9ff1-7c2b0421e822 tempest-TestImageHashVerification-251265999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:53:24 devstack sudo[103853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:53:24 devstack sudo[103853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:53:24 devstack sudo[103852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9341cc8b-32a9-4840-bdef-ba04b6e0b519 Sep 04 22:53:25 devstack sudo[103852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:53:25 devstack sudo[103853]: pam_unix(sudo:session): session closed for user root Sep 04 22:53:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f14d38d7-b511-4a0f-9ff1-7c2b0421e822 tempest-TestImageHashVerification-251265999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.283s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:53:25 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-f14d38d7-b511-4a0f-9ff1-7c2b0421e822 tempest-TestImageHashVerification-251265999 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:53:25 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-f14d38d7-b511-4a0f-9ff1-7c2b0421e822 tempest-TestImageHashVerification-251265999 None] Deleted volume successfully. Sep 04 22:53:25 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f14d38d7-b511-4a0f-9ff1-7c2b0421e822 tempest-TestImageHashVerification-251265999 None] Lock "cinder-fb6790f1-36ed-4e31-9c8d-d17e91891999-delete_volume" released by "delete_volume" :: held 1.219s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:53:25 devstack sudo[103852]: pam_unix(sudo:session): session closed for user root Sep 04 22:53:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a78777d9-5a2d-4e99-ab03-88bd894a84b9 tempest-VolumeTypesAccessTest-2122459474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9341cc8b-32a9-4840-bdef-ba04b6e0b519" returned: 0 in 0.416s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:53:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a78777d9-5a2d-4e99-ab03-88bd894a84b9 tempest-VolumeTypesAccessTest-2122459474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9341cc8b-32a9-4840-bdef-ba04b6e0b519 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:53:25 devstack sudo[103860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9341cc8b-32a9-4840-bdef-ba04b6e0b519 Sep 04 22:53:25 devstack sudo[103860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:53:25 devstack sudo[103860]: pam_unix(sudo:session): session closed for user root Sep 04 22:53:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a78777d9-5a2d-4e99-ab03-88bd894a84b9 tempest-VolumeTypesAccessTest-2122459474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9341cc8b-32a9-4840-bdef-ba04b6e0b519" returned: 0 in 0.255s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:53:25 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-a78777d9-5a2d-4e99-ab03-88bd894a84b9 tempest-VolumeTypesAccessTest-2122459474 None] Lock "cinder-quobyte-9341cc8b-32a9-4840-bdef-ba04b6e0b519" released by "delete_volume" :: held 0.711s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:53:25 devstack cinder-volume[87576]: WARNING cinder.quota [None req-a78777d9-5a2d-4e99-ab03-88bd894a84b9 tempest-VolumeTypesAccessTest-2122459474 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1395324734 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1395324734, it is now deprecated. Please use the default quota class for default quota. Sep 04 22:53:25 devstack cinder-volume[87576]: WARNING cinder.quota [None req-a78777d9-5a2d-4e99-ab03-88bd894a84b9 tempest-VolumeTypesAccessTest-2122459474 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1395324734 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1395324734, it is now deprecated. Please use the default quota class for default quota. Sep 04 22:53:25 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-a78777d9-5a2d-4e99-ab03-88bd894a84b9 tempest-VolumeTypesAccessTest-2122459474 None] Created reservations ['b3b162bc-da68-4271-9b80-e08c06a32cf9', 'cdedc1c8-f864-4282-b7d7-6822c3180654', 'c7821ff6-7379-44e0-84f8-26d21d6d45ce', '69b9343b-2cd3-4fbc-a551-ff21333ac681'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:53:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-a78777d9-5a2d-4e99-ab03-88bd894a84b9 tempest-VolumeTypesAccessTest-2122459474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:53:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-a78777d9-5a2d-4e99-ab03-88bd894a84b9 tempest-VolumeTypesAccessTest-2122459474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:53:25 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-a78777d9-5a2d-4e99-ab03-88bd894a84b9 tempest-VolumeTypesAccessTest-2122459474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:53:25 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-a78777d9-5a2d-4e99-ab03-88bd894a84b9 tempest-VolumeTypesAccessTest-2122459474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:53:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-a78777d9-5a2d-4e99-ab03-88bd894a84b9 tempest-VolumeTypesAccessTest-2122459474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:53:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a78777d9-5a2d-4e99-ab03-88bd894a84b9 tempest-VolumeTypesAccessTest-2122459474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:53:25 devstack sudo[103863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:53:25 devstack sudo[103863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:53:25 devstack sudo[103863]: pam_unix(sudo:session): session closed for user root Sep 04 22:53:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a78777d9-5a2d-4e99-ab03-88bd894a84b9 tempest-VolumeTypesAccessTest-2122459474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.299s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:53:25 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-a78777d9-5a2d-4e99-ab03-88bd894a84b9 tempest-VolumeTypesAccessTest-2122459474 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:53:26 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-a78777d9-5a2d-4e99-ab03-88bd894a84b9 tempest-VolumeTypesAccessTest-2122459474 None] Deleted volume successfully. Sep 04 22:53:26 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-a78777d9-5a2d-4e99-ab03-88bd894a84b9 tempest-VolumeTypesAccessTest-2122459474 None] Lock "cinder-9341cc8b-32a9-4840-bdef-ba04b6e0b519-delete_volume" released by "delete_volume" :: held 1.242s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:53:35 devstack cinder-volume[87576]: DEBUG dbcounter [-] [87576] Writing DB stats cinder:SELECT=10,cinder:UPDATE=18,cinder:DELETE=1,cinder:INSERT=4 {{(pid=87576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 22:53:36 devstack cinder-volume[87576]: DEBUG dbcounter [-] [87576] Writing DB stats cinder:UPDATE=20,cinder:SELECT=13,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 22:53:39 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd58322a-cc32-421a-a826-16632da8db09 tempest-CreateVolumesFromImageTest-1104757032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:53:39 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-fd58322a-cc32-421a-a826-16632da8db09 tempest-CreateVolumesFromImageTest-1104757032 None] Flow 'volume_create_manager' (ba033512-5864-49df-8270-c089a582520b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:53:39 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-fd58322a-cc32-421a-a826-16632da8db09 tempest-CreateVolumesFromImageTest-1104757032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b23ac24-f876-46d2-b14f-b86645b81f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:53:39 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-fd58322a-cc32-421a-a826-16632da8db09 tempest-CreateVolumesFromImageTest-1104757032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b23ac24-f876-46d2-b14f-b86645b81f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:53:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-860980600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6efc994f-5a78-4ff5-9ea8-4c8a0c4666c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb549e02251140d68a89bc787de9d5eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:53:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:53:40Z,use_quota=True,user_id='cb559523b3e84c0f8e41091ca41d5ffb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:53:39 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-fd58322a-cc32-421a-a826-16632da8db09 tempest-CreateVolumesFromImageTest-1104757032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c64ebf91-95d7-43ab-aded-5af58eeae87d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:53:39 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-fd58322a-cc32-421a-a826-16632da8db09 tempest-CreateVolumesFromImageTest-1104757032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c64ebf91-95d7-43ab-aded-5af58eeae87d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:53:39 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-fd58322a-cc32-421a-a826-16632da8db09 tempest-CreateVolumesFromImageTest-1104757032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebb9570a-851a-4508-81a5-1df5079f01d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:53:39 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-fd58322a-cc32-421a-a826-16632da8db09 tempest-CreateVolumesFromImageTest-1104757032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebb9570a-851a-4508-81a5-1df5079f01d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6efc994f-5a78-4ff5-9ea8-4c8a0c4666c2', 'volume_name': 'volume-6efc994f-5a78-4ff5-9ea8-4c8a0c4666c2', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:53:39 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-fd58322a-cc32-421a-a826-16632da8db09 tempest-CreateVolumesFromImageTest-1104757032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a4537e8-2214-4bc0-8926-d4f03b637deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:53:39 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-fd58322a-cc32-421a-a826-16632da8db09 tempest-CreateVolumesFromImageTest-1104757032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a4537e8-2214-4bc0-8926-d4f03b637deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:53:40 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-fd58322a-cc32-421a-a826-16632da8db09 tempest-CreateVolumesFromImageTest-1104757032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2353922f-ecb1-4f6a-b9d0-b26f6549b5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:53:40 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-fd58322a-cc32-421a-a826-16632da8db09 tempest-CreateVolumesFromImageTest-1104757032 None] Volume 6efc994f-5a78-4ff5-9ea8-4c8a0c4666c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6efc994f-5a78-4ff5-9ea8-4c8a0c4666c2', 'volume_size': 1} Sep 04 22:53:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-fd58322a-cc32-421a-a826-16632da8db09 tempest-CreateVolumesFromImageTest-1104757032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:53:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-fd58322a-cc32-421a-a826-16632da8db09 tempest-CreateVolumesFromImageTest-1104757032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:53:40 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-fd58322a-cc32-421a-a826-16632da8db09 tempest-CreateVolumesFromImageTest-1104757032 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:53:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-860980600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6efc994f-5a78-4ff5-9ea8-4c8a0c4666c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb549e02251140d68a89bc787de9d5eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:53:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:53:40Z,use_quota=True,user_id='cb559523b3e84c0f8e41091ca41d5ffb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:53:40 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-fd58322a-cc32-421a-a826-16632da8db09 tempest-CreateVolumesFromImageTest-1104757032 None] Creating volume 6efc994f-5a78-4ff5-9ea8-4c8a0c4666c2 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:53:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-fd58322a-cc32-421a-a826-16632da8db09 tempest-CreateVolumesFromImageTest-1104757032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:53:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-fd58322a-cc32-421a-a826-16632da8db09 tempest-CreateVolumesFromImageTest-1104757032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:53:40 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-fd58322a-cc32-421a-a826-16632da8db09 tempest-CreateVolumesFromImageTest-1104757032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:53:40 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-fd58322a-cc32-421a-a826-16632da8db09 tempest-CreateVolumesFromImageTest-1104757032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:53:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-fd58322a-cc32-421a-a826-16632da8db09 tempest-CreateVolumesFromImageTest-1104757032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:53:40 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-fd58322a-cc32-421a-a826-16632da8db09 tempest-CreateVolumesFromImageTest-1104757032 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:53:40 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-fd58322a-cc32-421a-a826-16632da8db09 tempest-CreateVolumesFromImageTest-1104757032 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:53:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-fd58322a-cc32-421a-a826-16632da8db09 tempest-CreateVolumesFromImageTest-1104757032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6efc994f-5a78-4ff5-9ea8-4c8a0c4666c2 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:53:40 devstack sudo[103908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6efc994f-5a78-4ff5-9ea8-4c8a0c4666c2 1073741824 Sep 04 22:53:40 devstack sudo[103908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:53:40 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-694c51ba-7b65-4710-b828-a02f0811c9c6 tempest-CreateVolumesFromImageTest-1104757032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:53:40 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-694c51ba-7b65-4710-b828-a02f0811c9c6 tempest-CreateVolumesFromImageTest-1104757032 None] Flow 'volume_create_manager' (1999a3c4-e195-4cbf-b2d6-0d9548e4e7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:53:40 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-694c51ba-7b65-4710-b828-a02f0811c9c6 tempest-CreateVolumesFromImageTest-1104757032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ffd9aba-db51-42d6-8627-4e97edb552e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:53:40 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-694c51ba-7b65-4710-b828-a02f0811c9c6 tempest-CreateVolumesFromImageTest-1104757032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ffd9aba-db51-42d6-8627-4e97edb552e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:53:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1158317352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9442c5e0-d911-4b0e-bcb4-8eb7fa180805,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb549e02251140d68a89bc787de9d5eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:53:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:53:40Z,use_quota=True,user_id='cb559523b3e84c0f8e41091ca41d5ffb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:53:40 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-694c51ba-7b65-4710-b828-a02f0811c9c6 tempest-CreateVolumesFromImageTest-1104757032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99639d0b-8c9c-4c2e-a4ff-706b1afb876f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:53:40 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-694c51ba-7b65-4710-b828-a02f0811c9c6 tempest-CreateVolumesFromImageTest-1104757032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99639d0b-8c9c-4c2e-a4ff-706b1afb876f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:53:40 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-694c51ba-7b65-4710-b828-a02f0811c9c6 tempest-CreateVolumesFromImageTest-1104757032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11c72576-1837-4a31-b835-5f2c8a017fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:53:40 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-694c51ba-7b65-4710-b828-a02f0811c9c6 tempest-CreateVolumesFromImageTest-1104757032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11c72576-1837-4a31-b835-5f2c8a017fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9442c5e0-d911-4b0e-bcb4-8eb7fa180805', 'volume_name': 'volume-9442c5e0-d911-4b0e-bcb4-8eb7fa180805', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:53:40 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-694c51ba-7b65-4710-b828-a02f0811c9c6 tempest-CreateVolumesFromImageTest-1104757032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba32aef2-b5e5-40fa-b661-2ee1f8d8f07d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:53:40 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-694c51ba-7b65-4710-b828-a02f0811c9c6 tempest-CreateVolumesFromImageTest-1104757032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba32aef2-b5e5-40fa-b661-2ee1f8d8f07d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:53:40 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-694c51ba-7b65-4710-b828-a02f0811c9c6 tempest-CreateVolumesFromImageTest-1104757032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d66014c-e270-4a68-81c0-66c7df1d9a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:53:40 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-694c51ba-7b65-4710-b828-a02f0811c9c6 tempest-CreateVolumesFromImageTest-1104757032 None] Volume 9442c5e0-d911-4b0e-bcb4-8eb7fa180805: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9442c5e0-d911-4b0e-bcb4-8eb7fa180805', 'volume_size': 1} Sep 04 22:53:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-694c51ba-7b65-4710-b828-a02f0811c9c6 tempest-CreateVolumesFromImageTest-1104757032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:53:40 devstack sudo[103908]: pam_unix(sudo:session): session closed for user root Sep 04 22:53:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-fd58322a-cc32-421a-a826-16632da8db09 tempest-CreateVolumesFromImageTest-1104757032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6efc994f-5a78-4ff5-9ea8-4c8a0c4666c2 1073741824" returned: 0 in 0.601s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:53:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-fd58322a-cc32-421a-a826-16632da8db09 tempest-CreateVolumesFromImageTest-1104757032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6efc994f-5a78-4ff5-9ea8-4c8a0c4666c2 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:53:40 devstack sudo[103915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6efc994f-5a78-4ff5-9ea8-4c8a0c4666c2 Sep 04 22:53:40 devstack sudo[103915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:53:40 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-60f0fe92-074b-455d-a4d4-6b6629b2cfd9 tempest-CreateVolumesFromImageTest-1104757032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:53:40 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-60f0fe92-074b-455d-a4d4-6b6629b2cfd9 tempest-CreateVolumesFromImageTest-1104757032 None] Flow 'volume_create_manager' (63f2bfe1-ff73-488d-9bba-241fc7b4280b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:53:40 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-60f0fe92-074b-455d-a4d4-6b6629b2cfd9 tempest-CreateVolumesFromImageTest-1104757032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1aab0b5-574c-4529-bc92-9456b205f2b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:53:40 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-60f0fe92-074b-455d-a4d4-6b6629b2cfd9 tempest-CreateVolumesFromImageTest-1104757032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1aab0b5-574c-4529-bc92-9456b205f2b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:53:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1521982254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e9277c8-63b2-401b-bebf-cc11f593360d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb549e02251140d68a89bc787de9d5eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:53:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:53:41Z,use_quota=True,user_id='cb559523b3e84c0f8e41091ca41d5ffb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:53:40 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-60f0fe92-074b-455d-a4d4-6b6629b2cfd9 tempest-CreateVolumesFromImageTest-1104757032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (498fd233-92b1-4d45-9656-6dfacc5cf610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:53:40 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-60f0fe92-074b-455d-a4d4-6b6629b2cfd9 tempest-CreateVolumesFromImageTest-1104757032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (498fd233-92b1-4d45-9656-6dfacc5cf610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:53:40 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-60f0fe92-074b-455d-a4d4-6b6629b2cfd9 tempest-CreateVolumesFromImageTest-1104757032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4834dd95-69e0-4cb6-a0d4-06baf2d2c466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:53:40 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-60f0fe92-074b-455d-a4d4-6b6629b2cfd9 tempest-CreateVolumesFromImageTest-1104757032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4834dd95-69e0-4cb6-a0d4-06baf2d2c466) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e9277c8-63b2-401b-bebf-cc11f593360d', 'volume_name': 'volume-2e9277c8-63b2-401b-bebf-cc11f593360d', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:53:40 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-60f0fe92-074b-455d-a4d4-6b6629b2cfd9 tempest-CreateVolumesFromImageTest-1104757032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d418adfa-44ca-4f60-8550-dc4414976cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:53:40 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-60f0fe92-074b-455d-a4d4-6b6629b2cfd9 tempest-CreateVolumesFromImageTest-1104757032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d418adfa-44ca-4f60-8550-dc4414976cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:53:40 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-60f0fe92-074b-455d-a4d4-6b6629b2cfd9 tempest-CreateVolumesFromImageTest-1104757032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc0beabd-756c-4a56-8fe1-832ac5aec5ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:53:40 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-60f0fe92-074b-455d-a4d4-6b6629b2cfd9 tempest-CreateVolumesFromImageTest-1104757032 None] Volume 2e9277c8-63b2-401b-bebf-cc11f593360d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e9277c8-63b2-401b-bebf-cc11f593360d', 'volume_size': 1} Sep 04 22:53:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-60f0fe92-074b-455d-a4d4-6b6629b2cfd9 tempest-CreateVolumesFromImageTest-1104757032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:53:41 devstack sudo[103915]: pam_unix(sudo:session): session closed for user root Sep 04 22:53:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-fd58322a-cc32-421a-a826-16632da8db09 tempest-CreateVolumesFromImageTest-1104757032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6efc994f-5a78-4ff5-9ea8-4c8a0c4666c2" returned: 0 in 0.394s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:53:41 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-fd58322a-cc32-421a-a826-16632da8db09 tempest-CreateVolumesFromImageTest-1104757032 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:53:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-fd58322a-cc32-421a-a826-16632da8db09 tempest-CreateVolumesFromImageTest-1104757032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:53:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-694c51ba-7b65-4710-b828-a02f0811c9c6 tempest-CreateVolumesFromImageTest-1104757032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.586s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:53:41 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-694c51ba-7b65-4710-b828-a02f0811c9c6 tempest-CreateVolumesFromImageTest-1104757032 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:53:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1158317352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9442c5e0-d911-4b0e-bcb4-8eb7fa180805,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb549e02251140d68a89bc787de9d5eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:53:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:53:40Z,use_quota=True,user_id='cb559523b3e84c0f8e41091ca41d5ffb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:53:41 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-694c51ba-7b65-4710-b828-a02f0811c9c6 tempest-CreateVolumesFromImageTest-1104757032 None] Creating volume 9442c5e0-d911-4b0e-bcb4-8eb7fa180805 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:53:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-694c51ba-7b65-4710-b828-a02f0811c9c6 tempest-CreateVolumesFromImageTest-1104757032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:53:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-694c51ba-7b65-4710-b828-a02f0811c9c6 tempest-CreateVolumesFromImageTest-1104757032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:53:41 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-694c51ba-7b65-4710-b828-a02f0811c9c6 tempest-CreateVolumesFromImageTest-1104757032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:53:41 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-694c51ba-7b65-4710-b828-a02f0811c9c6 tempest-CreateVolumesFromImageTest-1104757032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:53:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-694c51ba-7b65-4710-b828-a02f0811c9c6 tempest-CreateVolumesFromImageTest-1104757032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:53:41 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-694c51ba-7b65-4710-b828-a02f0811c9c6 tempest-CreateVolumesFromImageTest-1104757032 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:53:41 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-694c51ba-7b65-4710-b828-a02f0811c9c6 tempest-CreateVolumesFromImageTest-1104757032 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:53:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-694c51ba-7b65-4710-b828-a02f0811c9c6 tempest-CreateVolumesFromImageTest-1104757032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9442c5e0-d911-4b0e-bcb4-8eb7fa180805 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:53:41 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-fd58322a-cc32-421a-a826-16632da8db09 tempest-CreateVolumesFromImageTest-1104757032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2353922f-ecb1-4f6a-b9d0-b26f6549b5ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6efc994f-5a78-4ff5-9ea8-4c8a0c4666c2', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:53:41 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-fd58322a-cc32-421a-a826-16632da8db09 tempest-CreateVolumesFromImageTest-1104757032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51f15250-2c86-46fb-b7db-60cd0906d3bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:53:41 devstack sudo[103918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9442c5e0-d911-4b0e-bcb4-8eb7fa180805 1073741824 Sep 04 22:53:41 devstack sudo[103918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:53:41 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-fd58322a-cc32-421a-a826-16632da8db09 tempest-CreateVolumesFromImageTest-1104757032 None] Volume volume-6efc994f-5a78-4ff5-9ea8-4c8a0c4666c2 (6efc994f-5a78-4ff5-9ea8-4c8a0c4666c2): created successfully Sep 04 22:53:41 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-fd58322a-cc32-421a-a826-16632da8db09 tempest-CreateVolumesFromImageTest-1104757032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51f15250-2c86-46fb-b7db-60cd0906d3bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:53:41 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-fd58322a-cc32-421a-a826-16632da8db09 tempest-CreateVolumesFromImageTest-1104757032 None] Flow 'volume_create_manager' (ba033512-5864-49df-8270-c089a582520b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:53:41 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-fd58322a-cc32-421a-a826-16632da8db09 tempest-CreateVolumesFromImageTest-1104757032 None] Created volume successfully. Sep 04 22:53:41 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c1a7db3-e943-4530-966c-90a2809b69d5 tempest-CreateVolumesFromImageTest-1104757032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:53:41 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6c1a7db3-e943-4530-966c-90a2809b69d5 tempest-CreateVolumesFromImageTest-1104757032 None] Flow 'volume_create_manager' (ed274d41-f8b1-4a6a-9641-32f5156ff9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:53:41 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6c1a7db3-e943-4530-966c-90a2809b69d5 tempest-CreateVolumesFromImageTest-1104757032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4aa21b6-03c4-42f1-8d51-ef7c379708f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:53:41 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6c1a7db3-e943-4530-966c-90a2809b69d5 tempest-CreateVolumesFromImageTest-1104757032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4aa21b6-03c4-42f1-8d51-ef7c379708f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:53:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-230133117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52ef834c-a7ac-430c-89c3-c4af9ac2347e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb549e02251140d68a89bc787de9d5eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:53:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:53:41Z,use_quota=True,user_id='cb559523b3e84c0f8e41091ca41d5ffb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:53:41 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6c1a7db3-e943-4530-966c-90a2809b69d5 tempest-CreateVolumesFromImageTest-1104757032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5510df35-635b-4f46-bbaa-7f5c79910867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:53:41 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6c1a7db3-e943-4530-966c-90a2809b69d5 tempest-CreateVolumesFromImageTest-1104757032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5510df35-635b-4f46-bbaa-7f5c79910867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:53:41 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6c1a7db3-e943-4530-966c-90a2809b69d5 tempest-CreateVolumesFromImageTest-1104757032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b20a592-7b25-46e8-a4b9-b242e0084897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:53:41 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6c1a7db3-e943-4530-966c-90a2809b69d5 tempest-CreateVolumesFromImageTest-1104757032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b20a592-7b25-46e8-a4b9-b242e0084897) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52ef834c-a7ac-430c-89c3-c4af9ac2347e', 'volume_name': 'volume-52ef834c-a7ac-430c-89c3-c4af9ac2347e', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:53:41 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6c1a7db3-e943-4530-966c-90a2809b69d5 tempest-CreateVolumesFromImageTest-1104757032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fe2d151-2e8f-4b81-820b-27240c498a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:53:41 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6c1a7db3-e943-4530-966c-90a2809b69d5 tempest-CreateVolumesFromImageTest-1104757032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fe2d151-2e8f-4b81-820b-27240c498a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:53:41 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6c1a7db3-e943-4530-966c-90a2809b69d5 tempest-CreateVolumesFromImageTest-1104757032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a231116e-ed15-4953-add2-21fc17a6b129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:53:41 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-6c1a7db3-e943-4530-966c-90a2809b69d5 tempest-CreateVolumesFromImageTest-1104757032 None] Volume 52ef834c-a7ac-430c-89c3-c4af9ac2347e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52ef834c-a7ac-430c-89c3-c4af9ac2347e', 'volume_size': 1} Sep 04 22:53:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-6c1a7db3-e943-4530-966c-90a2809b69d5 tempest-CreateVolumesFromImageTest-1104757032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:53:41 devstack sudo[103918]: pam_unix(sudo:session): session closed for user root Sep 04 22:53:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-694c51ba-7b65-4710-b828-a02f0811c9c6 tempest-CreateVolumesFromImageTest-1104757032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9442c5e0-d911-4b0e-bcb4-8eb7fa180805 1073741824" returned: 0 in 0.708s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:53:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-694c51ba-7b65-4710-b828-a02f0811c9c6 tempest-CreateVolumesFromImageTest-1104757032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9442c5e0-d911-4b0e-bcb4-8eb7fa180805 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:53:41 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f0cbaaa-3d2d-4cd4-926a-0bc24debebcb tempest-CreateVolumesFromImageTest-1104757032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:53:41 devstack sudo[103924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9442c5e0-d911-4b0e-bcb4-8eb7fa180805 Sep 04 22:53:41 devstack sudo[103924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:53:41 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2f0cbaaa-3d2d-4cd4-926a-0bc24debebcb tempest-CreateVolumesFromImageTest-1104757032 None] Flow 'volume_create_manager' (00b4d122-5240-4455-b23b-2be9e31708ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:53:41 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2f0cbaaa-3d2d-4cd4-926a-0bc24debebcb tempest-CreateVolumesFromImageTest-1104757032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d19d571-aedd-4566-a17d-9d860e22bf40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:53:41 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2f0cbaaa-3d2d-4cd4-926a-0bc24debebcb tempest-CreateVolumesFromImageTest-1104757032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d19d571-aedd-4566-a17d-9d860e22bf40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:53:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1516532448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c91239e2-e3ea-418f-97ea-ce8a18a15a92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb549e02251140d68a89bc787de9d5eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:53:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:53:42Z,use_quota=True,user_id='cb559523b3e84c0f8e41091ca41d5ffb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:53:41 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2f0cbaaa-3d2d-4cd4-926a-0bc24debebcb tempest-CreateVolumesFromImageTest-1104757032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91666d69-3e8b-48d1-b392-c8cddeb7d9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:53:41 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2f0cbaaa-3d2d-4cd4-926a-0bc24debebcb tempest-CreateVolumesFromImageTest-1104757032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91666d69-3e8b-48d1-b392-c8cddeb7d9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:53:41 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2f0cbaaa-3d2d-4cd4-926a-0bc24debebcb tempest-CreateVolumesFromImageTest-1104757032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39011968-70de-436b-a00d-76bd95867ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:53:41 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2f0cbaaa-3d2d-4cd4-926a-0bc24debebcb tempest-CreateVolumesFromImageTest-1104757032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39011968-70de-436b-a00d-76bd95867ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c91239e2-e3ea-418f-97ea-ce8a18a15a92', 'volume_name': 'volume-c91239e2-e3ea-418f-97ea-ce8a18a15a92', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:53:41 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2f0cbaaa-3d2d-4cd4-926a-0bc24debebcb tempest-CreateVolumesFromImageTest-1104757032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f61ed22-9d8d-4e6e-bf56-c46fef480a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:53:41 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2f0cbaaa-3d2d-4cd4-926a-0bc24debebcb tempest-CreateVolumesFromImageTest-1104757032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f61ed22-9d8d-4e6e-bf56-c46fef480a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:53:41 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2f0cbaaa-3d2d-4cd4-926a-0bc24debebcb tempest-CreateVolumesFromImageTest-1104757032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ced2da9-5e83-4e07-a8e2-76ce50b904b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:53:41 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-2f0cbaaa-3d2d-4cd4-926a-0bc24debebcb tempest-CreateVolumesFromImageTest-1104757032 None] Volume c91239e2-e3ea-418f-97ea-ce8a18a15a92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c91239e2-e3ea-418f-97ea-ce8a18a15a92', 'volume_size': 1} Sep 04 22:53:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-2f0cbaaa-3d2d-4cd4-926a-0bc24debebcb tempest-CreateVolumesFromImageTest-1104757032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:53:42 devstack sudo[103924]: pam_unix(sudo:session): session closed for user root Sep 04 22:53:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-694c51ba-7b65-4710-b828-a02f0811c9c6 tempest-CreateVolumesFromImageTest-1104757032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9442c5e0-d911-4b0e-bcb4-8eb7fa180805" returned: 0 in 0.255s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:53:42 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-694c51ba-7b65-4710-b828-a02f0811c9c6 tempest-CreateVolumesFromImageTest-1104757032 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:53:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-694c51ba-7b65-4710-b828-a02f0811c9c6 tempest-CreateVolumesFromImageTest-1104757032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:53:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-60f0fe92-074b-455d-a4d4-6b6629b2cfd9 tempest-CreateVolumesFromImageTest-1104757032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.202s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:53:42 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-60f0fe92-074b-455d-a4d4-6b6629b2cfd9 tempest-CreateVolumesFromImageTest-1104757032 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:53:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1521982254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e9277c8-63b2-401b-bebf-cc11f593360d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb549e02251140d68a89bc787de9d5eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:53:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:53:41Z,use_quota=True,user_id='cb559523b3e84c0f8e41091ca41d5ffb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:53:42 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-60f0fe92-074b-455d-a4d4-6b6629b2cfd9 tempest-CreateVolumesFromImageTest-1104757032 None] Creating volume 2e9277c8-63b2-401b-bebf-cc11f593360d {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:53:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-60f0fe92-074b-455d-a4d4-6b6629b2cfd9 tempest-CreateVolumesFromImageTest-1104757032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:53:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-60f0fe92-074b-455d-a4d4-6b6629b2cfd9 tempest-CreateVolumesFromImageTest-1104757032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:53:42 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-60f0fe92-074b-455d-a4d4-6b6629b2cfd9 tempest-CreateVolumesFromImageTest-1104757032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:53:42 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-60f0fe92-074b-455d-a4d4-6b6629b2cfd9 tempest-CreateVolumesFromImageTest-1104757032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:53:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-60f0fe92-074b-455d-a4d4-6b6629b2cfd9 tempest-CreateVolumesFromImageTest-1104757032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:53:42 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-60f0fe92-074b-455d-a4d4-6b6629b2cfd9 tempest-CreateVolumesFromImageTest-1104757032 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:53:42 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-60f0fe92-074b-455d-a4d4-6b6629b2cfd9 tempest-CreateVolumesFromImageTest-1104757032 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:53:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-60f0fe92-074b-455d-a4d4-6b6629b2cfd9 tempest-CreateVolumesFromImageTest-1104757032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-2e9277c8-63b2-401b-bebf-cc11f593360d 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:53:42 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-694c51ba-7b65-4710-b828-a02f0811c9c6 tempest-CreateVolumesFromImageTest-1104757032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d66014c-e270-4a68-81c0-66c7df1d9a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9442c5e0-d911-4b0e-bcb4-8eb7fa180805', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:53:42 devstack sudo[103927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-2e9277c8-63b2-401b-bebf-cc11f593360d 1073741824 Sep 04 22:53:42 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-694c51ba-7b65-4710-b828-a02f0811c9c6 tempest-CreateVolumesFromImageTest-1104757032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4027aa6-ca22-461e-9e25-ec5a46da757c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:53:42 devstack sudo[103927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:53:42 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-694c51ba-7b65-4710-b828-a02f0811c9c6 tempest-CreateVolumesFromImageTest-1104757032 None] Volume volume-9442c5e0-d911-4b0e-bcb4-8eb7fa180805 (9442c5e0-d911-4b0e-bcb4-8eb7fa180805): created successfully Sep 04 22:53:42 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-694c51ba-7b65-4710-b828-a02f0811c9c6 tempest-CreateVolumesFromImageTest-1104757032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4027aa6-ca22-461e-9e25-ec5a46da757c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:53:42 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-694c51ba-7b65-4710-b828-a02f0811c9c6 tempest-CreateVolumesFromImageTest-1104757032 None] Flow 'volume_create_manager' (1999a3c4-e195-4cbf-b2d6-0d9548e4e7d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:53:42 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-694c51ba-7b65-4710-b828-a02f0811c9c6 tempest-CreateVolumesFromImageTest-1104757032 None] Created volume successfully. Sep 04 22:53:42 devstack sudo[103927]: pam_unix(sudo:session): session closed for user root Sep 04 22:53:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-60f0fe92-074b-455d-a4d4-6b6629b2cfd9 tempest-CreateVolumesFromImageTest-1104757032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-2e9277c8-63b2-401b-bebf-cc11f593360d 1073741824" returned: 0 in 0.497s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:53:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-60f0fe92-074b-455d-a4d4-6b6629b2cfd9 tempest-CreateVolumesFromImageTest-1104757032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-2e9277c8-63b2-401b-bebf-cc11f593360d {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:53:42 devstack sudo[103933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-2e9277c8-63b2-401b-bebf-cc11f593360d Sep 04 22:53:42 devstack sudo[103933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:53:42 devstack sudo[103933]: pam_unix(sudo:session): session closed for user root Sep 04 22:53:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-60f0fe92-074b-455d-a4d4-6b6629b2cfd9 tempest-CreateVolumesFromImageTest-1104757032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-2e9277c8-63b2-401b-bebf-cc11f593360d" returned: 0 in 0.269s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:53:42 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-60f0fe92-074b-455d-a4d4-6b6629b2cfd9 tempest-CreateVolumesFromImageTest-1104757032 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:53:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-60f0fe92-074b-455d-a4d4-6b6629b2cfd9 tempest-CreateVolumesFromImageTest-1104757032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:53:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-6c1a7db3-e943-4530-966c-90a2809b69d5 tempest-CreateVolumesFromImageTest-1104757032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.394s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:53:42 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-6c1a7db3-e943-4530-966c-90a2809b69d5 tempest-CreateVolumesFromImageTest-1104757032 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:53:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-230133117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52ef834c-a7ac-430c-89c3-c4af9ac2347e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb549e02251140d68a89bc787de9d5eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:53:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:53:41Z,use_quota=True,user_id='cb559523b3e84c0f8e41091ca41d5ffb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:53:42 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-6c1a7db3-e943-4530-966c-90a2809b69d5 tempest-CreateVolumesFromImageTest-1104757032 None] Creating volume 52ef834c-a7ac-430c-89c3-c4af9ac2347e {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:53:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-6c1a7db3-e943-4530-966c-90a2809b69d5 tempest-CreateVolumesFromImageTest-1104757032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:53:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-6c1a7db3-e943-4530-966c-90a2809b69d5 tempest-CreateVolumesFromImageTest-1104757032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:53:42 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-6c1a7db3-e943-4530-966c-90a2809b69d5 tempest-CreateVolumesFromImageTest-1104757032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:53:42 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-6c1a7db3-e943-4530-966c-90a2809b69d5 tempest-CreateVolumesFromImageTest-1104757032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:53:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-6c1a7db3-e943-4530-966c-90a2809b69d5 tempest-CreateVolumesFromImageTest-1104757032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:53:42 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-6c1a7db3-e943-4530-966c-90a2809b69d5 tempest-CreateVolumesFromImageTest-1104757032 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:53:42 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-6c1a7db3-e943-4530-966c-90a2809b69d5 tempest-CreateVolumesFromImageTest-1104757032 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:53:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-6c1a7db3-e943-4530-966c-90a2809b69d5 tempest-CreateVolumesFromImageTest-1104757032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-52ef834c-a7ac-430c-89c3-c4af9ac2347e 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:53:42 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-60f0fe92-074b-455d-a4d4-6b6629b2cfd9 tempest-CreateVolumesFromImageTest-1104757032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc0beabd-756c-4a56-8fe1-832ac5aec5ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e9277c8-63b2-401b-bebf-cc11f593360d', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:53:42 devstack sudo[103936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-52ef834c-a7ac-430c-89c3-c4af9ac2347e 1073741824 Sep 04 22:53:42 devstack sudo[103936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:53:42 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-60f0fe92-074b-455d-a4d4-6b6629b2cfd9 tempest-CreateVolumesFromImageTest-1104757032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e89051dd-ad0f-49d1-aaa0-7b61d4f0b8f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:53:42 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-60f0fe92-074b-455d-a4d4-6b6629b2cfd9 tempest-CreateVolumesFromImageTest-1104757032 None] Volume volume-2e9277c8-63b2-401b-bebf-cc11f593360d (2e9277c8-63b2-401b-bebf-cc11f593360d): created successfully Sep 04 22:53:42 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-60f0fe92-074b-455d-a4d4-6b6629b2cfd9 tempest-CreateVolumesFromImageTest-1104757032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e89051dd-ad0f-49d1-aaa0-7b61d4f0b8f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:53:42 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-60f0fe92-074b-455d-a4d4-6b6629b2cfd9 tempest-CreateVolumesFromImageTest-1104757032 None] Flow 'volume_create_manager' (63f2bfe1-ff73-488d-9bba-241fc7b4280b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:53:43 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-60f0fe92-074b-455d-a4d4-6b6629b2cfd9 tempest-CreateVolumesFromImageTest-1104757032 None] Created volume successfully. Sep 04 22:53:43 devstack sudo[103936]: pam_unix(sudo:session): session closed for user root Sep 04 22:53:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-6c1a7db3-e943-4530-966c-90a2809b69d5 tempest-CreateVolumesFromImageTest-1104757032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-52ef834c-a7ac-430c-89c3-c4af9ac2347e 1073741824" returned: 0 in 0.489s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:53:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-6c1a7db3-e943-4530-966c-90a2809b69d5 tempest-CreateVolumesFromImageTest-1104757032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-52ef834c-a7ac-430c-89c3-c4af9ac2347e {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:53:43 devstack sudo[103944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-52ef834c-a7ac-430c-89c3-c4af9ac2347e Sep 04 22:53:43 devstack sudo[103944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:53:43 devstack sudo[103944]: pam_unix(sudo:session): session closed for user root Sep 04 22:53:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-6c1a7db3-e943-4530-966c-90a2809b69d5 tempest-CreateVolumesFromImageTest-1104757032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-52ef834c-a7ac-430c-89c3-c4af9ac2347e" returned: 0 in 0.269s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:53:43 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-6c1a7db3-e943-4530-966c-90a2809b69d5 tempest-CreateVolumesFromImageTest-1104757032 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:53:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-6c1a7db3-e943-4530-966c-90a2809b69d5 tempest-CreateVolumesFromImageTest-1104757032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:53:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-2f0cbaaa-3d2d-4cd4-926a-0bc24debebcb tempest-CreateVolumesFromImageTest-1104757032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.778s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:53:43 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-2f0cbaaa-3d2d-4cd4-926a-0bc24debebcb tempest-CreateVolumesFromImageTest-1104757032 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:53:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1516532448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c91239e2-e3ea-418f-97ea-ce8a18a15a92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb549e02251140d68a89bc787de9d5eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:53:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:53:42Z,use_quota=True,user_id='cb559523b3e84c0f8e41091ca41d5ffb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:53:43 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-2f0cbaaa-3d2d-4cd4-926a-0bc24debebcb tempest-CreateVolumesFromImageTest-1104757032 None] Creating volume c91239e2-e3ea-418f-97ea-ce8a18a15a92 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:53:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-2f0cbaaa-3d2d-4cd4-926a-0bc24debebcb tempest-CreateVolumesFromImageTest-1104757032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:53:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-2f0cbaaa-3d2d-4cd4-926a-0bc24debebcb tempest-CreateVolumesFromImageTest-1104757032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:53:43 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-2f0cbaaa-3d2d-4cd4-926a-0bc24debebcb tempest-CreateVolumesFromImageTest-1104757032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:53:43 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-2f0cbaaa-3d2d-4cd4-926a-0bc24debebcb tempest-CreateVolumesFromImageTest-1104757032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:53:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-2f0cbaaa-3d2d-4cd4-926a-0bc24debebcb tempest-CreateVolumesFromImageTest-1104757032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:53:43 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-2f0cbaaa-3d2d-4cd4-926a-0bc24debebcb tempest-CreateVolumesFromImageTest-1104757032 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:53:43 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-2f0cbaaa-3d2d-4cd4-926a-0bc24debebcb tempest-CreateVolumesFromImageTest-1104757032 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:53:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2f0cbaaa-3d2d-4cd4-926a-0bc24debebcb tempest-CreateVolumesFromImageTest-1104757032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c91239e2-e3ea-418f-97ea-ce8a18a15a92 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:53:43 devstack sudo[103947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c91239e2-e3ea-418f-97ea-ce8a18a15a92 1073741824 Sep 04 22:53:43 devstack sudo[103947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:53:43 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6c1a7db3-e943-4530-966c-90a2809b69d5 tempest-CreateVolumesFromImageTest-1104757032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a231116e-ed15-4953-add2-21fc17a6b129) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52ef834c-a7ac-430c-89c3-c4af9ac2347e', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:53:43 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6c1a7db3-e943-4530-966c-90a2809b69d5 tempest-CreateVolumesFromImageTest-1104757032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (178f1e55-d072-41a8-9dc9-a9dc542effa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:53:43 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-6c1a7db3-e943-4530-966c-90a2809b69d5 tempest-CreateVolumesFromImageTest-1104757032 None] Volume volume-52ef834c-a7ac-430c-89c3-c4af9ac2347e (52ef834c-a7ac-430c-89c3-c4af9ac2347e): created successfully Sep 04 22:53:43 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6c1a7db3-e943-4530-966c-90a2809b69d5 tempest-CreateVolumesFromImageTest-1104757032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (178f1e55-d072-41a8-9dc9-a9dc542effa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:53:43 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6c1a7db3-e943-4530-966c-90a2809b69d5 tempest-CreateVolumesFromImageTest-1104757032 None] Flow 'volume_create_manager' (ed274d41-f8b1-4a6a-9641-32f5156ff9aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:53:43 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-6c1a7db3-e943-4530-966c-90a2809b69d5 tempest-CreateVolumesFromImageTest-1104757032 None] Created volume successfully. Sep 04 22:53:44 devstack sudo[103947]: pam_unix(sudo:session): session closed for user root Sep 04 22:53:44 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2f0cbaaa-3d2d-4cd4-926a-0bc24debebcb tempest-CreateVolumesFromImageTest-1104757032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c91239e2-e3ea-418f-97ea-ce8a18a15a92 1073741824" returned: 0 in 0.515s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:53:44 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2f0cbaaa-3d2d-4cd4-926a-0bc24debebcb tempest-CreateVolumesFromImageTest-1104757032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c91239e2-e3ea-418f-97ea-ce8a18a15a92 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:53:44 devstack sudo[103953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c91239e2-e3ea-418f-97ea-ce8a18a15a92 Sep 04 22:53:44 devstack sudo[103953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:53:44 devstack sudo[103953]: pam_unix(sudo:session): session closed for user root Sep 04 22:53:44 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2f0cbaaa-3d2d-4cd4-926a-0bc24debebcb tempest-CreateVolumesFromImageTest-1104757032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c91239e2-e3ea-418f-97ea-ce8a18a15a92" returned: 0 in 0.268s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:53:44 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-2f0cbaaa-3d2d-4cd4-926a-0bc24debebcb tempest-CreateVolumesFromImageTest-1104757032 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:53:44 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-2f0cbaaa-3d2d-4cd4-926a-0bc24debebcb tempest-CreateVolumesFromImageTest-1104757032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:53:44 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2f0cbaaa-3d2d-4cd4-926a-0bc24debebcb tempest-CreateVolumesFromImageTest-1104757032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ced2da9-5e83-4e07-a8e2-76ce50b904b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c91239e2-e3ea-418f-97ea-ce8a18a15a92', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:53:44 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2f0cbaaa-3d2d-4cd4-926a-0bc24debebcb tempest-CreateVolumesFromImageTest-1104757032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c586090d-d552-4614-8257-5d9956d4605f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:53:44 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-2f0cbaaa-3d2d-4cd4-926a-0bc24debebcb tempest-CreateVolumesFromImageTest-1104757032 None] Volume volume-c91239e2-e3ea-418f-97ea-ce8a18a15a92 (c91239e2-e3ea-418f-97ea-ce8a18a15a92): created successfully Sep 04 22:53:44 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2f0cbaaa-3d2d-4cd4-926a-0bc24debebcb tempest-CreateVolumesFromImageTest-1104757032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c586090d-d552-4614-8257-5d9956d4605f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:53:44 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2f0cbaaa-3d2d-4cd4-926a-0bc24debebcb tempest-CreateVolumesFromImageTest-1104757032 None] Flow 'volume_create_manager' (00b4d122-5240-4455-b23b-2be9e31708ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:53:44 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-2f0cbaaa-3d2d-4cd4-926a-0bc24debebcb tempest-CreateVolumesFromImageTest-1104757032 None] Created volume successfully. Sep 04 22:53:45 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-db7114a1-6084-46fd-86fe-b530a8ae54f3 tempest-CreateVolumesFromImageTest-1104757032 None] Acquiring lock "cinder-c91239e2-e3ea-418f-97ea-ce8a18a15a92-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:53:45 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-db7114a1-6084-46fd-86fe-b530a8ae54f3 tempest-CreateVolumesFromImageTest-1104757032 None] Lock "cinder-c91239e2-e3ea-418f-97ea-ce8a18a15a92-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:53:45 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-db7114a1-6084-46fd-86fe-b530a8ae54f3 tempest-CreateVolumesFromImageTest-1104757032 None] Acquiring lock "cinder-quobyte-c91239e2-e3ea-418f-97ea-ce8a18a15a92" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:53:45 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-db7114a1-6084-46fd-86fe-b530a8ae54f3 tempest-CreateVolumesFromImageTest-1104757032 None] Lock "cinder-quobyte-c91239e2-e3ea-418f-97ea-ce8a18a15a92" acquired by "delete_volume" :: waited 0.016s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:53:45 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[e841fae1-7c20-48c2-adf5-b0c5d371c042]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:53:45 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-db7114a1-6084-46fd-86fe-b530a8ae54f3 tempest-CreateVolumesFromImageTest-1104757032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c91239e2-e3ea-418f-97ea-ce8a18a15a92 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:53:45 devstack sudo[103956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c91239e2-e3ea-418f-97ea-ce8a18a15a92 Sep 04 22:53:45 devstack sudo[103956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:53:45 devstack sudo[103956]: pam_unix(sudo:session): session closed for user root Sep 04 22:53:45 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-db7114a1-6084-46fd-86fe-b530a8ae54f3 tempest-CreateVolumesFromImageTest-1104757032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c91239e2-e3ea-418f-97ea-ce8a18a15a92" returned: 0 in 0.483s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:53:45 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-db7114a1-6084-46fd-86fe-b530a8ae54f3 tempest-CreateVolumesFromImageTest-1104757032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c91239e2-e3ea-418f-97ea-ce8a18a15a92 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:53:45 devstack sudo[103962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c91239e2-e3ea-418f-97ea-ce8a18a15a92 Sep 04 22:53:45 devstack sudo[103962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:53:46 devstack sudo[103962]: pam_unix(sudo:session): session closed for user root Sep 04 22:53:46 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-db7114a1-6084-46fd-86fe-b530a8ae54f3 tempest-CreateVolumesFromImageTest-1104757032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c91239e2-e3ea-418f-97ea-ce8a18a15a92" returned: 0 in 0.254s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:53:46 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-db7114a1-6084-46fd-86fe-b530a8ae54f3 tempest-CreateVolumesFromImageTest-1104757032 None] Lock "cinder-quobyte-c91239e2-e3ea-418f-97ea-ce8a18a15a92" released by "delete_volume" :: held 0.779s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:53:46 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-db7114a1-6084-46fd-86fe-b530a8ae54f3 tempest-CreateVolumesFromImageTest-1104757032 None] Created reservations ['1c729aa1-ffab-4cf7-808f-2cfb7647837e', 'cdaaca84-1a2a-425a-9651-381d13090d4c', 'cb6e071b-60df-42ca-8976-e9d0a201bde1', 'cdf4e05d-75b4-4db3-ba7d-2e4f0106d1cd'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:53:46 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-db7114a1-6084-46fd-86fe-b530a8ae54f3 tempest-CreateVolumesFromImageTest-1104757032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:53:46 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-db7114a1-6084-46fd-86fe-b530a8ae54f3 tempest-CreateVolumesFromImageTest-1104757032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:53:46 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-db7114a1-6084-46fd-86fe-b530a8ae54f3 tempest-CreateVolumesFromImageTest-1104757032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:53:46 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-db7114a1-6084-46fd-86fe-b530a8ae54f3 tempest-CreateVolumesFromImageTest-1104757032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:53:46 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-db7114a1-6084-46fd-86fe-b530a8ae54f3 tempest-CreateVolumesFromImageTest-1104757032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:53:46 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-db7114a1-6084-46fd-86fe-b530a8ae54f3 tempest-CreateVolumesFromImageTest-1104757032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:53:46 devstack sudo[103967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:53:46 devstack sudo[103967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:53:46 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-b7585587-c43c-4419-aee4-9772ed37d6df tempest-CreateVolumesFromImageTest-1104757032 None] Acquiring lock "cinder-52ef834c-a7ac-430c-89c3-c4af9ac2347e-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:53:46 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-b7585587-c43c-4419-aee4-9772ed37d6df tempest-CreateVolumesFromImageTest-1104757032 None] Lock "cinder-52ef834c-a7ac-430c-89c3-c4af9ac2347e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:53:46 devstack sudo[103967]: pam_unix(sudo:session): session closed for user root Sep 04 22:53:46 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-db7114a1-6084-46fd-86fe-b530a8ae54f3 tempest-CreateVolumesFromImageTest-1104757032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.269s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:53:46 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-db7114a1-6084-46fd-86fe-b530a8ae54f3 tempest-CreateVolumesFromImageTest-1104757032 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:53:46 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-b7585587-c43c-4419-aee4-9772ed37d6df tempest-CreateVolumesFromImageTest-1104757032 None] Acquiring lock "cinder-quobyte-52ef834c-a7ac-430c-89c3-c4af9ac2347e" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:53:46 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-db7114a1-6084-46fd-86fe-b530a8ae54f3 tempest-CreateVolumesFromImageTest-1104757032 None] Deleted volume successfully. Sep 04 22:53:46 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-b7585587-c43c-4419-aee4-9772ed37d6df tempest-CreateVolumesFromImageTest-1104757032 None] Lock "cinder-quobyte-52ef834c-a7ac-430c-89c3-c4af9ac2347e" acquired by "delete_volume" :: waited 0.025s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:53:46 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-db7114a1-6084-46fd-86fe-b530a8ae54f3 tempest-CreateVolumesFromImageTest-1104757032 None] Lock "cinder-c91239e2-e3ea-418f-97ea-ce8a18a15a92-delete_volume" released by "delete_volume" :: held 1.289s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:53:46 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd45610-dbc3-4d32-829d-84f054a024a9]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:53:46 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b7585587-c43c-4419-aee4-9772ed37d6df tempest-CreateVolumesFromImageTest-1104757032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-52ef834c-a7ac-430c-89c3-c4af9ac2347e {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:53:46 devstack sudo[103970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-52ef834c-a7ac-430c-89c3-c4af9ac2347e Sep 04 22:53:46 devstack sudo[103970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:53:46 devstack sudo[103970]: pam_unix(sudo:session): session closed for user root Sep 04 22:53:46 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b7585587-c43c-4419-aee4-9772ed37d6df tempest-CreateVolumesFromImageTest-1104757032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-52ef834c-a7ac-430c-89c3-c4af9ac2347e" returned: 0 in 0.382s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:53:46 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b7585587-c43c-4419-aee4-9772ed37d6df tempest-CreateVolumesFromImageTest-1104757032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-52ef834c-a7ac-430c-89c3-c4af9ac2347e {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:53:47 devstack sudo[103975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-52ef834c-a7ac-430c-89c3-c4af9ac2347e Sep 04 22:53:47 devstack sudo[103975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:53:47 devstack sudo[103975]: pam_unix(sudo:session): session closed for user root Sep 04 22:53:47 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b7585587-c43c-4419-aee4-9772ed37d6df tempest-CreateVolumesFromImageTest-1104757032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-52ef834c-a7ac-430c-89c3-c4af9ac2347e" returned: 0 in 0.268s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:53:47 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-b7585587-c43c-4419-aee4-9772ed37d6df tempest-CreateVolumesFromImageTest-1104757032 None] Lock "cinder-quobyte-52ef834c-a7ac-430c-89c3-c4af9ac2347e" released by "delete_volume" :: held 0.700s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:53:47 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-b7585587-c43c-4419-aee4-9772ed37d6df tempest-CreateVolumesFromImageTest-1104757032 None] Created reservations ['81439b59-7e92-4dad-95be-843be93ec35c', '3ceb72e0-9bf8-444b-aabb-4706bcbccb2b', '222487c7-4489-4146-b0dd-7072f0191b11', '08f61605-e511-40eb-ba54-62cf1a03aded'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:53:47 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-b7585587-c43c-4419-aee4-9772ed37d6df tempest-CreateVolumesFromImageTest-1104757032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:53:47 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-b7585587-c43c-4419-aee4-9772ed37d6df tempest-CreateVolumesFromImageTest-1104757032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:53:47 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-b7585587-c43c-4419-aee4-9772ed37d6df tempest-CreateVolumesFromImageTest-1104757032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:53:47 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-b7585587-c43c-4419-aee4-9772ed37d6df tempest-CreateVolumesFromImageTest-1104757032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:53:47 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-b7585587-c43c-4419-aee4-9772ed37d6df tempest-CreateVolumesFromImageTest-1104757032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:53:47 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b7585587-c43c-4419-aee4-9772ed37d6df tempest-CreateVolumesFromImageTest-1104757032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:53:47 devstack sudo[103978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:53:47 devstack sudo[103978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:53:47 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-b15758d6-40e3-4271-a5b5-63d62b9f59bb tempest-CreateVolumesFromImageTest-1104757032 None] Acquiring lock "cinder-2e9277c8-63b2-401b-bebf-cc11f593360d-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:53:47 devstack sudo[103978]: pam_unix(sudo:session): session closed for user root Sep 04 22:53:47 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b7585587-c43c-4419-aee4-9772ed37d6df tempest-CreateVolumesFromImageTest-1104757032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.284s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:53:47 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-b7585587-c43c-4419-aee4-9772ed37d6df tempest-CreateVolumesFromImageTest-1104757032 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:53:47 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-b7585587-c43c-4419-aee4-9772ed37d6df tempest-CreateVolumesFromImageTest-1104757032 None] Deleted volume successfully. Sep 04 22:53:47 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-b15758d6-40e3-4271-a5b5-63d62b9f59bb tempest-CreateVolumesFromImageTest-1104757032 None] Lock "cinder-2e9277c8-63b2-401b-bebf-cc11f593360d-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:53:47 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-b7585587-c43c-4419-aee4-9772ed37d6df tempest-CreateVolumesFromImageTest-1104757032 None] Lock "cinder-52ef834c-a7ac-430c-89c3-c4af9ac2347e-delete_volume" released by "delete_volume" :: held 1.272s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:53:47 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-b15758d6-40e3-4271-a5b5-63d62b9f59bb tempest-CreateVolumesFromImageTest-1104757032 None] Acquiring lock "cinder-quobyte-2e9277c8-63b2-401b-bebf-cc11f593360d" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:53:47 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-b15758d6-40e3-4271-a5b5-63d62b9f59bb tempest-CreateVolumesFromImageTest-1104757032 None] Lock "cinder-quobyte-2e9277c8-63b2-401b-bebf-cc11f593360d" acquired by "delete_volume" :: waited 0.022s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:53:47 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd1e2e1-cbc6-4f44-b2d1-976cb6ef9dc3]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:53:47 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b15758d6-40e3-4271-a5b5-63d62b9f59bb tempest-CreateVolumesFromImageTest-1104757032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-2e9277c8-63b2-401b-bebf-cc11f593360d {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:53:47 devstack sudo[103987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-2e9277c8-63b2-401b-bebf-cc11f593360d Sep 04 22:53:47 devstack sudo[103987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:53:48 devstack sudo[103987]: pam_unix(sudo:session): session closed for user root Sep 04 22:53:48 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b15758d6-40e3-4271-a5b5-63d62b9f59bb tempest-CreateVolumesFromImageTest-1104757032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-2e9277c8-63b2-401b-bebf-cc11f593360d" returned: 0 in 0.402s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:53:48 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b15758d6-40e3-4271-a5b5-63d62b9f59bb tempest-CreateVolumesFromImageTest-1104757032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-2e9277c8-63b2-401b-bebf-cc11f593360d {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:53:48 devstack sudo[103992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-2e9277c8-63b2-401b-bebf-cc11f593360d Sep 04 22:53:48 devstack sudo[103992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:53:48 devstack sudo[103992]: pam_unix(sudo:session): session closed for user root Sep 04 22:53:48 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b15758d6-40e3-4271-a5b5-63d62b9f59bb tempest-CreateVolumesFromImageTest-1104757032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-2e9277c8-63b2-401b-bebf-cc11f593360d" returned: 0 in 0.242s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:53:48 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-b15758d6-40e3-4271-a5b5-63d62b9f59bb tempest-CreateVolumesFromImageTest-1104757032 None] Lock "cinder-quobyte-2e9277c8-63b2-401b-bebf-cc11f593360d" released by "delete_volume" :: held 0.689s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:53:48 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-b15758d6-40e3-4271-a5b5-63d62b9f59bb tempest-CreateVolumesFromImageTest-1104757032 None] Created reservations ['2607abd3-6e6e-403d-be12-1d0a62463d1b', 'c7f7f52f-0031-4b6f-a192-072a480341fd', '54106c2e-ace0-44f6-bc1c-1c30cab404f4', '10bf0044-a565-41ce-bdf2-413f195a40a7'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:53:48 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-b15758d6-40e3-4271-a5b5-63d62b9f59bb tempest-CreateVolumesFromImageTest-1104757032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:53:48 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-b15758d6-40e3-4271-a5b5-63d62b9f59bb tempest-CreateVolumesFromImageTest-1104757032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:53:48 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-b15758d6-40e3-4271-a5b5-63d62b9f59bb tempest-CreateVolumesFromImageTest-1104757032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:53:48 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-b15758d6-40e3-4271-a5b5-63d62b9f59bb tempest-CreateVolumesFromImageTest-1104757032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:53:48 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-b15758d6-40e3-4271-a5b5-63d62b9f59bb tempest-CreateVolumesFromImageTest-1104757032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:53:48 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b15758d6-40e3-4271-a5b5-63d62b9f59bb tempest-CreateVolumesFromImageTest-1104757032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:53:48 devstack sudo[103995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:53:48 devstack sudo[103995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:53:48 devstack sudo[103995]: pam_unix(sudo:session): session closed for user root Sep 04 22:53:48 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b15758d6-40e3-4271-a5b5-63d62b9f59bb tempest-CreateVolumesFromImageTest-1104757032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.271s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:53:48 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-b15758d6-40e3-4271-a5b5-63d62b9f59bb tempest-CreateVolumesFromImageTest-1104757032 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:53:48 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-b15758d6-40e3-4271-a5b5-63d62b9f59bb tempest-CreateVolumesFromImageTest-1104757032 None] Deleted volume successfully. Sep 04 22:53:48 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-b15758d6-40e3-4271-a5b5-63d62b9f59bb tempest-CreateVolumesFromImageTest-1104757032 None] Lock "cinder-2e9277c8-63b2-401b-bebf-cc11f593360d-delete_volume" released by "delete_volume" :: held 1.190s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:53:48 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-6fa5829b-3a7d-4ed4-8c13-86e3bbc0a069 tempest-CreateVolumesFromImageTest-1104757032 None] Acquiring lock "cinder-9442c5e0-d911-4b0e-bcb4-8eb7fa180805-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:53:48 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-6fa5829b-3a7d-4ed4-8c13-86e3bbc0a069 tempest-CreateVolumesFromImageTest-1104757032 None] Lock "cinder-9442c5e0-d911-4b0e-bcb4-8eb7fa180805-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:53:49 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-6fa5829b-3a7d-4ed4-8c13-86e3bbc0a069 tempest-CreateVolumesFromImageTest-1104757032 None] Acquiring lock "cinder-quobyte-9442c5e0-d911-4b0e-bcb4-8eb7fa180805" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:53:49 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-6fa5829b-3a7d-4ed4-8c13-86e3bbc0a069 tempest-CreateVolumesFromImageTest-1104757032 None] Lock "cinder-quobyte-9442c5e0-d911-4b0e-bcb4-8eb7fa180805" acquired by "delete_volume" :: waited 0.019s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:53:49 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd65f3de-d867-4f54-a477-57ad5b1f4ad7]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:53:49 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-6fa5829b-3a7d-4ed4-8c13-86e3bbc0a069 tempest-CreateVolumesFromImageTest-1104757032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9442c5e0-d911-4b0e-bcb4-8eb7fa180805 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:53:49 devstack sudo[103998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9442c5e0-d911-4b0e-bcb4-8eb7fa180805 Sep 04 22:53:49 devstack sudo[103998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:53:49 devstack sudo[103998]: pam_unix(sudo:session): session closed for user root Sep 04 22:53:49 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-6fa5829b-3a7d-4ed4-8c13-86e3bbc0a069 tempest-CreateVolumesFromImageTest-1104757032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9442c5e0-d911-4b0e-bcb4-8eb7fa180805" returned: 0 in 0.378s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:53:49 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-6fa5829b-3a7d-4ed4-8c13-86e3bbc0a069 tempest-CreateVolumesFromImageTest-1104757032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9442c5e0-d911-4b0e-bcb4-8eb7fa180805 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:53:49 devstack sudo[104003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9442c5e0-d911-4b0e-bcb4-8eb7fa180805 Sep 04 22:53:49 devstack sudo[104003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:53:49 devstack sudo[104003]: pam_unix(sudo:session): session closed for user root Sep 04 22:53:49 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-6fa5829b-3a7d-4ed4-8c13-86e3bbc0a069 tempest-CreateVolumesFromImageTest-1104757032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9442c5e0-d911-4b0e-bcb4-8eb7fa180805" returned: 0 in 0.265s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:53:49 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-6fa5829b-3a7d-4ed4-8c13-86e3bbc0a069 tempest-CreateVolumesFromImageTest-1104757032 None] Lock "cinder-quobyte-9442c5e0-d911-4b0e-bcb4-8eb7fa180805" released by "delete_volume" :: held 0.691s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:53:49 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-6fa5829b-3a7d-4ed4-8c13-86e3bbc0a069 tempest-CreateVolumesFromImageTest-1104757032 None] Created reservations ['a2439fe9-c7cc-459b-b2e0-dfe71824ab1f', 'c69316eb-67f3-4fe2-9832-4a271b166162', '6b0e53f5-8537-4a08-b574-77ac1a8f07cf', 'f834c16c-4ff4-4e81-8c71-5e7bfe041c07'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:53:49 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-6fa5829b-3a7d-4ed4-8c13-86e3bbc0a069 tempest-CreateVolumesFromImageTest-1104757032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:53:49 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-6fa5829b-3a7d-4ed4-8c13-86e3bbc0a069 tempest-CreateVolumesFromImageTest-1104757032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:53:49 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-6fa5829b-3a7d-4ed4-8c13-86e3bbc0a069 tempest-CreateVolumesFromImageTest-1104757032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:53:49 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-6fa5829b-3a7d-4ed4-8c13-86e3bbc0a069 tempest-CreateVolumesFromImageTest-1104757032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:53:49 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-6fa5829b-3a7d-4ed4-8c13-86e3bbc0a069 tempest-CreateVolumesFromImageTest-1104757032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:53:49 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-6fa5829b-3a7d-4ed4-8c13-86e3bbc0a069 tempest-CreateVolumesFromImageTest-1104757032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:53:49 devstack sudo[104006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:53:49 devstack sudo[104006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:53:50 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-4c3e9ab4-6ac9-4dec-b8e7-2219b4ecd821 tempest-CreateVolumesFromImageTest-1104757032 None] Acquiring lock "cinder-6efc994f-5a78-4ff5-9ea8-4c8a0c4666c2-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:53:50 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-4c3e9ab4-6ac9-4dec-b8e7-2219b4ecd821 tempest-CreateVolumesFromImageTest-1104757032 None] Lock "cinder-6efc994f-5a78-4ff5-9ea8-4c8a0c4666c2-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:53:50 devstack sudo[104006]: pam_unix(sudo:session): session closed for user root Sep 04 22:53:50 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-6fa5829b-3a7d-4ed4-8c13-86e3bbc0a069 tempest-CreateVolumesFromImageTest-1104757032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.340s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:53:50 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-6fa5829b-3a7d-4ed4-8c13-86e3bbc0a069 tempest-CreateVolumesFromImageTest-1104757032 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:53:50 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-6fa5829b-3a7d-4ed4-8c13-86e3bbc0a069 tempest-CreateVolumesFromImageTest-1104757032 None] Deleted volume successfully. Sep 04 22:53:50 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-6fa5829b-3a7d-4ed4-8c13-86e3bbc0a069 tempest-CreateVolumesFromImageTest-1104757032 None] Lock "cinder-9442c5e0-d911-4b0e-bcb4-8eb7fa180805-delete_volume" released by "delete_volume" :: held 1.296s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:53:50 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-4c3e9ab4-6ac9-4dec-b8e7-2219b4ecd821 tempest-CreateVolumesFromImageTest-1104757032 None] Acquiring lock "cinder-quobyte-6efc994f-5a78-4ff5-9ea8-4c8a0c4666c2" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:53:50 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-4c3e9ab4-6ac9-4dec-b8e7-2219b4ecd821 tempest-CreateVolumesFromImageTest-1104757032 None] Lock "cinder-quobyte-6efc994f-5a78-4ff5-9ea8-4c8a0c4666c2" acquired by "delete_volume" :: waited 0.018s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:53:50 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85d6296-f73d-4e91-b3bc-9fee8437837c]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:53:50 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4c3e9ab4-6ac9-4dec-b8e7-2219b4ecd821 tempest-CreateVolumesFromImageTest-1104757032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6efc994f-5a78-4ff5-9ea8-4c8a0c4666c2 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:53:50 devstack sudo[104009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6efc994f-5a78-4ff5-9ea8-4c8a0c4666c2 Sep 04 22:53:50 devstack sudo[104009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:53:50 devstack sudo[104009]: pam_unix(sudo:session): session closed for user root Sep 04 22:53:50 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4c3e9ab4-6ac9-4dec-b8e7-2219b4ecd821 tempest-CreateVolumesFromImageTest-1104757032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6efc994f-5a78-4ff5-9ea8-4c8a0c4666c2" returned: 0 in 0.436s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:53:50 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4c3e9ab4-6ac9-4dec-b8e7-2219b4ecd821 tempest-CreateVolumesFromImageTest-1104757032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6efc994f-5a78-4ff5-9ea8-4c8a0c4666c2 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:53:50 devstack sudo[104015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6efc994f-5a78-4ff5-9ea8-4c8a0c4666c2 Sep 04 22:53:50 devstack sudo[104015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:53:51 devstack sudo[104015]: pam_unix(sudo:session): session closed for user root Sep 04 22:53:51 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4c3e9ab4-6ac9-4dec-b8e7-2219b4ecd821 tempest-CreateVolumesFromImageTest-1104757032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6efc994f-5a78-4ff5-9ea8-4c8a0c4666c2" returned: 0 in 0.266s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:53:51 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-4c3e9ab4-6ac9-4dec-b8e7-2219b4ecd821 tempest-CreateVolumesFromImageTest-1104757032 None] Lock "cinder-quobyte-6efc994f-5a78-4ff5-9ea8-4c8a0c4666c2" released by "delete_volume" :: held 0.783s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:53:51 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-4c3e9ab4-6ac9-4dec-b8e7-2219b4ecd821 tempest-CreateVolumesFromImageTest-1104757032 None] Created reservations ['b1f1bb8e-9d80-4cc9-9893-ae14232dffc3', '2e2ed260-38c9-454b-8e4b-5722c020987c', 'd1c074f9-f5fb-4b5e-b0a5-b1ddde041363', '8d7e0149-8b20-4631-ab3f-1dfba7fb1f51'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:53:51 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-4c3e9ab4-6ac9-4dec-b8e7-2219b4ecd821 tempest-CreateVolumesFromImageTest-1104757032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:53:51 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-4c3e9ab4-6ac9-4dec-b8e7-2219b4ecd821 tempest-CreateVolumesFromImageTest-1104757032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:53:51 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-4c3e9ab4-6ac9-4dec-b8e7-2219b4ecd821 tempest-CreateVolumesFromImageTest-1104757032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:53:51 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-4c3e9ab4-6ac9-4dec-b8e7-2219b4ecd821 tempest-CreateVolumesFromImageTest-1104757032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:53:51 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-4c3e9ab4-6ac9-4dec-b8e7-2219b4ecd821 tempest-CreateVolumesFromImageTest-1104757032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:53:51 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4c3e9ab4-6ac9-4dec-b8e7-2219b4ecd821 tempest-CreateVolumesFromImageTest-1104757032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:53:51 devstack sudo[104018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:53:51 devstack sudo[104018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:53:51 devstack sudo[104018]: pam_unix(sudo:session): session closed for user root Sep 04 22:53:51 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4c3e9ab4-6ac9-4dec-b8e7-2219b4ecd821 tempest-CreateVolumesFromImageTest-1104757032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.284s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:53:51 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-4c3e9ab4-6ac9-4dec-b8e7-2219b4ecd821 tempest-CreateVolumesFromImageTest-1104757032 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:53:51 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-4c3e9ab4-6ac9-4dec-b8e7-2219b4ecd821 tempest-CreateVolumesFromImageTest-1104757032 None] Deleted volume successfully. Sep 04 22:53:51 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-4c3e9ab4-6ac9-4dec-b8e7-2219b4ecd821 tempest-CreateVolumesFromImageTest-1104757032 None] Lock "cinder-6efc994f-5a78-4ff5-9ea8-4c8a0c4666c2-delete_volume" released by "delete_volume" :: held 1.342s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:53:54 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-e49ef8b1-4135-4809-bc8d-55c0ac8c02c0 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:53:54 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-e49ef8b1-4135-4809-bc8d-55c0ac8c02c0 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Flow 'volume_create_manager' (d028919a-d078-4aba-9536-ce05b0d72d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:53:54 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-e49ef8b1-4135-4809-bc8d-55c0ac8c02c0 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (256b881b-8d20-461b-bff4-a22705d8c52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:53:54 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-e49ef8b1-4135-4809-bc8d-55c0ac8c02c0 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (256b881b-8d20-461b-bff4-a22705d8c52f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-708003921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=736eaa45-22cd-4deb-852f-2ef4d0310e24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='effdd5020b264accb47e9a7e80bc6777',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:53:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:53:55Z,use_quota=True,user_id='c852f9ffdd2f4725a48e97cf1cb2216b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:53:54 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-e49ef8b1-4135-4809-bc8d-55c0ac8c02c0 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (278dd957-af3a-4573-948d-44168eafff12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:53:54 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-e49ef8b1-4135-4809-bc8d-55c0ac8c02c0 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (278dd957-af3a-4573-948d-44168eafff12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:53:54 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-e49ef8b1-4135-4809-bc8d-55c0ac8c02c0 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0abb4bf-d0e3-4429-a250-743ead35f1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:53:54 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-e49ef8b1-4135-4809-bc8d-55c0ac8c02c0 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0abb4bf-d0e3-4429-a250-743ead35f1cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '736eaa45-22cd-4deb-852f-2ef4d0310e24', 'volume_name': 'volume-736eaa45-22cd-4deb-852f-2ef4d0310e24', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:53:54 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-e49ef8b1-4135-4809-bc8d-55c0ac8c02c0 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2b47f1d-556b-43f2-afc5-3e531d656373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:53:54 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-e49ef8b1-4135-4809-bc8d-55c0ac8c02c0 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2b47f1d-556b-43f2-afc5-3e531d656373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:53:54 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-e49ef8b1-4135-4809-bc8d-55c0ac8c02c0 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1afbc567-b367-4dc5-b33b-6162f8c6b64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:53:54 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-e49ef8b1-4135-4809-bc8d-55c0ac8c02c0 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Volume 736eaa45-22cd-4deb-852f-2ef4d0310e24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-736eaa45-22cd-4deb-852f-2ef4d0310e24', 'volume_size': 1} Sep 04 22:53:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-e49ef8b1-4135-4809-bc8d-55c0ac8c02c0 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:53:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-e49ef8b1-4135-4809-bc8d-55c0ac8c02c0 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:53:54 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-e49ef8b1-4135-4809-bc8d-55c0ac8c02c0 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-708003921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=736eaa45-22cd-4deb-852f-2ef4d0310e24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='effdd5020b264accb47e9a7e80bc6777',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:53:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:53:55Z,use_quota=True,user_id='c852f9ffdd2f4725a48e97cf1cb2216b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:53:54 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-e49ef8b1-4135-4809-bc8d-55c0ac8c02c0 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Creating volume 736eaa45-22cd-4deb-852f-2ef4d0310e24 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:53:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-e49ef8b1-4135-4809-bc8d-55c0ac8c02c0 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:53:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-e49ef8b1-4135-4809-bc8d-55c0ac8c02c0 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:53:54 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-e49ef8b1-4135-4809-bc8d-55c0ac8c02c0 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:53:54 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-e49ef8b1-4135-4809-bc8d-55c0ac8c02c0 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:53:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-e49ef8b1-4135-4809-bc8d-55c0ac8c02c0 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:53:54 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-e49ef8b1-4135-4809-bc8d-55c0ac8c02c0 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:53:54 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-e49ef8b1-4135-4809-bc8d-55c0ac8c02c0 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:53:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e49ef8b1-4135-4809-bc8d-55c0ac8c02c0 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-736eaa45-22cd-4deb-852f-2ef4d0310e24 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:53:54 devstack sudo[104042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-736eaa45-22cd-4deb-852f-2ef4d0310e24 1073741824 Sep 04 22:53:54 devstack sudo[104042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:53:55 devstack sudo[104042]: pam_unix(sudo:session): session closed for user root Sep 04 22:53:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e49ef8b1-4135-4809-bc8d-55c0ac8c02c0 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-736eaa45-22cd-4deb-852f-2ef4d0310e24 1073741824" returned: 0 in 0.449s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:53:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e49ef8b1-4135-4809-bc8d-55c0ac8c02c0 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-736eaa45-22cd-4deb-852f-2ef4d0310e24 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:53:55 devstack sudo[104047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-736eaa45-22cd-4deb-852f-2ef4d0310e24 Sep 04 22:53:55 devstack sudo[104047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:53:55 devstack sudo[104047]: pam_unix(sudo:session): session closed for user root Sep 04 22:53:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e49ef8b1-4135-4809-bc8d-55c0ac8c02c0 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-736eaa45-22cd-4deb-852f-2ef4d0310e24" returned: 0 in 0.250s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:53:55 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-e49ef8b1-4135-4809-bc8d-55c0ac8c02c0 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:53:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-e49ef8b1-4135-4809-bc8d-55c0ac8c02c0 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:53:55 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-e49ef8b1-4135-4809-bc8d-55c0ac8c02c0 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1afbc567-b367-4dc5-b33b-6162f8c6b64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-736eaa45-22cd-4deb-852f-2ef4d0310e24', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:53:55 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-e49ef8b1-4135-4809-bc8d-55c0ac8c02c0 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ed0608d-4312-458c-ac4c-852d99bc1169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:53:55 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-e49ef8b1-4135-4809-bc8d-55c0ac8c02c0 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Volume volume-736eaa45-22cd-4deb-852f-2ef4d0310e24 (736eaa45-22cd-4deb-852f-2ef4d0310e24): created successfully Sep 04 22:53:55 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-e49ef8b1-4135-4809-bc8d-55c0ac8c02c0 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ed0608d-4312-458c-ac4c-852d99bc1169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:53:55 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-e49ef8b1-4135-4809-bc8d-55c0ac8c02c0 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Flow 'volume_create_manager' (d028919a-d078-4aba-9536-ce05b0d72d72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:53:55 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-e49ef8b1-4135-4809-bc8d-55c0ac8c02c0 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Created volume successfully. Sep 04 22:53:57 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-f75d0e8a-6888-4896-8d63-dd7f4dc7e856 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:53:57 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-f75d0e8a-6888-4896-8d63-dd7f4dc7e856 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Flow 'volume_create_manager' (cf2c249f-0dea-45ef-95ed-122853bba801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:53:57 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-f75d0e8a-6888-4896-8d63-dd7f4dc7e856 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfd1a8af-5c9d-4592-8294-bcfb8a126d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:53:57 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-f75d0e8a-6888-4896-8d63-dd7f4dc7e856 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfd1a8af-5c9d-4592-8294-bcfb8a126d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:53:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-502100624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=945d7d43-87cd-455a-9638-5103bc76c349,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='effdd5020b264accb47e9a7e80bc6777',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:53:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:53:57Z,use_quota=True,user_id='c852f9ffdd2f4725a48e97cf1cb2216b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:53:57 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-f75d0e8a-6888-4896-8d63-dd7f4dc7e856 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39b51947-539c-498e-bfec-b58ba4499a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:53:57 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-f75d0e8a-6888-4896-8d63-dd7f4dc7e856 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39b51947-539c-498e-bfec-b58ba4499a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:53:57 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-f75d0e8a-6888-4896-8d63-dd7f4dc7e856 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b11460bd-4e70-431f-b792-f6d5209cccdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:53:57 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-f75d0e8a-6888-4896-8d63-dd7f4dc7e856 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b11460bd-4e70-431f-b792-f6d5209cccdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '945d7d43-87cd-455a-9638-5103bc76c349', 'volume_name': 'volume-945d7d43-87cd-455a-9638-5103bc76c349', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:53:57 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-f75d0e8a-6888-4896-8d63-dd7f4dc7e856 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a888e32-b691-4da9-b78d-cd95203855ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:53:57 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-f75d0e8a-6888-4896-8d63-dd7f4dc7e856 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a888e32-b691-4da9-b78d-cd95203855ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:53:57 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-f75d0e8a-6888-4896-8d63-dd7f4dc7e856 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69d51921-cc59-472c-9603-1417a70d2276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:53:57 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-f75d0e8a-6888-4896-8d63-dd7f4dc7e856 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Volume 945d7d43-87cd-455a-9638-5103bc76c349: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-945d7d43-87cd-455a-9638-5103bc76c349', 'volume_size': 1} Sep 04 22:53:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f75d0e8a-6888-4896-8d63-dd7f4dc7e856 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:53:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f75d0e8a-6888-4896-8d63-dd7f4dc7e856 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:53:57 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-f75d0e8a-6888-4896-8d63-dd7f4dc7e856 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:53:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-502100624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=945d7d43-87cd-455a-9638-5103bc76c349,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='effdd5020b264accb47e9a7e80bc6777',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:53:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:53:57Z,use_quota=True,user_id='c852f9ffdd2f4725a48e97cf1cb2216b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:53:57 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-f75d0e8a-6888-4896-8d63-dd7f4dc7e856 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Creating volume 945d7d43-87cd-455a-9638-5103bc76c349 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:53:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f75d0e8a-6888-4896-8d63-dd7f4dc7e856 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:53:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f75d0e8a-6888-4896-8d63-dd7f4dc7e856 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:53:57 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-f75d0e8a-6888-4896-8d63-dd7f4dc7e856 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:53:57 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-f75d0e8a-6888-4896-8d63-dd7f4dc7e856 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:53:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f75d0e8a-6888-4896-8d63-dd7f4dc7e856 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:53:57 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-f75d0e8a-6888-4896-8d63-dd7f4dc7e856 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:53:57 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-f75d0e8a-6888-4896-8d63-dd7f4dc7e856 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:53:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f75d0e8a-6888-4896-8d63-dd7f4dc7e856 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-945d7d43-87cd-455a-9638-5103bc76c349 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:53:57 devstack sudo[104064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-945d7d43-87cd-455a-9638-5103bc76c349 1073741824 Sep 04 22:53:57 devstack sudo[104064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:53:57 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5820373-b7be-4ef6-a880-2e722432f680 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:53:57 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-c5820373-b7be-4ef6-a880-2e722432f680 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Flow 'volume_create_manager' (80b5309e-9d45-421f-9008-d414e9147c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:53:57 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-c5820373-b7be-4ef6-a880-2e722432f680 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e426232-6b58-4fe9-b739-6303a11921dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:53:57 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-c5820373-b7be-4ef6-a880-2e722432f680 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e426232-6b58-4fe9-b739-6303a11921dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:53:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-701461844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e16c721-7a2a-4f94-8153-90cbe9138cee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='effdd5020b264accb47e9a7e80bc6777',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:53:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:53:58Z,use_quota=True,user_id='c852f9ffdd2f4725a48e97cf1cb2216b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:53:57 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-c5820373-b7be-4ef6-a880-2e722432f680 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9f057cc-07b4-423d-ba94-8fd61a27e8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:53:57 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-c5820373-b7be-4ef6-a880-2e722432f680 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9f057cc-07b4-423d-ba94-8fd61a27e8f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:53:57 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-c5820373-b7be-4ef6-a880-2e722432f680 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b704ec8a-d692-42da-bfa1-fd0201dabeaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:53:57 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-c5820373-b7be-4ef6-a880-2e722432f680 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b704ec8a-d692-42da-bfa1-fd0201dabeaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e16c721-7a2a-4f94-8153-90cbe9138cee', 'volume_name': 'volume-2e16c721-7a2a-4f94-8153-90cbe9138cee', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:53:58 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-c5820373-b7be-4ef6-a880-2e722432f680 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20858f7a-d1ff-4928-9438-ab62fc01d8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:53:58 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-c5820373-b7be-4ef6-a880-2e722432f680 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20858f7a-d1ff-4928-9438-ab62fc01d8be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:53:58 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-c5820373-b7be-4ef6-a880-2e722432f680 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6307a51-0477-4ca9-b025-59964b074d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:53:58 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-c5820373-b7be-4ef6-a880-2e722432f680 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Volume 2e16c721-7a2a-4f94-8153-90cbe9138cee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e16c721-7a2a-4f94-8153-90cbe9138cee', 'volume_size': 1} Sep 04 22:53:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-c5820373-b7be-4ef6-a880-2e722432f680 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:53:58 devstack sudo[104064]: pam_unix(sudo:session): session closed for user root Sep 04 22:53:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f75d0e8a-6888-4896-8d63-dd7f4dc7e856 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-945d7d43-87cd-455a-9638-5103bc76c349 1073741824" returned: 0 in 1.030s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:53:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f75d0e8a-6888-4896-8d63-dd7f4dc7e856 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-945d7d43-87cd-455a-9638-5103bc76c349 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:53:58 devstack sudo[104121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-945d7d43-87cd-455a-9638-5103bc76c349 Sep 04 22:53:58 devstack sudo[104121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:53:58 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9d0bf32-4cda-46b2-9716-9ae93b1544d3 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:53:58 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d9d0bf32-4cda-46b2-9716-9ae93b1544d3 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Flow 'volume_create_manager' (9dace451-fd12-4fdf-baee-59079e41d718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:53:58 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d9d0bf32-4cda-46b2-9716-9ae93b1544d3 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b3d220a-7af1-44d2-b5b5-b3e7129ca055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:53:58 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d9d0bf32-4cda-46b2-9716-9ae93b1544d3 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b3d220a-7af1-44d2-b5b5-b3e7129ca055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:53:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-763191894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27aceefe-46b4-4487-8f00-61a0f437f07b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='effdd5020b264accb47e9a7e80bc6777',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:53:59Z,use_quota=True,user_id='c852f9ffdd2f4725a48e97cf1cb2216b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:53:58 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d9d0bf32-4cda-46b2-9716-9ae93b1544d3 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (000a2daf-4d50-4735-98db-356d45afd027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:53:58 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d9d0bf32-4cda-46b2-9716-9ae93b1544d3 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (000a2daf-4d50-4735-98db-356d45afd027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:53:58 devstack sudo[104121]: pam_unix(sudo:session): session closed for user root Sep 04 22:53:58 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d9d0bf32-4cda-46b2-9716-9ae93b1544d3 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef20c48d-94d0-4957-9625-76c587f4ef07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:53:58 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d9d0bf32-4cda-46b2-9716-9ae93b1544d3 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef20c48d-94d0-4957-9625-76c587f4ef07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27aceefe-46b4-4487-8f00-61a0f437f07b', 'volume_name': 'volume-27aceefe-46b4-4487-8f00-61a0f437f07b', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:53:58 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d9d0bf32-4cda-46b2-9716-9ae93b1544d3 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7c606cd-d50f-486c-b011-f6f83f568296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:53:58 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d9d0bf32-4cda-46b2-9716-9ae93b1544d3 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7c606cd-d50f-486c-b011-f6f83f568296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:53:58 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d9d0bf32-4cda-46b2-9716-9ae93b1544d3 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73752533-0c86-468d-9f46-e2179e19c925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:53:58 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-d9d0bf32-4cda-46b2-9716-9ae93b1544d3 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Volume 27aceefe-46b4-4487-8f00-61a0f437f07b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27aceefe-46b4-4487-8f00-61a0f437f07b', 'volume_size': 1} Sep 04 22:53:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-d9d0bf32-4cda-46b2-9716-9ae93b1544d3 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:53:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f75d0e8a-6888-4896-8d63-dd7f4dc7e856 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-945d7d43-87cd-455a-9638-5103bc76c349" returned: 0 in 0.471s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:53:58 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-f75d0e8a-6888-4896-8d63-dd7f4dc7e856 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] <== create_volume: return (1556ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:53:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f75d0e8a-6888-4896-8d63-dd7f4dc7e856 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.560s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:53:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-c5820373-b7be-4ef6-a880-2e722432f680 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.936s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:53:58 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-c5820373-b7be-4ef6-a880-2e722432f680 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:53:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-701461844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e16c721-7a2a-4f94-8153-90cbe9138cee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='effdd5020b264accb47e9a7e80bc6777',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:53:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:53:58Z,use_quota=True,user_id='c852f9ffdd2f4725a48e97cf1cb2216b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:53:58 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-c5820373-b7be-4ef6-a880-2e722432f680 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Creating volume 2e16c721-7a2a-4f94-8153-90cbe9138cee {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:53:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-c5820373-b7be-4ef6-a880-2e722432f680 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:53:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-c5820373-b7be-4ef6-a880-2e722432f680 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:53:58 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-c5820373-b7be-4ef6-a880-2e722432f680 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:53:58 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-c5820373-b7be-4ef6-a880-2e722432f680 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:53:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-c5820373-b7be-4ef6-a880-2e722432f680 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:53:58 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-c5820373-b7be-4ef6-a880-2e722432f680 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:53:58 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-c5820373-b7be-4ef6-a880-2e722432f680 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:53:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c5820373-b7be-4ef6-a880-2e722432f680 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-2e16c721-7a2a-4f94-8153-90cbe9138cee 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:53:58 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-f75d0e8a-6888-4896-8d63-dd7f4dc7e856 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69d51921-cc59-472c-9603-1417a70d2276) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-945d7d43-87cd-455a-9638-5103bc76c349', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:53:58 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-f75d0e8a-6888-4896-8d63-dd7f4dc7e856 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98e132e8-4df4-4928-8f72-12d9bc05208f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:53:59 devstack sudo[104127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-2e16c721-7a2a-4f94-8153-90cbe9138cee 1073741824 Sep 04 22:53:59 devstack sudo[104127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:53:59 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-f75d0e8a-6888-4896-8d63-dd7f4dc7e856 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Volume volume-945d7d43-87cd-455a-9638-5103bc76c349 (945d7d43-87cd-455a-9638-5103bc76c349): created successfully Sep 04 22:53:59 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-f75d0e8a-6888-4896-8d63-dd7f4dc7e856 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98e132e8-4df4-4928-8f72-12d9bc05208f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:53:59 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-f75d0e8a-6888-4896-8d63-dd7f4dc7e856 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Flow 'volume_create_manager' (cf2c249f-0dea-45ef-95ed-122853bba801) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:53:59 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-f75d0e8a-6888-4896-8d63-dd7f4dc7e856 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Created volume successfully. Sep 04 22:53:59 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bd51078-727a-45f7-b9d9-dac447d57374 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:53:59 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2bd51078-727a-45f7-b9d9-dac447d57374 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Flow 'volume_create_manager' (e3688e8d-db8d-4ebf-b305-567922889d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:53:59 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2bd51078-727a-45f7-b9d9-dac447d57374 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2592ed0f-39be-461b-a9e0-9cfed2a8ab8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:53:59 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2bd51078-727a-45f7-b9d9-dac447d57374 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2592ed0f-39be-461b-a9e0-9cfed2a8ab8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:53:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1022139246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce5f2258-7f24-48a6-82e8-8e9d86838ce4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='effdd5020b264accb47e9a7e80bc6777',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:53:59Z,use_quota=True,user_id='c852f9ffdd2f4725a48e97cf1cb2216b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:53:59 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2bd51078-727a-45f7-b9d9-dac447d57374 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26c0e63d-4389-4998-b08a-225c3e3d4924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:53:59 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2bd51078-727a-45f7-b9d9-dac447d57374 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26c0e63d-4389-4998-b08a-225c3e3d4924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:53:59 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2bd51078-727a-45f7-b9d9-dac447d57374 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40223e66-faf9-4f57-bba0-92901afa78e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:53:59 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2bd51078-727a-45f7-b9d9-dac447d57374 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40223e66-faf9-4f57-bba0-92901afa78e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce5f2258-7f24-48a6-82e8-8e9d86838ce4', 'volume_name': 'volume-ce5f2258-7f24-48a6-82e8-8e9d86838ce4', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:53:59 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2bd51078-727a-45f7-b9d9-dac447d57374 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31d802e3-500d-4e40-a415-b68be46aa3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:53:59 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2bd51078-727a-45f7-b9d9-dac447d57374 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31d802e3-500d-4e40-a415-b68be46aa3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:53:59 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2bd51078-727a-45f7-b9d9-dac447d57374 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0d66373-a3bc-42c7-9913-a657fc4bc513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:53:59 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-2bd51078-727a-45f7-b9d9-dac447d57374 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Volume ce5f2258-7f24-48a6-82e8-8e9d86838ce4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce5f2258-7f24-48a6-82e8-8e9d86838ce4', 'volume_size': 1} Sep 04 22:53:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-2bd51078-727a-45f7-b9d9-dac447d57374 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:53:59 devstack sudo[104127]: pam_unix(sudo:session): session closed for user root Sep 04 22:53:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c5820373-b7be-4ef6-a880-2e722432f680 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-2e16c721-7a2a-4f94-8153-90cbe9138cee 1073741824" returned: 0 in 0.751s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:53:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c5820373-b7be-4ef6-a880-2e722432f680 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-2e16c721-7a2a-4f94-8153-90cbe9138cee {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:53:59 devstack sudo[104134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-2e16c721-7a2a-4f94-8153-90cbe9138cee Sep 04 22:53:59 devstack sudo[104134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:53:59 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c6eb955-11c5-4762-8b1f-ae81746b00fd tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:53:59 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-5c6eb955-11c5-4762-8b1f-ae81746b00fd tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Flow 'volume_create_manager' (3ee3fcd0-5dfe-4ecf-949a-7c73d34312e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:54:00 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-5c6eb955-11c5-4762-8b1f-ae81746b00fd tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94b6f277-48db-4522-9f5b-61ebb1125121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:00 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-5c6eb955-11c5-4762-8b1f-ae81746b00fd tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94b6f277-48db-4522-9f5b-61ebb1125121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:54:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-694085154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e37c6050-440f-428f-9a2a-c7e0f67699ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='effdd5020b264accb47e9a7e80bc6777',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:54:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:54:00Z,use_quota=True,user_id='c852f9ffdd2f4725a48e97cf1cb2216b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:00 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-5c6eb955-11c5-4762-8b1f-ae81746b00fd tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (498c9d66-1c29-4b96-abc9-1efb1d2a98da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:00 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-5c6eb955-11c5-4762-8b1f-ae81746b00fd tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (498c9d66-1c29-4b96-abc9-1efb1d2a98da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:00 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-5c6eb955-11c5-4762-8b1f-ae81746b00fd tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e654a800-adbf-4208-b0bc-0f40541b6ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:00 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-5c6eb955-11c5-4762-8b1f-ae81746b00fd tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e654a800-adbf-4208-b0bc-0f40541b6ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e37c6050-440f-428f-9a2a-c7e0f67699ce', 'volume_name': 'volume-e37c6050-440f-428f-9a2a-c7e0f67699ce', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:00 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-5c6eb955-11c5-4762-8b1f-ae81746b00fd tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8eb0da5-9126-476b-9edf-788eb4904ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:00 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-5c6eb955-11c5-4762-8b1f-ae81746b00fd tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8eb0da5-9126-476b-9edf-788eb4904ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:00 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-5c6eb955-11c5-4762-8b1f-ae81746b00fd tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e725f80-62d5-4198-b748-551ae40ca9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:00 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-5c6eb955-11c5-4762-8b1f-ae81746b00fd tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Volume e37c6050-440f-428f-9a2a-c7e0f67699ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e37c6050-440f-428f-9a2a-c7e0f67699ce', 'volume_size': 1} Sep 04 22:54:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-5c6eb955-11c5-4762-8b1f-ae81746b00fd tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:54:00 devstack sudo[104134]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c5820373-b7be-4ef6-a880-2e722432f680 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-2e16c721-7a2a-4f94-8153-90cbe9138cee" returned: 0 in 0.350s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:00 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-c5820373-b7be-4ef6-a880-2e722432f680 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] <== create_volume: return (1175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:54:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-c5820373-b7be-4ef6-a880-2e722432f680 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.178s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:54:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-d9d0bf32-4cda-46b2-9716-9ae93b1544d3 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.190s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:54:00 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-d9d0bf32-4cda-46b2-9716-9ae93b1544d3 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:53:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-763191894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27aceefe-46b4-4487-8f00-61a0f437f07b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='effdd5020b264accb47e9a7e80bc6777',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:53:59Z,use_quota=True,user_id='c852f9ffdd2f4725a48e97cf1cb2216b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:54:00 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-d9d0bf32-4cda-46b2-9716-9ae93b1544d3 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Creating volume 27aceefe-46b4-4487-8f00-61a0f437f07b {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:54:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-d9d0bf32-4cda-46b2-9716-9ae93b1544d3 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:54:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-d9d0bf32-4cda-46b2-9716-9ae93b1544d3 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:54:00 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-d9d0bf32-4cda-46b2-9716-9ae93b1544d3 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:54:00 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-d9d0bf32-4cda-46b2-9716-9ae93b1544d3 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:54:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-d9d0bf32-4cda-46b2-9716-9ae93b1544d3 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:54:00 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-d9d0bf32-4cda-46b2-9716-9ae93b1544d3 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:54:00 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-d9d0bf32-4cda-46b2-9716-9ae93b1544d3 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:54:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d9d0bf32-4cda-46b2-9716-9ae93b1544d3 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-27aceefe-46b4-4487-8f00-61a0f437f07b 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:00 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-c5820373-b7be-4ef6-a880-2e722432f680 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6307a51-0477-4ca9-b025-59964b074d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e16c721-7a2a-4f94-8153-90cbe9138cee', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:00 devstack sudo[104137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-27aceefe-46b4-4487-8f00-61a0f437f07b 1073741824 Sep 04 22:54:00 devstack sudo[104137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:00 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-c5820373-b7be-4ef6-a880-2e722432f680 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ae9da37-afbd-40f5-bdd1-1656b64585c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:00 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-c5820373-b7be-4ef6-a880-2e722432f680 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Volume volume-2e16c721-7a2a-4f94-8153-90cbe9138cee (2e16c721-7a2a-4f94-8153-90cbe9138cee): created successfully Sep 04 22:54:00 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-c5820373-b7be-4ef6-a880-2e722432f680 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ae9da37-afbd-40f5-bdd1-1656b64585c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:00 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-c5820373-b7be-4ef6-a880-2e722432f680 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Flow 'volume_create_manager' (80b5309e-9d45-421f-9008-d414e9147c73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:54:00 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-c5820373-b7be-4ef6-a880-2e722432f680 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Created volume successfully. Sep 04 22:54:00 devstack sudo[104137]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d9d0bf32-4cda-46b2-9716-9ae93b1544d3 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-27aceefe-46b4-4487-8f00-61a0f437f07b 1073741824" returned: 0 in 0.507s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d9d0bf32-4cda-46b2-9716-9ae93b1544d3 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-27aceefe-46b4-4487-8f00-61a0f437f07b {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:00 devstack sudo[104143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-27aceefe-46b4-4487-8f00-61a0f437f07b Sep 04 22:54:00 devstack sudo[104143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:00 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-3db74bb9-c4e9-4179-9559-2daf37ce4de9 tempest-VolumesActionsTest-1832300490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:54:00 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3db74bb9-c4e9-4179-9559-2daf37ce4de9 tempest-VolumesActionsTest-1832300490 None] Flow 'volume_create_manager' (860f1ab8-7573-45a5-a36f-d4d9eb502a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:54:00 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3db74bb9-c4e9-4179-9559-2daf37ce4de9 tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f6a17f3-17c6-45ec-b55c-b30e14ef6621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:00 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3db74bb9-c4e9-4179-9559-2daf37ce4de9 tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f6a17f3-17c6-45ec-b55c-b30e14ef6621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:54:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-916675936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59525526-8bbb-4e8e-98cf-df0f869c02e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d95843e4152441bbbbfbfa2e77795605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:54:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:54:01Z,use_quota=True,user_id='a4b20ec1c95842f4bbf9f2645d24e5fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:00 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3db74bb9-c4e9-4179-9559-2daf37ce4de9 tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6e0694b-ec38-4b80-982c-95b3c715346d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:00 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3db74bb9-c4e9-4179-9559-2daf37ce4de9 tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6e0694b-ec38-4b80-982c-95b3c715346d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:00 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3db74bb9-c4e9-4179-9559-2daf37ce4de9 tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76762462-1b66-4285-a606-f8e2afc3228e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:00 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3db74bb9-c4e9-4179-9559-2daf37ce4de9 tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76762462-1b66-4285-a606-f8e2afc3228e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59525526-8bbb-4e8e-98cf-df0f869c02e0', 'volume_name': 'volume-59525526-8bbb-4e8e-98cf-df0f869c02e0', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:01 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3db74bb9-c4e9-4179-9559-2daf37ce4de9 tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (069d98d5-1afd-482b-9480-910fde68344b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:01 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3db74bb9-c4e9-4179-9559-2daf37ce4de9 tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (069d98d5-1afd-482b-9480-910fde68344b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:01 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3db74bb9-c4e9-4179-9559-2daf37ce4de9 tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (672ab0a4-21a5-43b9-b827-31cdd0950a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:01 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-3db74bb9-c4e9-4179-9559-2daf37ce4de9 tempest-VolumesActionsTest-1832300490 None] Volume 59525526-8bbb-4e8e-98cf-df0f869c02e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59525526-8bbb-4e8e-98cf-df0f869c02e0', 'volume_size': 1} Sep 04 22:54:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-3db74bb9-c4e9-4179-9559-2daf37ce4de9 tempest-VolumesActionsTest-1832300490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:54:01 devstack sudo[104143]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d9d0bf32-4cda-46b2-9716-9ae93b1544d3 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-27aceefe-46b4-4487-8f00-61a0f437f07b" returned: 0 in 0.328s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:01 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-d9d0bf32-4cda-46b2-9716-9ae93b1544d3 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:54:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-d9d0bf32-4cda-46b2-9716-9ae93b1544d3 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:54:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-2bd51078-727a-45f7-b9d9-dac447d57374 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.506s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:54:01 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-2bd51078-727a-45f7-b9d9-dac447d57374 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:53:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1022139246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce5f2258-7f24-48a6-82e8-8e9d86838ce4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='effdd5020b264accb47e9a7e80bc6777',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:53:59Z,use_quota=True,user_id='c852f9ffdd2f4725a48e97cf1cb2216b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:54:01 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-2bd51078-727a-45f7-b9d9-dac447d57374 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Creating volume ce5f2258-7f24-48a6-82e8-8e9d86838ce4 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:54:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-2bd51078-727a-45f7-b9d9-dac447d57374 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:54:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-2bd51078-727a-45f7-b9d9-dac447d57374 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:54:01 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-2bd51078-727a-45f7-b9d9-dac447d57374 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:54:01 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-2bd51078-727a-45f7-b9d9-dac447d57374 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:54:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-2bd51078-727a-45f7-b9d9-dac447d57374 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:54:01 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-2bd51078-727a-45f7-b9d9-dac447d57374 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:54:01 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-2bd51078-727a-45f7-b9d9-dac447d57374 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:54:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2bd51078-727a-45f7-b9d9-dac447d57374 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-ce5f2258-7f24-48a6-82e8-8e9d86838ce4 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:01 devstack sudo[104146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-ce5f2258-7f24-48a6-82e8-8e9d86838ce4 1073741824 Sep 04 22:54:01 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d9d0bf32-4cda-46b2-9716-9ae93b1544d3 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73752533-0c86-468d-9f46-e2179e19c925) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27aceefe-46b4-4487-8f00-61a0f437f07b', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:01 devstack sudo[104146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:01 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d9d0bf32-4cda-46b2-9716-9ae93b1544d3 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbeb765d-e985-47ea-a852-12dc81c70589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:01 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-d9d0bf32-4cda-46b2-9716-9ae93b1544d3 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Volume volume-27aceefe-46b4-4487-8f00-61a0f437f07b (27aceefe-46b4-4487-8f00-61a0f437f07b): created successfully Sep 04 22:54:01 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d9d0bf32-4cda-46b2-9716-9ae93b1544d3 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbeb765d-e985-47ea-a852-12dc81c70589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:01 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d9d0bf32-4cda-46b2-9716-9ae93b1544d3 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Flow 'volume_create_manager' (9dace451-fd12-4fdf-baee-59079e41d718) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:54:01 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-d9d0bf32-4cda-46b2-9716-9ae93b1544d3 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Created volume successfully. Sep 04 22:54:01 devstack sudo[104146]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2bd51078-727a-45f7-b9d9-dac447d57374 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-ce5f2258-7f24-48a6-82e8-8e9d86838ce4 1073741824" returned: 0 in 0.466s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2bd51078-727a-45f7-b9d9-dac447d57374 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-ce5f2258-7f24-48a6-82e8-8e9d86838ce4 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:01 devstack sudo[104151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-ce5f2258-7f24-48a6-82e8-8e9d86838ce4 Sep 04 22:54:01 devstack sudo[104151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:01 devstack sudo[104151]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2bd51078-727a-45f7-b9d9-dac447d57374 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-ce5f2258-7f24-48a6-82e8-8e9d86838ce4" returned: 0 in 0.284s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:01 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-2bd51078-727a-45f7-b9d9-dac447d57374 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:54:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-2bd51078-727a-45f7-b9d9-dac447d57374 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:54:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-5c6eb955-11c5-4762-8b1f-ae81746b00fd tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.771s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:54:01 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-5c6eb955-11c5-4762-8b1f-ae81746b00fd tempest-CreateVolumesFromSourceVolumeTest-978646788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:54:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-694085154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e37c6050-440f-428f-9a2a-c7e0f67699ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='effdd5020b264accb47e9a7e80bc6777',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:54:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:54:00Z,use_quota=True,user_id='c852f9ffdd2f4725a48e97cf1cb2216b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:54:01 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-5c6eb955-11c5-4762-8b1f-ae81746b00fd tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Creating volume e37c6050-440f-428f-9a2a-c7e0f67699ce {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:54:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-5c6eb955-11c5-4762-8b1f-ae81746b00fd tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:54:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-5c6eb955-11c5-4762-8b1f-ae81746b00fd tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:54:01 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-5c6eb955-11c5-4762-8b1f-ae81746b00fd tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:54:01 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-5c6eb955-11c5-4762-8b1f-ae81746b00fd tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:54:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-5c6eb955-11c5-4762-8b1f-ae81746b00fd tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:54:01 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-5c6eb955-11c5-4762-8b1f-ae81746b00fd tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:54:01 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-5c6eb955-11c5-4762-8b1f-ae81746b00fd tempest-CreateVolumesFromSourceVolumeTest-978646788 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:54:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5c6eb955-11c5-4762-8b1f-ae81746b00fd tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e37c6050-440f-428f-9a2a-c7e0f67699ce 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:01 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2bd51078-727a-45f7-b9d9-dac447d57374 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0d66373-a3bc-42c7-9913-a657fc4bc513) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce5f2258-7f24-48a6-82e8-8e9d86838ce4', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:01 devstack sudo[104155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e37c6050-440f-428f-9a2a-c7e0f67699ce 1073741824 Sep 04 22:54:01 devstack sudo[104155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:01 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2bd51078-727a-45f7-b9d9-dac447d57374 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d28d3324-ffb4-4105-b5a3-6fa0f14390cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:01 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-2bd51078-727a-45f7-b9d9-dac447d57374 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Volume volume-ce5f2258-7f24-48a6-82e8-8e9d86838ce4 (ce5f2258-7f24-48a6-82e8-8e9d86838ce4): created successfully Sep 04 22:54:01 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2bd51078-727a-45f7-b9d9-dac447d57374 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d28d3324-ffb4-4105-b5a3-6fa0f14390cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:01 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2bd51078-727a-45f7-b9d9-dac447d57374 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Flow 'volume_create_manager' (e3688e8d-db8d-4ebf-b305-567922889d8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:54:01 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-2bd51078-727a-45f7-b9d9-dac447d57374 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Created volume successfully. Sep 04 22:54:02 devstack sudo[104155]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:02 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5c6eb955-11c5-4762-8b1f-ae81746b00fd tempest-CreateVolumesFromSourceVolumeTest-978646788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e37c6050-440f-428f-9a2a-c7e0f67699ce 1073741824" returned: 0 in 0.506s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:02 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5c6eb955-11c5-4762-8b1f-ae81746b00fd tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e37c6050-440f-428f-9a2a-c7e0f67699ce {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:02 devstack sudo[104168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e37c6050-440f-428f-9a2a-c7e0f67699ce Sep 04 22:54:02 devstack sudo[104168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:02 devstack sudo[104168]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:02 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5c6eb955-11c5-4762-8b1f-ae81746b00fd tempest-CreateVolumesFromSourceVolumeTest-978646788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e37c6050-440f-428f-9a2a-c7e0f67699ce" returned: 0 in 0.268s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:02 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-5c6eb955-11c5-4762-8b1f-ae81746b00fd tempest-CreateVolumesFromSourceVolumeTest-978646788 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:54:02 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-5c6eb955-11c5-4762-8b1f-ae81746b00fd tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:54:02 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-3db74bb9-c4e9-4179-9559-2daf37ce4de9 tempest-VolumesActionsTest-1832300490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.678s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:54:02 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-3db74bb9-c4e9-4179-9559-2daf37ce4de9 tempest-VolumesActionsTest-1832300490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:54:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-916675936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59525526-8bbb-4e8e-98cf-df0f869c02e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d95843e4152441bbbbfbfa2e77795605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:54:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:54:01Z,use_quota=True,user_id='a4b20ec1c95842f4bbf9f2645d24e5fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:54:02 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-3db74bb9-c4e9-4179-9559-2daf37ce4de9 tempest-VolumesActionsTest-1832300490 None] Creating volume 59525526-8bbb-4e8e-98cf-df0f869c02e0 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:54:02 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-3db74bb9-c4e9-4179-9559-2daf37ce4de9 tempest-VolumesActionsTest-1832300490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:54:02 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-3db74bb9-c4e9-4179-9559-2daf37ce4de9 tempest-VolumesActionsTest-1832300490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:54:02 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-3db74bb9-c4e9-4179-9559-2daf37ce4de9 tempest-VolumesActionsTest-1832300490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:54:02 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-3db74bb9-c4e9-4179-9559-2daf37ce4de9 tempest-VolumesActionsTest-1832300490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:54:02 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-3db74bb9-c4e9-4179-9559-2daf37ce4de9 tempest-VolumesActionsTest-1832300490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:54:02 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-3db74bb9-c4e9-4179-9559-2daf37ce4de9 tempest-VolumesActionsTest-1832300490 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:54:02 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-3db74bb9-c4e9-4179-9559-2daf37ce4de9 tempest-VolumesActionsTest-1832300490 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:54:02 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3db74bb9-c4e9-4179-9559-2daf37ce4de9 tempest-VolumesActionsTest-1832300490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-59525526-8bbb-4e8e-98cf-df0f869c02e0 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:02 devstack sudo[104171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-59525526-8bbb-4e8e-98cf-df0f869c02e0 1073741824 Sep 04 22:54:02 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-5c6eb955-11c5-4762-8b1f-ae81746b00fd tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e725f80-62d5-4198-b748-551ae40ca9a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e37c6050-440f-428f-9a2a-c7e0f67699ce', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:02 devstack sudo[104171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:02 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-5c6eb955-11c5-4762-8b1f-ae81746b00fd tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d200ab5a-66c9-4086-bd7d-76fd5f589288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:02 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-5c6eb955-11c5-4762-8b1f-ae81746b00fd tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Volume volume-e37c6050-440f-428f-9a2a-c7e0f67699ce (e37c6050-440f-428f-9a2a-c7e0f67699ce): created successfully Sep 04 22:54:02 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-5c6eb955-11c5-4762-8b1f-ae81746b00fd tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d200ab5a-66c9-4086-bd7d-76fd5f589288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:02 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-5c6eb955-11c5-4762-8b1f-ae81746b00fd tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Flow 'volume_create_manager' (3ee3fcd0-5dfe-4ecf-949a-7c73d34312e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:54:02 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-5c6eb955-11c5-4762-8b1f-ae81746b00fd tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Created volume successfully. Sep 04 22:54:03 devstack sudo[104171]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3db74bb9-c4e9-4179-9559-2daf37ce4de9 tempest-VolumesActionsTest-1832300490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-59525526-8bbb-4e8e-98cf-df0f869c02e0 1073741824" returned: 0 in 0.428s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3db74bb9-c4e9-4179-9559-2daf37ce4de9 tempest-VolumesActionsTest-1832300490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-59525526-8bbb-4e8e-98cf-df0f869c02e0 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:03 devstack sudo[104177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-59525526-8bbb-4e8e-98cf-df0f869c02e0 Sep 04 22:54:03 devstack sudo[104177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:03 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-13c8502a-becd-4c1e-b82a-f710dd569a9f tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Acquiring lock "cinder-e37c6050-440f-428f-9a2a-c7e0f67699ce-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:54:03 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-13c8502a-becd-4c1e-b82a-f710dd569a9f tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Lock "cinder-e37c6050-440f-428f-9a2a-c7e0f67699ce-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:54:03 devstack sudo[104177]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3db74bb9-c4e9-4179-9559-2daf37ce4de9 tempest-VolumesActionsTest-1832300490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-59525526-8bbb-4e8e-98cf-df0f869c02e0" returned: 0 in 0.292s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:03 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-13c8502a-becd-4c1e-b82a-f710dd569a9f tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Acquiring lock "cinder-quobyte-e37c6050-440f-428f-9a2a-c7e0f67699ce" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:54:03 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-3db74bb9-c4e9-4179-9559-2daf37ce4de9 tempest-VolumesActionsTest-1832300490 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:54:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-3db74bb9-c4e9-4179-9559-2daf37ce4de9 tempest-VolumesActionsTest-1832300490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:54:03 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3db74bb9-c4e9-4179-9559-2daf37ce4de9 tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (672ab0a4-21a5-43b9-b827-31cdd0950a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59525526-8bbb-4e8e-98cf-df0f869c02e0', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:03 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3db74bb9-c4e9-4179-9559-2daf37ce4de9 tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7258eddd-e0e2-42f0-8f64-539eff8c18cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:03 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-13c8502a-becd-4c1e-b82a-f710dd569a9f tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Lock "cinder-quobyte-e37c6050-440f-428f-9a2a-c7e0f67699ce" acquired by "delete_volume" :: waited 0.038s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:54:03 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-3db74bb9-c4e9-4179-9559-2daf37ce4de9 tempest-VolumesActionsTest-1832300490 None] Volume volume-59525526-8bbb-4e8e-98cf-df0f869c02e0 (59525526-8bbb-4e8e-98cf-df0f869c02e0): created successfully Sep 04 22:54:03 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3db74bb9-c4e9-4179-9559-2daf37ce4de9 tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7258eddd-e0e2-42f0-8f64-539eff8c18cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:03 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3db74bb9-c4e9-4179-9559-2daf37ce4de9 tempest-VolumesActionsTest-1832300490 None] Flow 'volume_create_manager' (860f1ab8-7573-45a5-a36f-d4d9eb502a71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:54:03 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[819ed305-23b0-4b1f-946e-b388eaf2c485]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:54:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-13c8502a-becd-4c1e-b82a-f710dd569a9f tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e37c6050-440f-428f-9a2a-c7e0f67699ce {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:03 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-3db74bb9-c4e9-4179-9559-2daf37ce4de9 tempest-VolumesActionsTest-1832300490 None] Created volume successfully. Sep 04 22:54:03 devstack sudo[104180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e37c6050-440f-428f-9a2a-c7e0f67699ce Sep 04 22:54:03 devstack sudo[104180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:03 devstack sudo[104180]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-13c8502a-becd-4c1e-b82a-f710dd569a9f tempest-CreateVolumesFromSourceVolumeTest-978646788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e37c6050-440f-428f-9a2a-c7e0f67699ce" returned: 0 in 0.369s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-13c8502a-becd-4c1e-b82a-f710dd569a9f tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e37c6050-440f-428f-9a2a-c7e0f67699ce {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:03 devstack sudo[104185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e37c6050-440f-428f-9a2a-c7e0f67699ce Sep 04 22:54:03 devstack sudo[104185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:04 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-3060843c-ae56-43fb-9202-2577c362a762 tempest-VolumesActionsTest-1832300490 None] Acquiring lock "cinder-59525526-8bbb-4e8e-98cf-df0f869c02e0" by "attach_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:54:04 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-3060843c-ae56-43fb-9202-2577c362a762 tempest-VolumesActionsTest-1832300490 None] Lock "cinder-59525526-8bbb-4e8e-98cf-df0f869c02e0" acquired by "attach_volume" :: waited 0.025s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:54:04 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-3060843c-ae56-43fb-9202-2577c362a762 tempest-VolumesActionsTest-1832300490 None] Attaching volume 59525526-8bbb-4e8e-98cf-df0f869c02e0 to instance d0214867-1e22-4be0-8ca4-71fec073ef18 at mountpoint /dev/vdb on host None. Sep 04 22:54:04 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-3060843c-ae56-43fb-9202-2577c362a762 tempest-VolumesActionsTest-1832300490 None] Attach volume completed successfully. Sep 04 22:54:04 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-3060843c-ae56-43fb-9202-2577c362a762 tempest-VolumesActionsTest-1832300490 None] Lock "cinder-59525526-8bbb-4e8e-98cf-df0f869c02e0" released by "attach_volume" :: held 0.097s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:54:04 devstack sudo[104185]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-13c8502a-becd-4c1e-b82a-f710dd569a9f tempest-CreateVolumesFromSourceVolumeTest-978646788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e37c6050-440f-428f-9a2a-c7e0f67699ce" returned: 0 in 0.280s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:04 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-13c8502a-becd-4c1e-b82a-f710dd569a9f tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Lock "cinder-quobyte-e37c6050-440f-428f-9a2a-c7e0f67699ce" released by "delete_volume" :: held 0.697s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:54:04 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-13c8502a-becd-4c1e-b82a-f710dd569a9f tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Created reservations ['5aff107b-6126-4ead-9d8f-492b244833c4', '8f3e7058-6337-4259-9723-08c9b1b7c307', 'ae77e816-b4a8-44b2-824d-fb3b2fbe80c2', 'b8da9508-75b8-4067-bb39-8b758daa3958'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:54:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-13c8502a-becd-4c1e-b82a-f710dd569a9f tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:54:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-13c8502a-becd-4c1e-b82a-f710dd569a9f tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:54:04 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-13c8502a-becd-4c1e-b82a-f710dd569a9f tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:54:04 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-13c8502a-becd-4c1e-b82a-f710dd569a9f tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:54:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-13c8502a-becd-4c1e-b82a-f710dd569a9f tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:54:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-13c8502a-becd-4c1e-b82a-f710dd569a9f tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:04 devstack sudo[104188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:54:04 devstack sudo[104188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:04 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-641dc389-f94e-4547-98fa-ca492dfa68cd tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Acquiring lock "cinder-ce5f2258-7f24-48a6-82e8-8e9d86838ce4-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:54:04 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-641dc389-f94e-4547-98fa-ca492dfa68cd tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Lock "cinder-ce5f2258-7f24-48a6-82e8-8e9d86838ce4-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:54:04 devstack sudo[104188]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-13c8502a-becd-4c1e-b82a-f710dd569a9f tempest-CreateVolumesFromSourceVolumeTest-978646788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.315s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:04 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-13c8502a-becd-4c1e-b82a-f710dd569a9f tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:54:04 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-13c8502a-becd-4c1e-b82a-f710dd569a9f tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Deleted volume successfully. Sep 04 22:54:04 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-641dc389-f94e-4547-98fa-ca492dfa68cd tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Acquiring lock "cinder-quobyte-ce5f2258-7f24-48a6-82e8-8e9d86838ce4" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:54:04 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-13c8502a-becd-4c1e-b82a-f710dd569a9f tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Lock "cinder-e37c6050-440f-428f-9a2a-c7e0f67699ce-delete_volume" released by "delete_volume" :: held 1.288s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:54:04 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-641dc389-f94e-4547-98fa-ca492dfa68cd tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Lock "cinder-quobyte-ce5f2258-7f24-48a6-82e8-8e9d86838ce4" acquired by "delete_volume" :: waited 0.027s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:54:04 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[10865516-9ead-4ab9-ab80-e5e105d1f57c]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:54:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-641dc389-f94e-4547-98fa-ca492dfa68cd tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-ce5f2258-7f24-48a6-82e8-8e9d86838ce4 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:04 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-2807c13e-e436-47cb-a1fc-61b53992d7a2 tempest-VolumesActionsTest-1819649853 None] Terminate volume connection completed successfully. Sep 04 22:54:04 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-2807c13e-e436-47cb-a1fc-61b53992d7a2 tempest-VolumesActionsTest-1819649853 None] Acquiring lock "cinder-59525526-8bbb-4e8e-98cf-df0f869c02e0-detach_volume" by "detach_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:54:04 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-2807c13e-e436-47cb-a1fc-61b53992d7a2 tempest-VolumesActionsTest-1819649853 None] Lock "cinder-59525526-8bbb-4e8e-98cf-df0f869c02e0-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:54:04 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-2807c13e-e436-47cb-a1fc-61b53992d7a2 tempest-VolumesActionsTest-1819649853 None] Detaching volume 59525526-8bbb-4e8e-98cf-df0f869c02e0 from instance d0214867-1e22-4be0-8ca4-71fec073ef18. Sep 04 22:54:04 devstack sudo[104191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-ce5f2258-7f24-48a6-82e8-8e9d86838ce4 Sep 04 22:54:04 devstack sudo[104191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:04 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-2807c13e-e436-47cb-a1fc-61b53992d7a2 tempest-VolumesActionsTest-1819649853 None] Detach volume completed successfully. Sep 04 22:54:04 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-2807c13e-e436-47cb-a1fc-61b53992d7a2 tempest-VolumesActionsTest-1819649853 None] Lock "cinder-59525526-8bbb-4e8e-98cf-df0f869c02e0-detach_volume" released by "detach_volume" :: held 0.075s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:54:05 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-b2de4417-7e74-4721-a46c-6e419331732e tempest-VolumesActionsTest-1832300490 None] Acquiring lock "cinder-59525526-8bbb-4e8e-98cf-df0f869c02e0-detach_volume" by "detach_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:54:05 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-b2de4417-7e74-4721-a46c-6e419331732e tempest-VolumesActionsTest-1832300490 None] Lock "cinder-59525526-8bbb-4e8e-98cf-df0f869c02e0-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:54:05 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-b2de4417-7e74-4721-a46c-6e419331732e tempest-VolumesActionsTest-1832300490 None] Volume detach called, but volume not attached. Sep 04 22:54:05 devstack sudo[104191]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-641dc389-f94e-4547-98fa-ca492dfa68cd tempest-CreateVolumesFromSourceVolumeTest-978646788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-ce5f2258-7f24-48a6-82e8-8e9d86838ce4" returned: 0 in 0.390s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-641dc389-f94e-4547-98fa-ca492dfa68cd tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-ce5f2258-7f24-48a6-82e8-8e9d86838ce4 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:05 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-b2de4417-7e74-4721-a46c-6e419331732e tempest-VolumesActionsTest-1832300490 None] Lock "cinder-59525526-8bbb-4e8e-98cf-df0f869c02e0-detach_volume" released by "detach_volume" :: held 0.040s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:54:05 devstack sudo[104196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-ce5f2258-7f24-48a6-82e8-8e9d86838ce4 Sep 04 22:54:05 devstack sudo[104196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:05 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-854d46a9-6be4-4edd-9a64-ecea5ea54906 tempest-VolumesActionsTest-1832300490 None] Acquiring lock "cinder-59525526-8bbb-4e8e-98cf-df0f869c02e0-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:54:05 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-854d46a9-6be4-4edd-9a64-ecea5ea54906 tempest-VolumesActionsTest-1832300490 None] Lock "cinder-59525526-8bbb-4e8e-98cf-df0f869c02e0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:54:05 devstack sudo[104196]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-641dc389-f94e-4547-98fa-ca492dfa68cd tempest-CreateVolumesFromSourceVolumeTest-978646788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-ce5f2258-7f24-48a6-82e8-8e9d86838ce4" returned: 0 in 0.296s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:05 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-641dc389-f94e-4547-98fa-ca492dfa68cd tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Lock "cinder-quobyte-ce5f2258-7f24-48a6-82e8-8e9d86838ce4" released by "delete_volume" :: held 0.749s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:54:05 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-854d46a9-6be4-4edd-9a64-ecea5ea54906 tempest-VolumesActionsTest-1832300490 None] Acquiring lock "cinder-quobyte-59525526-8bbb-4e8e-98cf-df0f869c02e0" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:54:05 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-854d46a9-6be4-4edd-9a64-ecea5ea54906 tempest-VolumesActionsTest-1832300490 None] Lock "cinder-quobyte-59525526-8bbb-4e8e-98cf-df0f869c02e0" acquired by "delete_volume" :: waited 0.022s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:54:05 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5295200-6917-41a1-8151-2a788b979e35]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:54:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-854d46a9-6be4-4edd-9a64-ecea5ea54906 tempest-VolumesActionsTest-1832300490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-59525526-8bbb-4e8e-98cf-df0f869c02e0 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:05 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-641dc389-f94e-4547-98fa-ca492dfa68cd tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Created reservations ['808ba44b-75e6-4607-ad11-addbc5b1eb7a', '7b170e77-5379-4a12-b1cc-3d66f44904bc', '71de339b-848e-4dce-94a6-a471db826e28', '56be64c0-23f8-4af0-80e1-b51d408ba584'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:54:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-641dc389-f94e-4547-98fa-ca492dfa68cd tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:54:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-641dc389-f94e-4547-98fa-ca492dfa68cd tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:54:05 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-641dc389-f94e-4547-98fa-ca492dfa68cd tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:54:05 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-641dc389-f94e-4547-98fa-ca492dfa68cd tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:54:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-641dc389-f94e-4547-98fa-ca492dfa68cd tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:54:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-641dc389-f94e-4547-98fa-ca492dfa68cd tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:05 devstack sudo[104200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:54:05 devstack sudo[104199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-59525526-8bbb-4e8e-98cf-df0f869c02e0 Sep 04 22:54:05 devstack sudo[104200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:05 devstack sudo[104199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:05 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-1c3ef5e6-75a8-4f17-946c-96e8d1acbe5b tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Acquiring lock "cinder-27aceefe-46b4-4487-8f00-61a0f437f07b-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:54:05 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-1c3ef5e6-75a8-4f17-946c-96e8d1acbe5b tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Lock "cinder-27aceefe-46b4-4487-8f00-61a0f437f07b-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:54:05 devstack sudo[104200]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-641dc389-f94e-4547-98fa-ca492dfa68cd tempest-CreateVolumesFromSourceVolumeTest-978646788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.285s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:05 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-641dc389-f94e-4547-98fa-ca492dfa68cd tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:54:05 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-641dc389-f94e-4547-98fa-ca492dfa68cd tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Deleted volume successfully. Sep 04 22:54:05 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-1c3ef5e6-75a8-4f17-946c-96e8d1acbe5b tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Acquiring lock "cinder-quobyte-27aceefe-46b4-4487-8f00-61a0f437f07b" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:54:05 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-641dc389-f94e-4547-98fa-ca492dfa68cd tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Lock "cinder-ce5f2258-7f24-48a6-82e8-8e9d86838ce4-delete_volume" released by "delete_volume" :: held 1.344s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:54:05 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-1c3ef5e6-75a8-4f17-946c-96e8d1acbe5b tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Lock "cinder-quobyte-27aceefe-46b4-4487-8f00-61a0f437f07b" acquired by "delete_volume" :: waited 0.026s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:54:06 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ab2c65-64ae-4986-b977-daf8b66e8a9a]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:54:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-1c3ef5e6-75a8-4f17-946c-96e8d1acbe5b tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-27aceefe-46b4-4487-8f00-61a0f437f07b {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:06 devstack sudo[104199]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-854d46a9-6be4-4edd-9a64-ecea5ea54906 tempest-VolumesActionsTest-1832300490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-59525526-8bbb-4e8e-98cf-df0f869c02e0" returned: 0 in 0.498s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-854d46a9-6be4-4edd-9a64-ecea5ea54906 tempest-VolumesActionsTest-1832300490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-59525526-8bbb-4e8e-98cf-df0f869c02e0 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:06 devstack sudo[104209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-59525526-8bbb-4e8e-98cf-df0f869c02e0 Sep 04 22:54:06 devstack sudo[104209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:06 devstack sudo[104208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-27aceefe-46b4-4487-8f00-61a0f437f07b Sep 04 22:54:06 devstack sudo[104208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:06 devstack sudo[104209]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-854d46a9-6be4-4edd-9a64-ecea5ea54906 tempest-VolumesActionsTest-1832300490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-59525526-8bbb-4e8e-98cf-df0f869c02e0" returned: 0 in 0.265s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:06 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-854d46a9-6be4-4edd-9a64-ecea5ea54906 tempest-VolumesActionsTest-1832300490 None] Lock "cinder-quobyte-59525526-8bbb-4e8e-98cf-df0f869c02e0" released by "delete_volume" :: held 0.808s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:54:06 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-854d46a9-6be4-4edd-9a64-ecea5ea54906 tempest-VolumesActionsTest-1832300490 None] Created reservations ['a0fdeb5e-b567-4e7a-8196-361234766651', '771602b5-99c0-49cc-a2c0-2c53919ad247', 'd6c7907f-594b-4e6e-b254-80adb006cab5', 'bd7cd10a-a577-48f9-bc46-1874275b1c60'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:54:06 devstack sudo[104208]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-1c3ef5e6-75a8-4f17-946c-96e8d1acbe5b tempest-CreateVolumesFromSourceVolumeTest-978646788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-27aceefe-46b4-4487-8f00-61a0f437f07b" returned: 0 in 0.386s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-1c3ef5e6-75a8-4f17-946c-96e8d1acbe5b tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-27aceefe-46b4-4487-8f00-61a0f437f07b {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:06 devstack sudo[104217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-27aceefe-46b4-4487-8f00-61a0f437f07b Sep 04 22:54:06 devstack sudo[104217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-854d46a9-6be4-4edd-9a64-ecea5ea54906 tempest-VolumesActionsTest-1832300490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:54:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-854d46a9-6be4-4edd-9a64-ecea5ea54906 tempest-VolumesActionsTest-1832300490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:54:06 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-854d46a9-6be4-4edd-9a64-ecea5ea54906 tempest-VolumesActionsTest-1832300490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:54:06 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-854d46a9-6be4-4edd-9a64-ecea5ea54906 tempest-VolumesActionsTest-1832300490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:54:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-854d46a9-6be4-4edd-9a64-ecea5ea54906 tempest-VolumesActionsTest-1832300490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:54:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-854d46a9-6be4-4edd-9a64-ecea5ea54906 tempest-VolumesActionsTest-1832300490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:06 devstack sudo[104219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:54:06 devstack sudo[104219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:06 devstack sudo[104217]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-1c3ef5e6-75a8-4f17-946c-96e8d1acbe5b tempest-CreateVolumesFromSourceVolumeTest-978646788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-27aceefe-46b4-4487-8f00-61a0f437f07b" returned: 0 in 0.334s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:06 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-1c3ef5e6-75a8-4f17-946c-96e8d1acbe5b tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Lock "cinder-quobyte-27aceefe-46b4-4487-8f00-61a0f437f07b" released by "delete_volume" :: held 0.770s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:54:06 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-1c3ef5e6-75a8-4f17-946c-96e8d1acbe5b tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Created reservations ['23369492-dd82-4d4f-b53f-2587e3f66c45', '9f683063-de7c-421d-8774-a0c810830e2a', '98d54240-06af-46c7-8702-dae1ab95e051', '0959ce86-c7bb-4b8a-8b5a-e969ba0b6066'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:54:06 devstack sudo[104219]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-854d46a9-6be4-4edd-9a64-ecea5ea54906 tempest-VolumesActionsTest-1832300490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.429s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:06 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-854d46a9-6be4-4edd-9a64-ecea5ea54906 tempest-VolumesActionsTest-1832300490 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:54:06 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-854d46a9-6be4-4edd-9a64-ecea5ea54906 tempest-VolumesActionsTest-1832300490 None] Deleted volume successfully. Sep 04 22:54:06 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-854d46a9-6be4-4edd-9a64-ecea5ea54906 tempest-VolumesActionsTest-1832300490 None] Lock "cinder-59525526-8bbb-4e8e-98cf-df0f869c02e0-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:54:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-1c3ef5e6-75a8-4f17-946c-96e8d1acbe5b tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:54:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-1c3ef5e6-75a8-4f17-946c-96e8d1acbe5b tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:54:07 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-1c3ef5e6-75a8-4f17-946c-96e8d1acbe5b tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:54:07 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-1c3ef5e6-75a8-4f17-946c-96e8d1acbe5b tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:54:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-1c3ef5e6-75a8-4f17-946c-96e8d1acbe5b tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:54:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-1c3ef5e6-75a8-4f17-946c-96e8d1acbe5b tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:07 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-5c19f172-ed90-4c55-90fe-f1691acc2121 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Acquiring lock "cinder-2e16c721-7a2a-4f94-8153-90cbe9138cee-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:54:07 devstack sudo[104225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:54:07 devstack sudo[104225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:07 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-5c19f172-ed90-4c55-90fe-f1691acc2121 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Lock "cinder-2e16c721-7a2a-4f94-8153-90cbe9138cee-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:54:07 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-5c19f172-ed90-4c55-90fe-f1691acc2121 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Acquiring lock "cinder-quobyte-2e16c721-7a2a-4f94-8153-90cbe9138cee" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:54:07 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-5c19f172-ed90-4c55-90fe-f1691acc2121 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Lock "cinder-quobyte-2e16c721-7a2a-4f94-8153-90cbe9138cee" acquired by "delete_volume" :: waited 0.030s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:54:07 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8dee0f7-7605-4ffc-b877-d75f1aaf9ba7]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:54:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5c19f172-ed90-4c55-90fe-f1691acc2121 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-2e16c721-7a2a-4f94-8153-90cbe9138cee {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:07 devstack sudo[104231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-2e16c721-7a2a-4f94-8153-90cbe9138cee Sep 04 22:54:07 devstack sudo[104231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:07 devstack sudo[104225]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-1c3ef5e6-75a8-4f17-946c-96e8d1acbe5b tempest-CreateVolumesFromSourceVolumeTest-978646788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.463s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:07 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-1c3ef5e6-75a8-4f17-946c-96e8d1acbe5b tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:54:07 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-1c3ef5e6-75a8-4f17-946c-96e8d1acbe5b tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Deleted volume successfully. Sep 04 22:54:07 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-1c3ef5e6-75a8-4f17-946c-96e8d1acbe5b tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Lock "cinder-27aceefe-46b4-4487-8f00-61a0f437f07b-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:54:07 devstack sudo[104231]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5c19f172-ed90-4c55-90fe-f1691acc2121 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-2e16c721-7a2a-4f94-8153-90cbe9138cee" returned: 0 in 0.508s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5c19f172-ed90-4c55-90fe-f1691acc2121 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-2e16c721-7a2a-4f94-8153-90cbe9138cee {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:07 devstack sudo[104253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-2e16c721-7a2a-4f94-8153-90cbe9138cee Sep 04 22:54:07 devstack sudo[104253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:07 devstack sudo[104253]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5c19f172-ed90-4c55-90fe-f1691acc2121 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-2e16c721-7a2a-4f94-8153-90cbe9138cee" returned: 0 in 0.265s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:08 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-5c19f172-ed90-4c55-90fe-f1691acc2121 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Lock "cinder-quobyte-2e16c721-7a2a-4f94-8153-90cbe9138cee" released by "delete_volume" :: held 0.829s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:54:08 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-5c19f172-ed90-4c55-90fe-f1691acc2121 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Created reservations ['f9d2e21e-b94e-4f4c-894c-05ffc0926aed', '8a9644be-5daf-48b4-b3d1-67eab367e412', 'c2057274-d4bc-49b3-a38d-51b0f0dea322', '91fbe580-7350-4e6d-bb2f-791bb5ff2bc4'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:54:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-5c19f172-ed90-4c55-90fe-f1691acc2121 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:54:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-5c19f172-ed90-4c55-90fe-f1691acc2121 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:54:08 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-5c19f172-ed90-4c55-90fe-f1691acc2121 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:54:08 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-5c19f172-ed90-4c55-90fe-f1691acc2121 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:54:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-5c19f172-ed90-4c55-90fe-f1691acc2121 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:54:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5c19f172-ed90-4c55-90fe-f1691acc2121 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:08 devstack sudo[104256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:54:08 devstack sudo[104256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:08 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-fe8feea0-a6d5-455c-b8a7-95832370f8bc tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Acquiring lock "cinder-945d7d43-87cd-455a-9638-5103bc76c349-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:54:08 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-fe8feea0-a6d5-455c-b8a7-95832370f8bc tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Lock "cinder-945d7d43-87cd-455a-9638-5103bc76c349-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:54:08 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-fe8feea0-a6d5-455c-b8a7-95832370f8bc tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Acquiring lock "cinder-quobyte-945d7d43-87cd-455a-9638-5103bc76c349" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:54:08 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-fe8feea0-a6d5-455c-b8a7-95832370f8bc tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Lock "cinder-quobyte-945d7d43-87cd-455a-9638-5103bc76c349" acquired by "delete_volume" :: waited 0.024s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:54:08 devstack sudo[104256]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5c19f172-ed90-4c55-90fe-f1691acc2121 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.286s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:08 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-5c19f172-ed90-4c55-90fe-f1691acc2121 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:54:08 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-5c19f172-ed90-4c55-90fe-f1691acc2121 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Deleted volume successfully. Sep 04 22:54:08 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[767d9ae3-8ccc-4925-b6ba-af5f5333ea36]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:54:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-fe8feea0-a6d5-455c-b8a7-95832370f8bc tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-945d7d43-87cd-455a-9638-5103bc76c349 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:08 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-5c19f172-ed90-4c55-90fe-f1691acc2121 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Lock "cinder-2e16c721-7a2a-4f94-8153-90cbe9138cee-delete_volume" released by "delete_volume" :: held 1.371s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:54:08 devstack sudo[104260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-945d7d43-87cd-455a-9638-5103bc76c349 Sep 04 22:54:08 devstack sudo[104260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:08 devstack sudo[104260]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-fe8feea0-a6d5-455c-b8a7-95832370f8bc tempest-CreateVolumesFromSourceVolumeTest-978646788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-945d7d43-87cd-455a-9638-5103bc76c349" returned: 0 in 0.450s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-fe8feea0-a6d5-455c-b8a7-95832370f8bc tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-945d7d43-87cd-455a-9638-5103bc76c349 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:08 devstack sudo[104266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-945d7d43-87cd-455a-9638-5103bc76c349 Sep 04 22:54:08 devstack sudo[104266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:09 devstack sudo[104266]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-fe8feea0-a6d5-455c-b8a7-95832370f8bc tempest-CreateVolumesFromSourceVolumeTest-978646788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-945d7d43-87cd-455a-9638-5103bc76c349" returned: 0 in 0.265s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:09 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-fe8feea0-a6d5-455c-b8a7-95832370f8bc tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Lock "cinder-quobyte-945d7d43-87cd-455a-9638-5103bc76c349" released by "delete_volume" :: held 0.772s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:54:09 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-fe8feea0-a6d5-455c-b8a7-95832370f8bc tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Created reservations ['566f1e05-455b-4c50-ac82-087ad9b9bcca', 'ccc92929-99b0-471f-8110-b0bcc30b4f5b', 'bb63fbbb-fdac-40bd-b329-1a84384ea6c3', '9bcfbe51-fadb-4ec2-befb-558a77ec904f'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:54:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-fe8feea0-a6d5-455c-b8a7-95832370f8bc tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:54:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-fe8feea0-a6d5-455c-b8a7-95832370f8bc tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:54:09 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-fe8feea0-a6d5-455c-b8a7-95832370f8bc tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:54:09 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-fe8feea0-a6d5-455c-b8a7-95832370f8bc tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:54:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-fe8feea0-a6d5-455c-b8a7-95832370f8bc tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:54:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-fe8feea0-a6d5-455c-b8a7-95832370f8bc tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:09 devstack sudo[104269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:54:09 devstack sudo[104269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:09 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-25a7c6a8-1c75-4b7a-b639-74ed3c699964 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Acquiring lock "cinder-736eaa45-22cd-4deb-852f-2ef4d0310e24-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:54:09 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-25a7c6a8-1c75-4b7a-b639-74ed3c699964 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Lock "cinder-736eaa45-22cd-4deb-852f-2ef4d0310e24-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:54:09 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-25a7c6a8-1c75-4b7a-b639-74ed3c699964 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Acquiring lock "cinder-quobyte-736eaa45-22cd-4deb-852f-2ef4d0310e24" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:54:09 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-25a7c6a8-1c75-4b7a-b639-74ed3c699964 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Lock "cinder-quobyte-736eaa45-22cd-4deb-852f-2ef4d0310e24" acquired by "delete_volume" :: waited 0.016s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:54:09 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9b4576-dd81-4c45-9f7b-fcb38feda45d]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:54:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-25a7c6a8-1c75-4b7a-b639-74ed3c699964 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-736eaa45-22cd-4deb-852f-2ef4d0310e24 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:09 devstack sudo[104269]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-fe8feea0-a6d5-455c-b8a7-95832370f8bc tempest-CreateVolumesFromSourceVolumeTest-978646788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.256s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:09 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-fe8feea0-a6d5-455c-b8a7-95832370f8bc tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:54:09 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-fe8feea0-a6d5-455c-b8a7-95832370f8bc tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Deleted volume successfully. Sep 04 22:54:09 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-fe8feea0-a6d5-455c-b8a7-95832370f8bc tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Lock "cinder-945d7d43-87cd-455a-9638-5103bc76c349-delete_volume" released by "delete_volume" :: held 1.319s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:54:09 devstack sudo[104272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-736eaa45-22cd-4deb-852f-2ef4d0310e24 Sep 04 22:54:09 devstack sudo[104272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:09 devstack sudo[104272]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-25a7c6a8-1c75-4b7a-b639-74ed3c699964 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-736eaa45-22cd-4deb-852f-2ef4d0310e24" returned: 0 in 0.366s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-25a7c6a8-1c75-4b7a-b639-74ed3c699964 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-736eaa45-22cd-4deb-852f-2ef4d0310e24 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:09 devstack sudo[104277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-736eaa45-22cd-4deb-852f-2ef4d0310e24 Sep 04 22:54:09 devstack sudo[104277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:10 devstack sudo[104277]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-25a7c6a8-1c75-4b7a-b639-74ed3c699964 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-736eaa45-22cd-4deb-852f-2ef4d0310e24" returned: 0 in 0.264s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:10 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-25a7c6a8-1c75-4b7a-b639-74ed3c699964 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Lock "cinder-quobyte-736eaa45-22cd-4deb-852f-2ef4d0310e24" released by "delete_volume" :: held 0.679s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:54:10 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-dae905e2-ae52-482c-941b-feceb42b142d tempest-VolumesActionsTest-1832300490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:54:10 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-dae905e2-ae52-482c-941b-feceb42b142d tempest-VolumesActionsTest-1832300490 None] Flow 'volume_create_manager' (67842440-2c4f-4f25-b04e-1904a3905eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:54:10 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-dae905e2-ae52-482c-941b-feceb42b142d tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef609788-c0bf-41c7-80e3-0249c6c76537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:10 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-dae905e2-ae52-482c-941b-feceb42b142d tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef609788-c0bf-41c7-80e3-0249c6c76537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:54:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-70929542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57401862-6ddc-40f5-a53f-03d16b936571,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d95843e4152441bbbbfbfa2e77795605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:54:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:54:10Z,use_quota=True,user_id='a4b20ec1c95842f4bbf9f2645d24e5fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:10 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-dae905e2-ae52-482c-941b-feceb42b142d tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f928fde2-9cc9-40d9-a304-076a3e9eb5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:10 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-dae905e2-ae52-482c-941b-feceb42b142d tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f928fde2-9cc9-40d9-a304-076a3e9eb5ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:10 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-dae905e2-ae52-482c-941b-feceb42b142d tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (709bd4e9-eac8-42a6-abf9-7cc0fd876f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:10 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-dae905e2-ae52-482c-941b-feceb42b142d tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (709bd4e9-eac8-42a6-abf9-7cc0fd876f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57401862-6ddc-40f5-a53f-03d16b936571', 'volume_name': 'volume-57401862-6ddc-40f5-a53f-03d16b936571', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:10 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-dae905e2-ae52-482c-941b-feceb42b142d tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (233ab528-c208-49ba-9414-b85d36015edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:10 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-dae905e2-ae52-482c-941b-feceb42b142d tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (233ab528-c208-49ba-9414-b85d36015edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:10 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-dae905e2-ae52-482c-941b-feceb42b142d tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cde55e22-69a5-4e44-a341-b83895089bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:10 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-dae905e2-ae52-482c-941b-feceb42b142d tempest-VolumesActionsTest-1832300490 None] Volume 57401862-6ddc-40f5-a53f-03d16b936571: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57401862-6ddc-40f5-a53f-03d16b936571', 'volume_size': 1} Sep 04 22:54:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-dae905e2-ae52-482c-941b-feceb42b142d tempest-VolumesActionsTest-1832300490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:54:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-dae905e2-ae52-482c-941b-feceb42b142d tempest-VolumesActionsTest-1832300490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:54:10 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-dae905e2-ae52-482c-941b-feceb42b142d tempest-VolumesActionsTest-1832300490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:54:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-70929542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57401862-6ddc-40f5-a53f-03d16b936571,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d95843e4152441bbbbfbfa2e77795605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:54:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:54:10Z,use_quota=True,user_id='a4b20ec1c95842f4bbf9f2645d24e5fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:54:10 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-dae905e2-ae52-482c-941b-feceb42b142d tempest-VolumesActionsTest-1832300490 None] Creating volume 57401862-6ddc-40f5-a53f-03d16b936571 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:54:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-dae905e2-ae52-482c-941b-feceb42b142d tempest-VolumesActionsTest-1832300490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:54:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-dae905e2-ae52-482c-941b-feceb42b142d tempest-VolumesActionsTest-1832300490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:54:10 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-dae905e2-ae52-482c-941b-feceb42b142d tempest-VolumesActionsTest-1832300490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:54:10 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-dae905e2-ae52-482c-941b-feceb42b142d tempest-VolumesActionsTest-1832300490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:54:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-dae905e2-ae52-482c-941b-feceb42b142d tempest-VolumesActionsTest-1832300490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:54:10 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-dae905e2-ae52-482c-941b-feceb42b142d tempest-VolumesActionsTest-1832300490 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:54:10 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-dae905e2-ae52-482c-941b-feceb42b142d tempest-VolumesActionsTest-1832300490 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:54:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-dae905e2-ae52-482c-941b-feceb42b142d tempest-VolumesActionsTest-1832300490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-57401862-6ddc-40f5-a53f-03d16b936571 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:10 devstack sudo[104281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-57401862-6ddc-40f5-a53f-03d16b936571 1073741824 Sep 04 22:54:10 devstack sudo[104281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:10 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-25a7c6a8-1c75-4b7a-b639-74ed3c699964 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Created reservations ['f2a5867d-4810-4a37-a625-f66b11752cce', '13048b15-ab04-428a-8060-7210821960cf', '57281c4d-7772-4679-b4f2-8e28afa1ac90', '76bef8c7-715e-4a95-a646-b2d421938301'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:54:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-25a7c6a8-1c75-4b7a-b639-74ed3c699964 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:54:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-25a7c6a8-1c75-4b7a-b639-74ed3c699964 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:54:10 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-25a7c6a8-1c75-4b7a-b639-74ed3c699964 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:54:10 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-25a7c6a8-1c75-4b7a-b639-74ed3c699964 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:54:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-25a7c6a8-1c75-4b7a-b639-74ed3c699964 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:54:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-25a7c6a8-1c75-4b7a-b639-74ed3c699964 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:10 devstack sudo[104283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:54:10 devstack sudo[104283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:10 devstack sudo[104283]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-25a7c6a8-1c75-4b7a-b639-74ed3c699964 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.283s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:10 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-25a7c6a8-1c75-4b7a-b639-74ed3c699964 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:54:10 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-25a7c6a8-1c75-4b7a-b639-74ed3c699964 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Deleted volume successfully. Sep 04 22:54:10 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-25a7c6a8-1c75-4b7a-b639-74ed3c699964 tempest-CreateVolumesFromSourceVolumeTest-978646788 None] Lock "cinder-736eaa45-22cd-4deb-852f-2ef4d0310e24-delete_volume" released by "delete_volume" :: held 1.268s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:54:10 devstack sudo[104281]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-dae905e2-ae52-482c-941b-feceb42b142d tempest-VolumesActionsTest-1832300490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-57401862-6ddc-40f5-a53f-03d16b936571 1073741824" returned: 0 in 0.495s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-dae905e2-ae52-482c-941b-feceb42b142d tempest-VolumesActionsTest-1832300490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-57401862-6ddc-40f5-a53f-03d16b936571 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:10 devstack sudo[104289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-57401862-6ddc-40f5-a53f-03d16b936571 Sep 04 22:54:10 devstack sudo[104289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:11 devstack sudo[104289]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-dae905e2-ae52-482c-941b-feceb42b142d tempest-VolumesActionsTest-1832300490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-57401862-6ddc-40f5-a53f-03d16b936571" returned: 0 in 0.276s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-dae905e2-ae52-482c-941b-feceb42b142d tempest-VolumesActionsTest-1832300490 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:54:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-dae905e2-ae52-482c-941b-feceb42b142d tempest-VolumesActionsTest-1832300490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:54:11 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-dae905e2-ae52-482c-941b-feceb42b142d tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cde55e22-69a5-4e44-a341-b83895089bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57401862-6ddc-40f5-a53f-03d16b936571', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:11 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-dae905e2-ae52-482c-941b-feceb42b142d tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d7af775-b8a3-45d9-b867-5c4e6d981c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:11 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-dae905e2-ae52-482c-941b-feceb42b142d tempest-VolumesActionsTest-1832300490 None] Volume volume-57401862-6ddc-40f5-a53f-03d16b936571 (57401862-6ddc-40f5-a53f-03d16b936571): created successfully Sep 04 22:54:11 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-dae905e2-ae52-482c-941b-feceb42b142d tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d7af775-b8a3-45d9-b867-5c4e6d981c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:11 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-dae905e2-ae52-482c-941b-feceb42b142d tempest-VolumesActionsTest-1832300490 None] Flow 'volume_create_manager' (67842440-2c4f-4f25-b04e-1904a3905eef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:54:11 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-dae905e2-ae52-482c-941b-feceb42b142d tempest-VolumesActionsTest-1832300490 None] Created volume successfully. Sep 04 22:54:11 devstack cinder-volume[87576]: DEBUG oslo_service.periodic_task [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87576) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 22:54:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:54:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:54:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:54:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:54:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:54:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:11 devstack sudo[104292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:54:11 devstack sudo[104292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:12 devstack sudo[104292]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.263s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:12 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:54:12 devstack cinder-volume[87576]: DEBUG oslo_service.periodic_task [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Running periodic task VolumeManager._thread_info {{(pid=87576) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 22:54:12 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] thread count: 28 {{(pid=87576) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 22:54:12 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] thread info: [<_MainThread(MainThread, started 125730416963712)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87576) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 22:54:12 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-cd0b3ae0-fd80-42c0-9796-91a262250979 tempest-VolumesActionsTest-1819649853 None] Acquiring lock "cinder-57401862-6ddc-40f5-a53f-03d16b936571-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:54:12 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-cd0b3ae0-fd80-42c0-9796-91a262250979 tempest-VolumesActionsTest-1819649853 None] Lock "cinder-57401862-6ddc-40f5-a53f-03d16b936571-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:54:12 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-cd0b3ae0-fd80-42c0-9796-91a262250979 tempest-VolumesActionsTest-1819649853 None] Acquiring lock "cinder-quobyte-57401862-6ddc-40f5-a53f-03d16b936571" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:54:12 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-cd0b3ae0-fd80-42c0-9796-91a262250979 tempest-VolumesActionsTest-1819649853 None] Lock "cinder-quobyte-57401862-6ddc-40f5-a53f-03d16b936571" acquired by "delete_volume" :: waited 0.020s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:54:12 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a77955e-6402-4d7c-ba57-dbcfc4a1c807]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:54:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-cd0b3ae0-fd80-42c0-9796-91a262250979 tempest-VolumesActionsTest-1819649853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-57401862-6ddc-40f5-a53f-03d16b936571 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:12 devstack sudo[104295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-57401862-6ddc-40f5-a53f-03d16b936571 Sep 04 22:54:12 devstack sudo[104295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:12 devstack sudo[104295]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-cd0b3ae0-fd80-42c0-9796-91a262250979 tempest-VolumesActionsTest-1819649853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-57401862-6ddc-40f5-a53f-03d16b936571" returned: 0 in 0.374s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-cd0b3ae0-fd80-42c0-9796-91a262250979 tempest-VolumesActionsTest-1819649853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-57401862-6ddc-40f5-a53f-03d16b936571 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:12 devstack sudo[104301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-57401862-6ddc-40f5-a53f-03d16b936571 Sep 04 22:54:12 devstack sudo[104301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:13 devstack sudo[104301]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-cd0b3ae0-fd80-42c0-9796-91a262250979 tempest-VolumesActionsTest-1819649853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-57401862-6ddc-40f5-a53f-03d16b936571" returned: 0 in 0.254s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:13 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-cd0b3ae0-fd80-42c0-9796-91a262250979 tempest-VolumesActionsTest-1819649853 None] Lock "cinder-quobyte-57401862-6ddc-40f5-a53f-03d16b936571" released by "delete_volume" :: held 0.677s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:54:13 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-cd0b3ae0-fd80-42c0-9796-91a262250979 tempest-VolumesActionsTest-1819649853 None] Created reservations ['a78b5a28-3173-4e2a-b9df-b942f79455f5', '3887add6-3d9c-473c-8efa-d68f688ae42c', '3de1e1e2-9b6f-4193-b9ba-6d20235df88b', '59ddc975-fbd5-4cfd-8970-9b56bd8f6ab2'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:54:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-cd0b3ae0-fd80-42c0-9796-91a262250979 tempest-VolumesActionsTest-1819649853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:54:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-cd0b3ae0-fd80-42c0-9796-91a262250979 tempest-VolumesActionsTest-1819649853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:54:13 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-cd0b3ae0-fd80-42c0-9796-91a262250979 tempest-VolumesActionsTest-1819649853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:54:13 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-cd0b3ae0-fd80-42c0-9796-91a262250979 tempest-VolumesActionsTest-1819649853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:54:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-cd0b3ae0-fd80-42c0-9796-91a262250979 tempest-VolumesActionsTest-1819649853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:54:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-cd0b3ae0-fd80-42c0-9796-91a262250979 tempest-VolumesActionsTest-1819649853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:13 devstack sudo[104305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:54:13 devstack sudo[104305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:13 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e2f3e22-e6e6-4c15-ad21-33e9f4853e04 tempest-CinderUnicodeTest-1310483767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:54:13 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6e2f3e22-e6e6-4c15-ad21-33e9f4853e04 tempest-CinderUnicodeTest-1310483767 None] Flow 'volume_create_manager' (e1a1332f-25ad-4604-b887-9b6016190639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:54:13 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6e2f3e22-e6e6-4c15-ad21-33e9f4853e04 tempest-CinderUnicodeTest-1310483767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8861e293-a951-456b-974e-523f74cfc2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:13 devstack sudo[104305]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:13 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6e2f3e22-e6e6-4c15-ad21-33e9f4853e04 tempest-CinderUnicodeTest-1310483767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8861e293-a951-456b-974e-523f74cfc2b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:54:13Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a804568-a5f3-4227-a735-f362c93aa76e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0fd182ab6f94ecab5432db74322c81a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:54:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:54:14Z,use_quota=True,user_id='04d7d510521e40a4bdf8db872cbed771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:13 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6e2f3e22-e6e6-4c15-ad21-33e9f4853e04 tempest-CinderUnicodeTest-1310483767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37ce06ca-0e9d-403d-b103-03e6e465278b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:13 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6e2f3e22-e6e6-4c15-ad21-33e9f4853e04 tempest-CinderUnicodeTest-1310483767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37ce06ca-0e9d-403d-b103-03e6e465278b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:13 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6e2f3e22-e6e6-4c15-ad21-33e9f4853e04 tempest-CinderUnicodeTest-1310483767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eec9534c-6952-47e6-a4da-88a137cf4ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:13 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6e2f3e22-e6e6-4c15-ad21-33e9f4853e04 tempest-CinderUnicodeTest-1310483767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eec9534c-6952-47e6-a4da-88a137cf4ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a804568-a5f3-4227-a735-f362c93aa76e', 'volume_name': 'volume-7a804568-a5f3-4227-a735-f362c93aa76e', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:13 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6e2f3e22-e6e6-4c15-ad21-33e9f4853e04 tempest-CinderUnicodeTest-1310483767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8728d5fa-5bd3-49d1-b50e-4e949a047f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:13 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6e2f3e22-e6e6-4c15-ad21-33e9f4853e04 tempest-CinderUnicodeTest-1310483767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8728d5fa-5bd3-49d1-b50e-4e949a047f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:13 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6e2f3e22-e6e6-4c15-ad21-33e9f4853e04 tempest-CinderUnicodeTest-1310483767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57933219-fcc2-41a7-a10e-449ded768e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:13 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-6e2f3e22-e6e6-4c15-ad21-33e9f4853e04 tempest-CinderUnicodeTest-1310483767 None] Volume 7a804568-a5f3-4227-a735-f362c93aa76e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a804568-a5f3-4227-a735-f362c93aa76e', 'volume_size': 1} Sep 04 22:54:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-6e2f3e22-e6e6-4c15-ad21-33e9f4853e04 tempest-CinderUnicodeTest-1310483767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:54:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-6e2f3e22-e6e6-4c15-ad21-33e9f4853e04 tempest-CinderUnicodeTest-1310483767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:54:13 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-6e2f3e22-e6e6-4c15-ad21-33e9f4853e04 tempest-CinderUnicodeTest-1310483767 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:54:13Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a804568-a5f3-4227-a735-f362c93aa76e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0fd182ab6f94ecab5432db74322c81a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:54:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:54:14Z,use_quota=True,user_id='04d7d510521e40a4bdf8db872cbed771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:54:13 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-6e2f3e22-e6e6-4c15-ad21-33e9f4853e04 tempest-CinderUnicodeTest-1310483767 None] Creating volume 7a804568-a5f3-4227-a735-f362c93aa76e {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:54:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-6e2f3e22-e6e6-4c15-ad21-33e9f4853e04 tempest-CinderUnicodeTest-1310483767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:54:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-6e2f3e22-e6e6-4c15-ad21-33e9f4853e04 tempest-CinderUnicodeTest-1310483767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:54:13 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-6e2f3e22-e6e6-4c15-ad21-33e9f4853e04 tempest-CinderUnicodeTest-1310483767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:54:13 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-6e2f3e22-e6e6-4c15-ad21-33e9f4853e04 tempest-CinderUnicodeTest-1310483767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:54:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-6e2f3e22-e6e6-4c15-ad21-33e9f4853e04 tempest-CinderUnicodeTest-1310483767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:54:13 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-6e2f3e22-e6e6-4c15-ad21-33e9f4853e04 tempest-CinderUnicodeTest-1310483767 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:54:13 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-6e2f3e22-e6e6-4c15-ad21-33e9f4853e04 tempest-CinderUnicodeTest-1310483767 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:54:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-6e2f3e22-e6e6-4c15-ad21-33e9f4853e04 tempest-CinderUnicodeTest-1310483767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7a804568-a5f3-4227-a735-f362c93aa76e 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-cd0b3ae0-fd80-42c0-9796-91a262250979 tempest-VolumesActionsTest-1819649853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.324s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:13 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-cd0b3ae0-fd80-42c0-9796-91a262250979 tempest-VolumesActionsTest-1819649853 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:54:13 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-cd0b3ae0-fd80-42c0-9796-91a262250979 tempest-VolumesActionsTest-1819649853 None] Deleted volume successfully. Sep 04 22:54:13 devstack sudo[104308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7a804568-a5f3-4227-a735-f362c93aa76e 1073741824 Sep 04 22:54:13 devstack sudo[104308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:13 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-cd0b3ae0-fd80-42c0-9796-91a262250979 tempest-VolumesActionsTest-1819649853 None] Lock "cinder-57401862-6ddc-40f5-a53f-03d16b936571-delete_volume" released by "delete_volume" :: held 1.227s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:54:14 devstack sudo[104308]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-6e2f3e22-e6e6-4c15-ad21-33e9f4853e04 tempest-CinderUnicodeTest-1310483767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7a804568-a5f3-4227-a735-f362c93aa76e 1073741824" returned: 0 in 0.460s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:14 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-9491c16a-a233-4138-88f9-13b5bd4671ae tempest-VolumesActionsTest-1832300490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:54:14 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9491c16a-a233-4138-88f9-13b5bd4671ae tempest-VolumesActionsTest-1832300490 None] Flow 'volume_create_manager' (78c7e923-ecda-4049-9091-6897a80e4529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:54:14 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9491c16a-a233-4138-88f9-13b5bd4671ae tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff92e047-5b39-42cb-9c21-fdc1202479c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-6e2f3e22-e6e6-4c15-ad21-33e9f4853e04 tempest-CinderUnicodeTest-1310483767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7a804568-a5f3-4227-a735-f362c93aa76e {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:14 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9491c16a-a233-4138-88f9-13b5bd4671ae tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff92e047-5b39-42cb-9c21-fdc1202479c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:54:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1223508277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c40fde3-9011-4a53-9728-3c577269a822,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d95843e4152441bbbbfbfa2e77795605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:54:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:54:14Z,use_quota=True,user_id='a4b20ec1c95842f4bbf9f2645d24e5fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:14 devstack sudo[104314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7a804568-a5f3-4227-a735-f362c93aa76e Sep 04 22:54:14 devstack sudo[104314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:14 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9491c16a-a233-4138-88f9-13b5bd4671ae tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaa005f7-4e00-4428-8eb6-341672f075a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:14 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9491c16a-a233-4138-88f9-13b5bd4671ae tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaa005f7-4e00-4428-8eb6-341672f075a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:14 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9491c16a-a233-4138-88f9-13b5bd4671ae tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b65dfbb-074b-4831-b050-0c58277419ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:14 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9491c16a-a233-4138-88f9-13b5bd4671ae tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b65dfbb-074b-4831-b050-0c58277419ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c40fde3-9011-4a53-9728-3c577269a822', 'volume_name': 'volume-5c40fde3-9011-4a53-9728-3c577269a822', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:14 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9491c16a-a233-4138-88f9-13b5bd4671ae tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffd39bac-7db8-42b3-a154-d421a5cfa003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:14 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9491c16a-a233-4138-88f9-13b5bd4671ae tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffd39bac-7db8-42b3-a154-d421a5cfa003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:14 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9491c16a-a233-4138-88f9-13b5bd4671ae tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (945b5941-0c4a-4fff-b386-d5ef34643964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:14 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-9491c16a-a233-4138-88f9-13b5bd4671ae tempest-VolumesActionsTest-1832300490 None] Volume 5c40fde3-9011-4a53-9728-3c577269a822: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c40fde3-9011-4a53-9728-3c577269a822', 'volume_size': 1} Sep 04 22:54:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-9491c16a-a233-4138-88f9-13b5bd4671ae tempest-VolumesActionsTest-1832300490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:54:14 devstack sudo[104314]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-6e2f3e22-e6e6-4c15-ad21-33e9f4853e04 tempest-CinderUnicodeTest-1310483767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7a804568-a5f3-4227-a735-f362c93aa76e" returned: 0 in 0.248s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:14 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-6e2f3e22-e6e6-4c15-ad21-33e9f4853e04 tempest-CinderUnicodeTest-1310483767 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:54:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-6e2f3e22-e6e6-4c15-ad21-33e9f4853e04 tempest-CinderUnicodeTest-1310483767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:54:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-9491c16a-a233-4138-88f9-13b5bd4671ae tempest-VolumesActionsTest-1832300490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.192s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:54:14 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-9491c16a-a233-4138-88f9-13b5bd4671ae tempest-VolumesActionsTest-1832300490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:54:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1223508277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c40fde3-9011-4a53-9728-3c577269a822,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d95843e4152441bbbbfbfa2e77795605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:54:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:54:14Z,use_quota=True,user_id='a4b20ec1c95842f4bbf9f2645d24e5fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:54:14 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-9491c16a-a233-4138-88f9-13b5bd4671ae tempest-VolumesActionsTest-1832300490 None] Creating volume 5c40fde3-9011-4a53-9728-3c577269a822 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:54:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-9491c16a-a233-4138-88f9-13b5bd4671ae tempest-VolumesActionsTest-1832300490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:54:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-9491c16a-a233-4138-88f9-13b5bd4671ae tempest-VolumesActionsTest-1832300490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:54:14 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-9491c16a-a233-4138-88f9-13b5bd4671ae tempest-VolumesActionsTest-1832300490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:54:14 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-9491c16a-a233-4138-88f9-13b5bd4671ae tempest-VolumesActionsTest-1832300490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:54:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-9491c16a-a233-4138-88f9-13b5bd4671ae tempest-VolumesActionsTest-1832300490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:54:14 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-9491c16a-a233-4138-88f9-13b5bd4671ae tempest-VolumesActionsTest-1832300490 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:54:14 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-9491c16a-a233-4138-88f9-13b5bd4671ae tempest-VolumesActionsTest-1832300490 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:54:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-9491c16a-a233-4138-88f9-13b5bd4671ae tempest-VolumesActionsTest-1832300490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5c40fde3-9011-4a53-9728-3c577269a822 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:14 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6e2f3e22-e6e6-4c15-ad21-33e9f4853e04 tempest-CinderUnicodeTest-1310483767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57933219-fcc2-41a7-a10e-449ded768e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a804568-a5f3-4227-a735-f362c93aa76e', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:14 devstack sudo[104317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5c40fde3-9011-4a53-9728-3c577269a822 1073741824 Sep 04 22:54:14 devstack sudo[104317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:14 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6e2f3e22-e6e6-4c15-ad21-33e9f4853e04 tempest-CinderUnicodeTest-1310483767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49045ab4-c216-4506-af8a-b8e00300224b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:14 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-6e2f3e22-e6e6-4c15-ad21-33e9f4853e04 tempest-CinderUnicodeTest-1310483767 None] Volume volume-7a804568-a5f3-4227-a735-f362c93aa76e (7a804568-a5f3-4227-a735-f362c93aa76e): created successfully Sep 04 22:54:14 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6e2f3e22-e6e6-4c15-ad21-33e9f4853e04 tempest-CinderUnicodeTest-1310483767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49045ab4-c216-4506-af8a-b8e00300224b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:14 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6e2f3e22-e6e6-4c15-ad21-33e9f4853e04 tempest-CinderUnicodeTest-1310483767 None] Flow 'volume_create_manager' (e1a1332f-25ad-4604-b887-9b6016190639) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:54:14 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-6e2f3e22-e6e6-4c15-ad21-33e9f4853e04 tempest-CinderUnicodeTest-1310483767 None] Created volume successfully. Sep 04 22:54:14 devstack sudo[104317]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-9491c16a-a233-4138-88f9-13b5bd4671ae tempest-VolumesActionsTest-1832300490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5c40fde3-9011-4a53-9728-3c577269a822 1073741824" returned: 0 in 0.416s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-9491c16a-a233-4138-88f9-13b5bd4671ae tempest-VolumesActionsTest-1832300490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5c40fde3-9011-4a53-9728-3c577269a822 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:14 devstack sudo[104323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5c40fde3-9011-4a53-9728-3c577269a822 Sep 04 22:54:14 devstack sudo[104323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:15 devstack sudo[104323]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-9491c16a-a233-4138-88f9-13b5bd4671ae tempest-VolumesActionsTest-1832300490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5c40fde3-9011-4a53-9728-3c577269a822" returned: 0 in 0.262s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:15 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-9491c16a-a233-4138-88f9-13b5bd4671ae tempest-VolumesActionsTest-1832300490 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:54:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-9491c16a-a233-4138-88f9-13b5bd4671ae tempest-VolumesActionsTest-1832300490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.716s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:54:15 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9491c16a-a233-4138-88f9-13b5bd4671ae tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (945b5941-0c4a-4fff-b386-d5ef34643964) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c40fde3-9011-4a53-9728-3c577269a822', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:15 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9491c16a-a233-4138-88f9-13b5bd4671ae tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a38d5c3e-0b4c-4cd8-a2b1-30effc085ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:15 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-9491c16a-a233-4138-88f9-13b5bd4671ae tempest-VolumesActionsTest-1832300490 None] Volume volume-5c40fde3-9011-4a53-9728-3c577269a822 (5c40fde3-9011-4a53-9728-3c577269a822): created successfully Sep 04 22:54:15 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9491c16a-a233-4138-88f9-13b5bd4671ae tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a38d5c3e-0b4c-4cd8-a2b1-30effc085ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:15 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9491c16a-a233-4138-88f9-13b5bd4671ae tempest-VolumesActionsTest-1832300490 None] Flow 'volume_create_manager' (78c7e923-ecda-4049-9091-6897a80e4529) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:54:15 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-9491c16a-a233-4138-88f9-13b5bd4671ae tempest-VolumesActionsTest-1832300490 None] Created volume successfully. Sep 04 22:54:16 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-8361c525-98ed-4154-abd0-7061c12c9f4c tempest-CinderUnicodeTest-1310483767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:54:16 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-8361c525-98ed-4154-abd0-7061c12c9f4c tempest-CinderUnicodeTest-1310483767 None] Flow 'volume_create_manager' (ed69e72d-aa75-456a-8087-f12f87cb002c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:54:16 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-8361c525-98ed-4154-abd0-7061c12c9f4c tempest-CinderUnicodeTest-1310483767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e5fc95a-b693-46e9-94f2-f133d5bbabc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:16 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-8361c525-98ed-4154-abd0-7061c12c9f4c tempest-CinderUnicodeTest-1310483767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e5fc95a-b693-46e9-94f2-f133d5bbabc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:54:16Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-399786950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3689481-53c0-4983-a5f7-2db1fe943a67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0fd182ab6f94ecab5432db74322c81a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:54:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:54:16Z,use_quota=True,user_id='04d7d510521e40a4bdf8db872cbed771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:16 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-8361c525-98ed-4154-abd0-7061c12c9f4c tempest-CinderUnicodeTest-1310483767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ad9cf6a-7d27-4d85-ad0f-fbef09b1e198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:16 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-8361c525-98ed-4154-abd0-7061c12c9f4c tempest-CinderUnicodeTest-1310483767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ad9cf6a-7d27-4d85-ad0f-fbef09b1e198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:16 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-8361c525-98ed-4154-abd0-7061c12c9f4c tempest-CinderUnicodeTest-1310483767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4ec1ef9-79f1-4334-b5f1-2b7c87f9b6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:16 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-8361c525-98ed-4154-abd0-7061c12c9f4c tempest-CinderUnicodeTest-1310483767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4ec1ef9-79f1-4334-b5f1-2b7c87f9b6ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3689481-53c0-4983-a5f7-2db1fe943a67', 'volume_name': 'volume-d3689481-53c0-4983-a5f7-2db1fe943a67', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:16 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-8361c525-98ed-4154-abd0-7061c12c9f4c tempest-CinderUnicodeTest-1310483767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87d2b2db-e673-4da8-adac-12d49f75ae9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:16 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-8361c525-98ed-4154-abd0-7061c12c9f4c tempest-CinderUnicodeTest-1310483767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87d2b2db-e673-4da8-adac-12d49f75ae9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:16 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-8361c525-98ed-4154-abd0-7061c12c9f4c tempest-CinderUnicodeTest-1310483767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5febd118-6de9-4e92-b82c-c094cc6ff4e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:16 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-8361c525-98ed-4154-abd0-7061c12c9f4c tempest-CinderUnicodeTest-1310483767 None] Volume d3689481-53c0-4983-a5f7-2db1fe943a67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3689481-53c0-4983-a5f7-2db1fe943a67', 'volume_size': 1} Sep 04 22:54:16 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-8361c525-98ed-4154-abd0-7061c12c9f4c tempest-CinderUnicodeTest-1310483767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:54:16 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-8361c525-98ed-4154-abd0-7061c12c9f4c tempest-CinderUnicodeTest-1310483767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:54:16 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-8361c525-98ed-4154-abd0-7061c12c9f4c tempest-CinderUnicodeTest-1310483767 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:54:16Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-399786950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3689481-53c0-4983-a5f7-2db1fe943a67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0fd182ab6f94ecab5432db74322c81a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:54:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:54:16Z,use_quota=True,user_id='04d7d510521e40a4bdf8db872cbed771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:54:16 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-8361c525-98ed-4154-abd0-7061c12c9f4c tempest-CinderUnicodeTest-1310483767 None] Creating volume d3689481-53c0-4983-a5f7-2db1fe943a67 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:54:16 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-8361c525-98ed-4154-abd0-7061c12c9f4c tempest-CinderUnicodeTest-1310483767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:54:16 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-8361c525-98ed-4154-abd0-7061c12c9f4c tempest-CinderUnicodeTest-1310483767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:54:16 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-8361c525-98ed-4154-abd0-7061c12c9f4c tempest-CinderUnicodeTest-1310483767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:54:16 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-8361c525-98ed-4154-abd0-7061c12c9f4c tempest-CinderUnicodeTest-1310483767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:54:16 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-8361c525-98ed-4154-abd0-7061c12c9f4c tempest-CinderUnicodeTest-1310483767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:54:16 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-8361c525-98ed-4154-abd0-7061c12c9f4c tempest-CinderUnicodeTest-1310483767 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:54:16 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-8361c525-98ed-4154-abd0-7061c12c9f4c tempest-CinderUnicodeTest-1310483767 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:54:16 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-8361c525-98ed-4154-abd0-7061c12c9f4c tempest-CinderUnicodeTest-1310483767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d3689481-53c0-4983-a5f7-2db1fe943a67 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:16 devstack sudo[104326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d3689481-53c0-4983-a5f7-2db1fe943a67 1073741824 Sep 04 22:54:16 devstack sudo[104326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:16 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-43052a43-f972-4ac5-9e95-3281a9e6ff09 tempest-VolumesActionsTest-1819649853 None] Acquiring lock "cinder-5c40fde3-9011-4a53-9728-3c577269a822-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:54:16 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-43052a43-f972-4ac5-9e95-3281a9e6ff09 tempest-VolumesActionsTest-1819649853 None] Lock "cinder-5c40fde3-9011-4a53-9728-3c577269a822-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:54:16 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-43052a43-f972-4ac5-9e95-3281a9e6ff09 tempest-VolumesActionsTest-1819649853 None] Acquiring lock "cinder-quobyte-5c40fde3-9011-4a53-9728-3c577269a822" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:54:16 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-43052a43-f972-4ac5-9e95-3281a9e6ff09 tempest-VolumesActionsTest-1819649853 None] Lock "cinder-quobyte-5c40fde3-9011-4a53-9728-3c577269a822" acquired by "delete_volume" :: waited 0.019s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:54:16 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d363f1-eceb-44a8-a19e-b8b1698e8756]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:54:16 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-43052a43-f972-4ac5-9e95-3281a9e6ff09 tempest-VolumesActionsTest-1819649853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5c40fde3-9011-4a53-9728-3c577269a822 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:16 devstack sudo[104331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5c40fde3-9011-4a53-9728-3c577269a822 Sep 04 22:54:16 devstack sudo[104331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:16 devstack sudo[104326]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:16 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-8361c525-98ed-4154-abd0-7061c12c9f4c tempest-CinderUnicodeTest-1310483767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d3689481-53c0-4983-a5f7-2db1fe943a67 1073741824" returned: 0 in 0.439s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:16 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-8361c525-98ed-4154-abd0-7061c12c9f4c tempest-CinderUnicodeTest-1310483767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d3689481-53c0-4983-a5f7-2db1fe943a67 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:16 devstack sudo[104334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d3689481-53c0-4983-a5f7-2db1fe943a67 Sep 04 22:54:16 devstack sudo[104334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:16 devstack sudo[104331]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:16 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-43052a43-f972-4ac5-9e95-3281a9e6ff09 tempest-VolumesActionsTest-1819649853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5c40fde3-9011-4a53-9728-3c577269a822" returned: 0 in 0.419s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:16 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-43052a43-f972-4ac5-9e95-3281a9e6ff09 tempest-VolumesActionsTest-1819649853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5c40fde3-9011-4a53-9728-3c577269a822 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:16 devstack sudo[104340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5c40fde3-9011-4a53-9728-3c577269a822 Sep 04 22:54:16 devstack sudo[104340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:16 devstack sudo[104334]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:16 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-8361c525-98ed-4154-abd0-7061c12c9f4c tempest-CinderUnicodeTest-1310483767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d3689481-53c0-4983-a5f7-2db1fe943a67" returned: 0 in 0.282s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:16 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-8361c525-98ed-4154-abd0-7061c12c9f4c tempest-CinderUnicodeTest-1310483767 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:54:16 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-8361c525-98ed-4154-abd0-7061c12c9f4c tempest-CinderUnicodeTest-1310483767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:54:16 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-8361c525-98ed-4154-abd0-7061c12c9f4c tempest-CinderUnicodeTest-1310483767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5febd118-6de9-4e92-b82c-c094cc6ff4e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3689481-53c0-4983-a5f7-2db1fe943a67', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:16 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-8361c525-98ed-4154-abd0-7061c12c9f4c tempest-CinderUnicodeTest-1310483767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0bddc29-4877-47b6-af0c-4166bb56153f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:17 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-8361c525-98ed-4154-abd0-7061c12c9f4c tempest-CinderUnicodeTest-1310483767 None] Volume volume-d3689481-53c0-4983-a5f7-2db1fe943a67 (d3689481-53c0-4983-a5f7-2db1fe943a67): created successfully Sep 04 22:54:17 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-8361c525-98ed-4154-abd0-7061c12c9f4c tempest-CinderUnicodeTest-1310483767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0bddc29-4877-47b6-af0c-4166bb56153f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:17 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-8361c525-98ed-4154-abd0-7061c12c9f4c tempest-CinderUnicodeTest-1310483767 None] Flow 'volume_create_manager' (ed69e72d-aa75-456a-8087-f12f87cb002c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:54:17 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-8361c525-98ed-4154-abd0-7061c12c9f4c tempest-CinderUnicodeTest-1310483767 None] Created volume successfully. Sep 04 22:54:17 devstack sudo[104340]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-43052a43-f972-4ac5-9e95-3281a9e6ff09 tempest-VolumesActionsTest-1819649853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5c40fde3-9011-4a53-9728-3c577269a822" returned: 0 in 0.271s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:17 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-43052a43-f972-4ac5-9e95-3281a9e6ff09 tempest-VolumesActionsTest-1819649853 None] Lock "cinder-quobyte-5c40fde3-9011-4a53-9728-3c577269a822" released by "delete_volume" :: held 0.727s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:54:17 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-43052a43-f972-4ac5-9e95-3281a9e6ff09 tempest-VolumesActionsTest-1819649853 None] Created reservations ['77460db3-f153-4af3-bc93-fcf2c20cb0d1', 'b537fa89-541b-4066-b9be-c7797d5f837e', '62a3b319-0487-4342-85f3-19f4e543ed90', '9f612c9e-22f0-4fc6-936e-4fa19b4b6b9e'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:54:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-43052a43-f972-4ac5-9e95-3281a9e6ff09 tempest-VolumesActionsTest-1819649853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:54:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-43052a43-f972-4ac5-9e95-3281a9e6ff09 tempest-VolumesActionsTest-1819649853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:54:17 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-43052a43-f972-4ac5-9e95-3281a9e6ff09 tempest-VolumesActionsTest-1819649853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:54:17 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-43052a43-f972-4ac5-9e95-3281a9e6ff09 tempest-VolumesActionsTest-1819649853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:54:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-43052a43-f972-4ac5-9e95-3281a9e6ff09 tempest-VolumesActionsTest-1819649853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:54:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-43052a43-f972-4ac5-9e95-3281a9e6ff09 tempest-VolumesActionsTest-1819649853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:17 devstack sudo[104343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:54:17 devstack sudo[104343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:17 devstack sudo[104343]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-43052a43-f972-4ac5-9e95-3281a9e6ff09 tempest-VolumesActionsTest-1819649853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.252s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:17 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-43052a43-f972-4ac5-9e95-3281a9e6ff09 tempest-VolumesActionsTest-1819649853 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:54:17 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-43052a43-f972-4ac5-9e95-3281a9e6ff09 tempest-VolumesActionsTest-1819649853 None] Deleted volume successfully. Sep 04 22:54:17 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-43052a43-f972-4ac5-9e95-3281a9e6ff09 tempest-VolumesActionsTest-1819649853 None] Lock "cinder-5c40fde3-9011-4a53-9728-3c577269a822-delete_volume" released by "delete_volume" :: held 1.177s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:54:18 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-08ba1ffa-e148-43b5-97b7-f017c00cdc0b tempest-VolumesActionsTest-1832300490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:54:18 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-08ba1ffa-e148-43b5-97b7-f017c00cdc0b tempest-VolumesActionsTest-1832300490 None] Flow 'volume_create_manager' (c969c874-320b-4e01-bb9f-3b7b3e824a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:54:18 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-08ba1ffa-e148-43b5-97b7-f017c00cdc0b tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5dc107b-fd90-46c1-8fe5-9657bbea203c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:18 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-08ba1ffa-e148-43b5-97b7-f017c00cdc0b tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5dc107b-fd90-46c1-8fe5-9657bbea203c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:54:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-972102674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caf8f482-b3ba-4329-8bcb-e425a78341e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d95843e4152441bbbbfbfa2e77795605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:54:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:54:18Z,use_quota=True,user_id='a4b20ec1c95842f4bbf9f2645d24e5fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:18 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-08ba1ffa-e148-43b5-97b7-f017c00cdc0b tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (491370ac-5e24-463f-aaec-e9bd6bbb68c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:18 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-08ba1ffa-e148-43b5-97b7-f017c00cdc0b tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (491370ac-5e24-463f-aaec-e9bd6bbb68c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:18 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-08ba1ffa-e148-43b5-97b7-f017c00cdc0b tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38ef30e3-bcd3-410b-a926-90ffe2f042e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:18 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-08ba1ffa-e148-43b5-97b7-f017c00cdc0b tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38ef30e3-bcd3-410b-a926-90ffe2f042e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'caf8f482-b3ba-4329-8bcb-e425a78341e6', 'volume_name': 'volume-caf8f482-b3ba-4329-8bcb-e425a78341e6', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:18 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-08ba1ffa-e148-43b5-97b7-f017c00cdc0b tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (857dea7f-06bb-4870-aa34-8d25bdc096e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:18 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-08ba1ffa-e148-43b5-97b7-f017c00cdc0b tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (857dea7f-06bb-4870-aa34-8d25bdc096e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:18 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-08ba1ffa-e148-43b5-97b7-f017c00cdc0b tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (befce6da-7b57-4d36-9213-ddd38eef260e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:18 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-08ba1ffa-e148-43b5-97b7-f017c00cdc0b tempest-VolumesActionsTest-1832300490 None] Volume caf8f482-b3ba-4329-8bcb-e425a78341e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-caf8f482-b3ba-4329-8bcb-e425a78341e6', 'volume_size': 1} Sep 04 22:54:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-08ba1ffa-e148-43b5-97b7-f017c00cdc0b tempest-VolumesActionsTest-1832300490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:54:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-08ba1ffa-e148-43b5-97b7-f017c00cdc0b tempest-VolumesActionsTest-1832300490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:54:18 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-08ba1ffa-e148-43b5-97b7-f017c00cdc0b tempest-VolumesActionsTest-1832300490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:54:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-972102674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caf8f482-b3ba-4329-8bcb-e425a78341e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d95843e4152441bbbbfbfa2e77795605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:54:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:54:18Z,use_quota=True,user_id='a4b20ec1c95842f4bbf9f2645d24e5fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:54:18 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-08ba1ffa-e148-43b5-97b7-f017c00cdc0b tempest-VolumesActionsTest-1832300490 None] Creating volume caf8f482-b3ba-4329-8bcb-e425a78341e6 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:54:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-08ba1ffa-e148-43b5-97b7-f017c00cdc0b tempest-VolumesActionsTest-1832300490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:54:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-08ba1ffa-e148-43b5-97b7-f017c00cdc0b tempest-VolumesActionsTest-1832300490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:54:18 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-08ba1ffa-e148-43b5-97b7-f017c00cdc0b tempest-VolumesActionsTest-1832300490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:54:18 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-08ba1ffa-e148-43b5-97b7-f017c00cdc0b tempest-VolumesActionsTest-1832300490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:54:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-08ba1ffa-e148-43b5-97b7-f017c00cdc0b tempest-VolumesActionsTest-1832300490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:54:18 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-08ba1ffa-e148-43b5-97b7-f017c00cdc0b tempest-VolumesActionsTest-1832300490 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:54:18 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-08ba1ffa-e148-43b5-97b7-f017c00cdc0b tempest-VolumesActionsTest-1832300490 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:54:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-08ba1ffa-e148-43b5-97b7-f017c00cdc0b tempest-VolumesActionsTest-1832300490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-caf8f482-b3ba-4329-8bcb-e425a78341e6 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:18 devstack sudo[104346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-caf8f482-b3ba-4329-8bcb-e425a78341e6 1073741824 Sep 04 22:54:18 devstack sudo[104346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-01e1c86a-3537-4e19-9a7d-2c7357a43447 tempest-CinderUnicodeTest-1310483767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:54:18 devstack sudo[104346]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-08ba1ffa-e148-43b5-97b7-f017c00cdc0b tempest-VolumesActionsTest-1832300490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-caf8f482-b3ba-4329-8bcb-e425a78341e6 1073741824" returned: 0 in 0.413s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-08ba1ffa-e148-43b5-97b7-f017c00cdc0b tempest-VolumesActionsTest-1832300490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-caf8f482-b3ba-4329-8bcb-e425a78341e6 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:18 devstack sudo[104352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-caf8f482-b3ba-4329-8bcb-e425a78341e6 Sep 04 22:54:18 devstack sudo[104352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:18 devstack sudo[104352]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-08ba1ffa-e148-43b5-97b7-f017c00cdc0b tempest-VolumesActionsTest-1832300490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-caf8f482-b3ba-4329-8bcb-e425a78341e6" returned: 0 in 0.266s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:18 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-08ba1ffa-e148-43b5-97b7-f017c00cdc0b tempest-VolumesActionsTest-1832300490 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:54:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-08ba1ffa-e148-43b5-97b7-f017c00cdc0b tempest-VolumesActionsTest-1832300490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:54:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-01e1c86a-3537-4e19-9a7d-2c7357a43447 tempest-CinderUnicodeTest-1310483767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.544s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:54:18 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-08ba1ffa-e148-43b5-97b7-f017c00cdc0b tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (befce6da-7b57-4d36-9213-ddd38eef260e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-caf8f482-b3ba-4329-8bcb-e425a78341e6', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:18 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-08ba1ffa-e148-43b5-97b7-f017c00cdc0b tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2451e61f-bfab-4c8c-af27-95b25c79eb45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:18 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-01e1c86a-3537-4e19-9a7d-2c7357a43447 tempest-CinderUnicodeTest-1310483767 None] Creating offline snapshot 8ab0db42-e8df-46fb-a22b-a4b26355d172 of volume d3689481-53c0-4983-a5f7-2db1fe943a67 {{(pid=87576) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 22:54:19 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-08ba1ffa-e148-43b5-97b7-f017c00cdc0b tempest-VolumesActionsTest-1832300490 None] Volume volume-caf8f482-b3ba-4329-8bcb-e425a78341e6 (caf8f482-b3ba-4329-8bcb-e425a78341e6): created successfully Sep 04 22:54:19 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-08ba1ffa-e148-43b5-97b7-f017c00cdc0b tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2451e61f-bfab-4c8c-af27-95b25c79eb45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:19 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-08ba1ffa-e148-43b5-97b7-f017c00cdc0b tempest-VolumesActionsTest-1832300490 None] Flow 'volume_create_manager' (c969c874-320b-4e01-bb9f-3b7b3e824a18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:54:19 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3011ae5-befb-42df-a262-94242a80a399]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:54:19 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-01e1c86a-3537-4e19-9a7d-2c7357a43447 tempest-CinderUnicodeTest-1310483767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d3689481-53c0-4983-a5f7-2db1fe943a67 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:19 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-08ba1ffa-e148-43b5-97b7-f017c00cdc0b tempest-VolumesActionsTest-1832300490 None] Created volume successfully. Sep 04 22:54:19 devstack sudo[104355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d3689481-53c0-4983-a5f7-2db1fe943a67 Sep 04 22:54:19 devstack sudo[104355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:19 devstack sudo[104355]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:19 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-01e1c86a-3537-4e19-9a7d-2c7357a43447 tempest-CinderUnicodeTest-1310483767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d3689481-53c0-4983-a5f7-2db1fe943a67" returned: 0 in 0.351s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:19 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-01e1c86a-3537-4e19-9a7d-2c7357a43447 tempest-CinderUnicodeTest-1310483767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d3689481-53c0-4983-a5f7-2db1fe943a67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d3689481-53c0-4983-a5f7-2db1fe943a67.8ab0db42-e8df-46fb-a22b-a4b26355d172 1G {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:19 devstack sudo[104360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d3689481-53c0-4983-a5f7-2db1fe943a67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d3689481-53c0-4983-a5f7-2db1fe943a67.8ab0db42-e8df-46fb-a22b-a4b26355d172 1G Sep 04 22:54:19 devstack sudo[104360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:19 devstack sudo[104360]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:19 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-01e1c86a-3537-4e19-9a7d-2c7357a43447 tempest-CinderUnicodeTest-1310483767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d3689481-53c0-4983-a5f7-2db1fe943a67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d3689481-53c0-4983-a5f7-2db1fe943a67.8ab0db42-e8df-46fb-a22b-a4b26355d172 1G" returned: 0 in 0.393s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:19 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-01e1c86a-3537-4e19-9a7d-2c7357a43447 tempest-CinderUnicodeTest-1310483767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3689481-53c0-4983-a5f7-2db1fe943a67 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d3689481-53c0-4983-a5f7-2db1fe943a67.8ab0db42-e8df-46fb-a22b-a4b26355d172 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:19 devstack sudo[104366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3689481-53c0-4983-a5f7-2db1fe943a67 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d3689481-53c0-4983-a5f7-2db1fe943a67.8ab0db42-e8df-46fb-a22b-a4b26355d172 Sep 04 22:54:19 devstack sudo[104366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:20 devstack sudo[104366]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-01e1c86a-3537-4e19-9a7d-2c7357a43447 tempest-CinderUnicodeTest-1310483767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3689481-53c0-4983-a5f7-2db1fe943a67 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d3689481-53c0-4983-a5f7-2db1fe943a67.8ab0db42-e8df-46fb-a22b-a4b26355d172" returned: 0 in 0.301s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:20 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-01e1c86a-3537-4e19-9a7d-2c7357a43447 tempest-CinderUnicodeTest-1310483767 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d3689481-53c0-4983-a5f7-2db1fe943a67.8ab0db42-e8df-46fb-a22b-a4b26355d172 is being set with open permissions: ugo+rw Sep 04 22:54:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-01e1c86a-3537-4e19-9a7d-2c7357a43447 tempest-CinderUnicodeTest-1310483767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d3689481-53c0-4983-a5f7-2db1fe943a67.8ab0db42-e8df-46fb-a22b-a4b26355d172 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:20 devstack sudo[104371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d3689481-53c0-4983-a5f7-2db1fe943a67.8ab0db42-e8df-46fb-a22b-a4b26355d172 Sep 04 22:54:20 devstack sudo[104371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:20 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-897e7bf8-67f4-477a-a03e-d6fd6a472ee8 tempest-VolumesActionsTest-1819649853 None] Acquiring lock "cinder-caf8f482-b3ba-4329-8bcb-e425a78341e6-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:54:20 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-897e7bf8-67f4-477a-a03e-d6fd6a472ee8 tempest-VolumesActionsTest-1819649853 None] Lock "cinder-caf8f482-b3ba-4329-8bcb-e425a78341e6-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:54:20 devstack sudo[104371]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:20 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-897e7bf8-67f4-477a-a03e-d6fd6a472ee8 tempest-VolumesActionsTest-1819649853 None] Acquiring lock "cinder-quobyte-caf8f482-b3ba-4329-8bcb-e425a78341e6" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:54:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-01e1c86a-3537-4e19-9a7d-2c7357a43447 tempest-CinderUnicodeTest-1310483767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d3689481-53c0-4983-a5f7-2db1fe943a67.8ab0db42-e8df-46fb-a22b-a4b26355d172" returned: 0 in 0.272s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:20 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-897e7bf8-67f4-477a-a03e-d6fd6a472ee8 tempest-VolumesActionsTest-1819649853 None] Lock "cinder-quobyte-caf8f482-b3ba-4329-8bcb-e425a78341e6" acquired by "delete_volume" :: waited 0.019s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:54:20 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c2de86-f9b6-4c7e-930e-7e908830b8f5]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:54:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-897e7bf8-67f4-477a-a03e-d6fd6a472ee8 tempest-VolumesActionsTest-1819649853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-caf8f482-b3ba-4329-8bcb-e425a78341e6 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-01e1c86a-3537-4e19-9a7d-2c7357a43447 tempest-CinderUnicodeTest-1310483767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d3689481-53c0-4983-a5f7-2db1fe943a67.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:20 devstack sudo[104375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d3689481-53c0-4983-a5f7-2db1fe943a67.info Sep 04 22:54:20 devstack sudo[104375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:20 devstack sudo[104374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-caf8f482-b3ba-4329-8bcb-e425a78341e6 Sep 04 22:54:20 devstack sudo[104374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:20 devstack sudo[104375]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-01e1c86a-3537-4e19-9a7d-2c7357a43447 tempest-CinderUnicodeTest-1310483767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d3689481-53c0-4983-a5f7-2db1fe943a67.info" returned: 0 in 0.281s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:20 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-01e1c86a-3537-4e19-9a7d-2c7357a43447 tempest-CinderUnicodeTest-1310483767 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d3689481-53c0-4983-a5f7-2db1fe943a67.info is being set with open permissions: ugo+rw Sep 04 22:54:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-01e1c86a-3537-4e19-9a7d-2c7357a43447 tempest-CinderUnicodeTest-1310483767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d3689481-53c0-4983-a5f7-2db1fe943a67.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:20 devstack sudo[104381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d3689481-53c0-4983-a5f7-2db1fe943a67.info Sep 04 22:54:20 devstack sudo[104381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:20 devstack sudo[104374]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-897e7bf8-67f4-477a-a03e-d6fd6a472ee8 tempest-VolumesActionsTest-1819649853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-caf8f482-b3ba-4329-8bcb-e425a78341e6" returned: 0 in 0.378s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-897e7bf8-67f4-477a-a03e-d6fd6a472ee8 tempest-VolumesActionsTest-1819649853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-caf8f482-b3ba-4329-8bcb-e425a78341e6 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:20 devstack sudo[104385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-caf8f482-b3ba-4329-8bcb-e425a78341e6 Sep 04 22:54:20 devstack sudo[104385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:20 devstack sudo[104381]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-01e1c86a-3537-4e19-9a7d-2c7357a43447 tempest-CinderUnicodeTest-1310483767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d3689481-53c0-4983-a5f7-2db1fe943a67.info" returned: 0 in 0.268s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-01e1c86a-3537-4e19-9a7d-2c7357a43447 tempest-CinderUnicodeTest-1310483767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.007s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:54:20 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-01e1c86a-3537-4e19-9a7d-2c7357a43447 tempest-CinderUnicodeTest-1310483767 None] Create snapshot completed successfully Sep 04 22:54:21 devstack sudo[104385]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-897e7bf8-67f4-477a-a03e-d6fd6a472ee8 tempest-VolumesActionsTest-1819649853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-caf8f482-b3ba-4329-8bcb-e425a78341e6" returned: 0 in 0.281s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:21 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-897e7bf8-67f4-477a-a03e-d6fd6a472ee8 tempest-VolumesActionsTest-1819649853 None] Lock "cinder-quobyte-caf8f482-b3ba-4329-8bcb-e425a78341e6" released by "delete_volume" :: held 0.697s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:54:21 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-897e7bf8-67f4-477a-a03e-d6fd6a472ee8 tempest-VolumesActionsTest-1819649853 None] Created reservations ['b214c04c-1756-4ac1-9259-61aa499f06db', 'de3a34f5-574d-41b8-8d52-9d92c343fadc', '1c88fb6c-cfda-4599-a4bb-9d7cd398e2d5', '78c07a47-ed8f-4046-897b-f9aa9ce88c57'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:54:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-897e7bf8-67f4-477a-a03e-d6fd6a472ee8 tempest-VolumesActionsTest-1819649853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:54:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-897e7bf8-67f4-477a-a03e-d6fd6a472ee8 tempest-VolumesActionsTest-1819649853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:54:21 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-897e7bf8-67f4-477a-a03e-d6fd6a472ee8 tempest-VolumesActionsTest-1819649853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:54:21 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-897e7bf8-67f4-477a-a03e-d6fd6a472ee8 tempest-VolumesActionsTest-1819649853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:54:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-897e7bf8-67f4-477a-a03e-d6fd6a472ee8 tempest-VolumesActionsTest-1819649853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:54:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-897e7bf8-67f4-477a-a03e-d6fd6a472ee8 tempest-VolumesActionsTest-1819649853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:21 devstack sudo[104389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:54:21 devstack sudo[104389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:21 devstack sudo[104389]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-897e7bf8-67f4-477a-a03e-d6fd6a472ee8 tempest-VolumesActionsTest-1819649853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.246s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:21 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-897e7bf8-67f4-477a-a03e-d6fd6a472ee8 tempest-VolumesActionsTest-1819649853 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:54:21 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-897e7bf8-67f4-477a-a03e-d6fd6a472ee8 tempest-VolumesActionsTest-1819649853 None] Deleted volume successfully. Sep 04 22:54:21 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-897e7bf8-67f4-477a-a03e-d6fd6a472ee8 tempest-VolumesActionsTest-1819649853 None] Lock "cinder-caf8f482-b3ba-4329-8bcb-e425a78341e6-delete_volume" released by "delete_volume" :: held 1.153s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:54:21 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-9609f65a-27e7-4d91-86da-c6f425675596 tempest-CinderUnicodeTest-1310483767 None] Acquiring lock "cinder-8ab0db42-e8df-46fb-a22b-a4b26355d172-delete_snapshot" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:54:21 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-9609f65a-27e7-4d91-86da-c6f425675596 tempest-CinderUnicodeTest-1310483767 None] Lock "cinder-8ab0db42-e8df-46fb-a22b-a4b26355d172-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:54:21 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-9609f65a-27e7-4d91-86da-c6f425675596 tempest-CinderUnicodeTest-1310483767 None] Acquiring lock "cinder-quobyte-d3689481-53c0-4983-a5f7-2db1fe943a67" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:54:21 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-9609f65a-27e7-4d91-86da-c6f425675596 tempest-CinderUnicodeTest-1310483767 None] Lock "cinder-quobyte-d3689481-53c0-4983-a5f7-2db1fe943a67" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:54:21 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-9609f65a-27e7-4d91-86da-c6f425675596 tempest-CinderUnicodeTest-1310483767 None] Acquiring lock "cinder-quobyte-8ab0db42-e8df-46fb-a22b-a4b26355d172" by "_delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:54:21 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-9609f65a-27e7-4d91-86da-c6f425675596 tempest-CinderUnicodeTest-1310483767 None] Lock "cinder-quobyte-8ab0db42-e8df-46fb-a22b-a4b26355d172" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:54:21 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-9609f65a-27e7-4d91-86da-c6f425675596 tempest-CinderUnicodeTest-1310483767 None] Deleting offline snapshot 8ab0db42-e8df-46fb-a22b-a4b26355d172 of volume d3689481-53c0-4983-a5f7-2db1fe943a67 {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 22:54:21 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-9609f65a-27e7-4d91-86da-c6f425675596 tempest-CinderUnicodeTest-1310483767 None] snapshot_file for this snap is: volume-d3689481-53c0-4983-a5f7-2db1fe943a67.8ab0db42-e8df-46fb-a22b-a4b26355d172 {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 22:54:21 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7458668-489f-41b7-8a17-4ea0d23b4206]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:54:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-9609f65a-27e7-4d91-86da-c6f425675596 tempest-CinderUnicodeTest-1310483767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d3689481-53c0-4983-a5f7-2db1fe943a67.8ab0db42-e8df-46fb-a22b-a4b26355d172 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:21 devstack sudo[104392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d3689481-53c0-4983-a5f7-2db1fe943a67.8ab0db42-e8df-46fb-a22b-a4b26355d172 Sep 04 22:54:21 devstack sudo[104392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:21 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-719a9a1a-d3e9-4fb3-a719-716661d09c6f tempest-VolumesActionsTest-1832300490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:54:21 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-719a9a1a-d3e9-4fb3-a719-716661d09c6f tempest-VolumesActionsTest-1832300490 None] Flow 'volume_create_manager' (36c96d44-04d2-447a-ab8e-f0ba69cefb09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:54:21 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-719a9a1a-d3e9-4fb3-a719-716661d09c6f tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3736e51-1624-4bf6-8cde-e70a123772ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:22 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-719a9a1a-d3e9-4fb3-a719-716661d09c6f tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3736e51-1624-4bf6-8cde-e70a123772ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:54:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1791925999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3ec120e-353b-47cf-9068-3491bc663595,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d95843e4152441bbbbfbfa2e77795605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:54:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:54:22Z,use_quota=True,user_id='a4b20ec1c95842f4bbf9f2645d24e5fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:22 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-719a9a1a-d3e9-4fb3-a719-716661d09c6f tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6e63abe-a337-4041-a0ff-60211cd9918c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:22 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-719a9a1a-d3e9-4fb3-a719-716661d09c6f tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6e63abe-a337-4041-a0ff-60211cd9918c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:22 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-719a9a1a-d3e9-4fb3-a719-716661d09c6f tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e6a32f4-8053-4a86-89ad-13ca09396719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:22 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-719a9a1a-d3e9-4fb3-a719-716661d09c6f tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e6a32f4-8053-4a86-89ad-13ca09396719) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3ec120e-353b-47cf-9068-3491bc663595', 'volume_name': 'volume-b3ec120e-353b-47cf-9068-3491bc663595', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:22 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-719a9a1a-d3e9-4fb3-a719-716661d09c6f tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73f0f195-d841-4d4b-b166-6b0575739c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:22 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-719a9a1a-d3e9-4fb3-a719-716661d09c6f tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73f0f195-d841-4d4b-b166-6b0575739c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:22 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-719a9a1a-d3e9-4fb3-a719-716661d09c6f tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08273ccc-78eb-4291-8790-72abdc5fecf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:22 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-719a9a1a-d3e9-4fb3-a719-716661d09c6f tempest-VolumesActionsTest-1832300490 None] Volume b3ec120e-353b-47cf-9068-3491bc663595: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3ec120e-353b-47cf-9068-3491bc663595', 'volume_size': 1} Sep 04 22:54:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-719a9a1a-d3e9-4fb3-a719-716661d09c6f tempest-VolumesActionsTest-1832300490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:54:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-719a9a1a-d3e9-4fb3-a719-716661d09c6f tempest-VolumesActionsTest-1832300490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:54:22 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-719a9a1a-d3e9-4fb3-a719-716661d09c6f tempest-VolumesActionsTest-1832300490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:54:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1791925999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3ec120e-353b-47cf-9068-3491bc663595,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d95843e4152441bbbbfbfa2e77795605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:54:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:54:22Z,use_quota=True,user_id='a4b20ec1c95842f4bbf9f2645d24e5fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:54:22 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-719a9a1a-d3e9-4fb3-a719-716661d09c6f tempest-VolumesActionsTest-1832300490 None] Creating volume b3ec120e-353b-47cf-9068-3491bc663595 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:54:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-719a9a1a-d3e9-4fb3-a719-716661d09c6f tempest-VolumesActionsTest-1832300490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:54:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-719a9a1a-d3e9-4fb3-a719-716661d09c6f tempest-VolumesActionsTest-1832300490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:54:22 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-719a9a1a-d3e9-4fb3-a719-716661d09c6f tempest-VolumesActionsTest-1832300490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:54:22 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-719a9a1a-d3e9-4fb3-a719-716661d09c6f tempest-VolumesActionsTest-1832300490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:54:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-719a9a1a-d3e9-4fb3-a719-716661d09c6f tempest-VolumesActionsTest-1832300490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:54:22 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-719a9a1a-d3e9-4fb3-a719-716661d09c6f tempest-VolumesActionsTest-1832300490 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:54:22 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-719a9a1a-d3e9-4fb3-a719-716661d09c6f tempest-VolumesActionsTest-1832300490 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:54:22 devstack sudo[104392]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-719a9a1a-d3e9-4fb3-a719-716661d09c6f tempest-VolumesActionsTest-1832300490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b3ec120e-353b-47cf-9068-3491bc663595 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-9609f65a-27e7-4d91-86da-c6f425675596 tempest-CinderUnicodeTest-1310483767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d3689481-53c0-4983-a5f7-2db1fe943a67.8ab0db42-e8df-46fb-a22b-a4b26355d172" returned: 0 in 0.393s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:22 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-9609f65a-27e7-4d91-86da-c6f425675596 tempest-CinderUnicodeTest-1310483767 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3689481-53c0-4983-a5f7-2db1fe943a67(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 22:54:22 devstack sudo[104398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b3ec120e-353b-47cf-9068-3491bc663595 1073741824 Sep 04 22:54:22 devstack sudo[104398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:22 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[322fabdb-5dd4-4bab-aa58-951da7ac3559]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:54:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-9609f65a-27e7-4d91-86da-c6f425675596 tempest-CinderUnicodeTest-1310483767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d3689481-53c0-4983-a5f7-2db1fe943a67 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:22 devstack sudo[104400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d3689481-53c0-4983-a5f7-2db1fe943a67 Sep 04 22:54:22 devstack sudo[104400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:22 devstack sudo[104398]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-719a9a1a-d3e9-4fb3-a719-716661d09c6f tempest-VolumesActionsTest-1832300490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b3ec120e-353b-47cf-9068-3491bc663595 1073741824" returned: 0 in 0.443s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:22 devstack sudo[104400]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-9609f65a-27e7-4d91-86da-c6f425675596 tempest-CinderUnicodeTest-1310483767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d3689481-53c0-4983-a5f7-2db1fe943a67" returned: 0 in 0.411s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-9609f65a-27e7-4d91-86da-c6f425675596 tempest-CinderUnicodeTest-1310483767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d3689481-53c0-4983-a5f7-2db1fe943a67.8ab0db42-e8df-46fb-a22b-a4b26355d172 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:22 devstack sudo[104408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d3689481-53c0-4983-a5f7-2db1fe943a67.8ab0db42-e8df-46fb-a22b-a4b26355d172 Sep 04 22:54:22 devstack sudo[104408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-719a9a1a-d3e9-4fb3-a719-716661d09c6f tempest-VolumesActionsTest-1832300490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b3ec120e-353b-47cf-9068-3491bc663595 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:22 devstack sudo[104410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b3ec120e-353b-47cf-9068-3491bc663595 Sep 04 22:54:22 devstack sudo[104410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:22 devstack sudo[104410]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-719a9a1a-d3e9-4fb3-a719-716661d09c6f tempest-VolumesActionsTest-1832300490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b3ec120e-353b-47cf-9068-3491bc663595" returned: 0 in 0.273s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:22 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-719a9a1a-d3e9-4fb3-a719-716661d09c6f tempest-VolumesActionsTest-1832300490 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:54:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-719a9a1a-d3e9-4fb3-a719-716661d09c6f tempest-VolumesActionsTest-1832300490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:54:22 devstack sudo[104408]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:22 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-719a9a1a-d3e9-4fb3-a719-716661d09c6f tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08273ccc-78eb-4291-8790-72abdc5fecf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3ec120e-353b-47cf-9068-3491bc663595', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:22 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-719a9a1a-d3e9-4fb3-a719-716661d09c6f tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc8eb884-a0f9-437d-b644-02f5560ff996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-9609f65a-27e7-4d91-86da-c6f425675596 tempest-CinderUnicodeTest-1310483767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d3689481-53c0-4983-a5f7-2db1fe943a67.8ab0db42-e8df-46fb-a22b-a4b26355d172" returned: 0 in 0.344s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-9609f65a-27e7-4d91-86da-c6f425675596 tempest-CinderUnicodeTest-1310483767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d3689481-53c0-4983-a5f7-2db1fe943a67.8ab0db42-e8df-46fb-a22b-a4b26355d172 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:22 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-719a9a1a-d3e9-4fb3-a719-716661d09c6f tempest-VolumesActionsTest-1832300490 None] Volume volume-b3ec120e-353b-47cf-9068-3491bc663595 (b3ec120e-353b-47cf-9068-3491bc663595): created successfully Sep 04 22:54:22 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-719a9a1a-d3e9-4fb3-a719-716661d09c6f tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc8eb884-a0f9-437d-b644-02f5560ff996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:22 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-719a9a1a-d3e9-4fb3-a719-716661d09c6f tempest-VolumesActionsTest-1832300490 None] Flow 'volume_create_manager' (36c96d44-04d2-447a-ab8e-f0ba69cefb09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:54:22 devstack sudo[104416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d3689481-53c0-4983-a5f7-2db1fe943a67.8ab0db42-e8df-46fb-a22b-a4b26355d172 Sep 04 22:54:22 devstack sudo[104416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:22 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-719a9a1a-d3e9-4fb3-a719-716661d09c6f tempest-VolumesActionsTest-1832300490 None] Created volume successfully. Sep 04 22:54:23 devstack sudo[104416]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-9609f65a-27e7-4d91-86da-c6f425675596 tempest-CinderUnicodeTest-1310483767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d3689481-53c0-4983-a5f7-2db1fe943a67.8ab0db42-e8df-46fb-a22b-a4b26355d172" returned: 0 in 0.253s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:23 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-9609f65a-27e7-4d91-86da-c6f425675596 tempest-CinderUnicodeTest-1310483767 None] Lock "cinder-quobyte-8ab0db42-e8df-46fb-a22b-a4b26355d172" released by "_delete_snapshot" :: held 1.525s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:54:23 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-9609f65a-27e7-4d91-86da-c6f425675596 tempest-CinderUnicodeTest-1310483767 None] Lock "cinder-quobyte-d3689481-53c0-4983-a5f7-2db1fe943a67" released by "delete_snapshot" :: held 1.551s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:54:23 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-9609f65a-27e7-4d91-86da-c6f425675596 tempest-CinderUnicodeTest-1310483767 None] Created reservations ['04ac53f0-21a2-45c1-b6ca-78f565fd04de', '2ef67819-5844-419e-8178-7929e2633502', '3666c422-d25a-44a6-a648-831af792efcb', '17a1ee68-21da-44ee-a3df-fe19236f5409'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:54:23 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-9609f65a-27e7-4d91-86da-c6f425675596 tempest-CinderUnicodeTest-1310483767 None] Delete snapshot completed successfully. Sep 04 22:54:23 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-9609f65a-27e7-4d91-86da-c6f425675596 tempest-CinderUnicodeTest-1310483767 None] Lock "cinder-8ab0db42-e8df-46fb-a22b-a4b26355d172-delete_snapshot" released by "delete_snapshot" :: held 1.731s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:54:23 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-5e055cf0-a7a4-44b5-8c57-b089129fe4a8 tempest-CinderUnicodeTest-1310483767 None] Acquiring lock "cinder-d3689481-53c0-4983-a5f7-2db1fe943a67-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:54:23 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-5e055cf0-a7a4-44b5-8c57-b089129fe4a8 tempest-CinderUnicodeTest-1310483767 None] Lock "cinder-d3689481-53c0-4983-a5f7-2db1fe943a67-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:54:23 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-5e055cf0-a7a4-44b5-8c57-b089129fe4a8 tempest-CinderUnicodeTest-1310483767 None] Acquiring lock "cinder-quobyte-d3689481-53c0-4983-a5f7-2db1fe943a67" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:54:23 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-5e055cf0-a7a4-44b5-8c57-b089129fe4a8 tempest-CinderUnicodeTest-1310483767 None] Lock "cinder-quobyte-d3689481-53c0-4983-a5f7-2db1fe943a67" acquired by "delete_volume" :: waited 0.015s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:54:23 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4859b86-b4c8-4644-8dbc-519f384868e3]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:54:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5e055cf0-a7a4-44b5-8c57-b089129fe4a8 tempest-CinderUnicodeTest-1310483767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d3689481-53c0-4983-a5f7-2db1fe943a67 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:23 devstack sudo[104420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d3689481-53c0-4983-a5f7-2db1fe943a67 Sep 04 22:54:23 devstack sudo[104420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:24 devstack sudo[104420]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:24 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-23b9d0b7-1b70-4ddc-b6cd-2dbf5f50888f tempest-VolumesActionsTest-1819649853 None] Acquiring lock "cinder-b3ec120e-353b-47cf-9068-3491bc663595-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:54:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5e055cf0-a7a4-44b5-8c57-b089129fe4a8 tempest-CinderUnicodeTest-1310483767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d3689481-53c0-4983-a5f7-2db1fe943a67" returned: 0 in 0.362s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5e055cf0-a7a4-44b5-8c57-b089129fe4a8 tempest-CinderUnicodeTest-1310483767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d3689481-53c0-4983-a5f7-2db1fe943a67 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:24 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-23b9d0b7-1b70-4ddc-b6cd-2dbf5f50888f tempest-VolumesActionsTest-1819649853 None] Lock "cinder-b3ec120e-353b-47cf-9068-3491bc663595-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:54:24 devstack sudo[104426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d3689481-53c0-4983-a5f7-2db1fe943a67 Sep 04 22:54:24 devstack sudo[104426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:24 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-23b9d0b7-1b70-4ddc-b6cd-2dbf5f50888f tempest-VolumesActionsTest-1819649853 None] Acquiring lock "cinder-quobyte-b3ec120e-353b-47cf-9068-3491bc663595" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:54:24 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-23b9d0b7-1b70-4ddc-b6cd-2dbf5f50888f tempest-VolumesActionsTest-1819649853 None] Lock "cinder-quobyte-b3ec120e-353b-47cf-9068-3491bc663595" acquired by "delete_volume" :: waited 0.016s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:54:24 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdbd15c5-dbcf-43c4-afd7-2cfc24799a94]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:54:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-23b9d0b7-1b70-4ddc-b6cd-2dbf5f50888f tempest-VolumesActionsTest-1819649853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b3ec120e-353b-47cf-9068-3491bc663595 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:24 devstack sudo[104428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b3ec120e-353b-47cf-9068-3491bc663595 Sep 04 22:54:24 devstack sudo[104428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:24 devstack sudo[104426]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5e055cf0-a7a4-44b5-8c57-b089129fe4a8 tempest-CinderUnicodeTest-1310483767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d3689481-53c0-4983-a5f7-2db1fe943a67" returned: 0 in 0.283s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:24 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-5e055cf0-a7a4-44b5-8c57-b089129fe4a8 tempest-CinderUnicodeTest-1310483767 None] Lock "cinder-quobyte-d3689481-53c0-4983-a5f7-2db1fe943a67" released by "delete_volume" :: held 0.706s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:54:24 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-5e055cf0-a7a4-44b5-8c57-b089129fe4a8 tempest-CinderUnicodeTest-1310483767 None] Created reservations ['484f05a2-ec0d-4262-83e8-f4611114c10f', '416f5e22-c314-459e-8bdf-64b88dea92ef', '864855ec-97ab-43a8-aafb-875679cc56c2', '043c69c4-4d0e-4ef1-867f-2b09ed094c6b'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:54:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-5e055cf0-a7a4-44b5-8c57-b089129fe4a8 tempest-CinderUnicodeTest-1310483767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:54:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-5e055cf0-a7a4-44b5-8c57-b089129fe4a8 tempest-CinderUnicodeTest-1310483767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:54:24 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-5e055cf0-a7a4-44b5-8c57-b089129fe4a8 tempest-CinderUnicodeTest-1310483767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:54:24 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-5e055cf0-a7a4-44b5-8c57-b089129fe4a8 tempest-CinderUnicodeTest-1310483767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:54:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-5e055cf0-a7a4-44b5-8c57-b089129fe4a8 tempest-CinderUnicodeTest-1310483767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:54:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5e055cf0-a7a4-44b5-8c57-b089129fe4a8 tempest-CinderUnicodeTest-1310483767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:24 devstack sudo[104433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:54:24 devstack sudo[104433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:24 devstack sudo[104428]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-23b9d0b7-1b70-4ddc-b6cd-2dbf5f50888f tempest-VolumesActionsTest-1819649853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b3ec120e-353b-47cf-9068-3491bc663595" returned: 0 in 0.369s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-23b9d0b7-1b70-4ddc-b6cd-2dbf5f50888f tempest-VolumesActionsTest-1819649853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b3ec120e-353b-47cf-9068-3491bc663595 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:24 devstack sudo[104436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b3ec120e-353b-47cf-9068-3491bc663595 Sep 04 22:54:24 devstack sudo[104436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:24 devstack sudo[104433]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5e055cf0-a7a4-44b5-8c57-b089129fe4a8 tempest-CinderUnicodeTest-1310483767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.259s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:24 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-5e055cf0-a7a4-44b5-8c57-b089129fe4a8 tempest-CinderUnicodeTest-1310483767 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:54:24 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-5e055cf0-a7a4-44b5-8c57-b089129fe4a8 tempest-CinderUnicodeTest-1310483767 None] Deleted volume successfully. Sep 04 22:54:24 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-e81f8c4c-649e-4e8c-bb13-b767bc053c09 tempest-CinderUnicodeTest-1310483767 None] Acquiring lock "cinder-7a804568-a5f3-4227-a735-f362c93aa76e-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:54:24 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-5e055cf0-a7a4-44b5-8c57-b089129fe4a8 tempest-CinderUnicodeTest-1310483767 None] Lock "cinder-d3689481-53c0-4983-a5f7-2db1fe943a67-delete_volume" released by "delete_volume" :: held 1.178s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:54:24 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-e81f8c4c-649e-4e8c-bb13-b767bc053c09 tempest-CinderUnicodeTest-1310483767 None] Lock "cinder-7a804568-a5f3-4227-a735-f362c93aa76e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:54:24 devstack sudo[104436]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:24 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-e81f8c4c-649e-4e8c-bb13-b767bc053c09 tempest-CinderUnicodeTest-1310483767 None] Acquiring lock "cinder-quobyte-7a804568-a5f3-4227-a735-f362c93aa76e" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:54:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-23b9d0b7-1b70-4ddc-b6cd-2dbf5f50888f tempest-VolumesActionsTest-1819649853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b3ec120e-353b-47cf-9068-3491bc663595" returned: 0 in 0.288s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:24 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-23b9d0b7-1b70-4ddc-b6cd-2dbf5f50888f tempest-VolumesActionsTest-1819649853 None] Lock "cinder-quobyte-b3ec120e-353b-47cf-9068-3491bc663595" released by "delete_volume" :: held 0.701s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:54:24 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-e81f8c4c-649e-4e8c-bb13-b767bc053c09 tempest-CinderUnicodeTest-1310483767 None] Lock "cinder-quobyte-7a804568-a5f3-4227-a735-f362c93aa76e" acquired by "delete_volume" :: waited 0.027s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:54:25 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d33b2f-781a-4544-97d5-ca74a0e97f97]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:54:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e81f8c4c-649e-4e8c-bb13-b767bc053c09 tempest-CinderUnicodeTest-1310483767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7a804568-a5f3-4227-a735-f362c93aa76e {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:25 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-23b9d0b7-1b70-4ddc-b6cd-2dbf5f50888f tempest-VolumesActionsTest-1819649853 None] Created reservations ['82d1b631-25b8-42ba-94b3-646b304a7754', '39abeea2-dbf0-4b1c-8c65-abc5686be8b7', 'cd581ce5-964e-4394-8d4e-0c346be964cd', '0fd517fd-cb2d-4e39-8139-95f7ddc49771'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:54:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-23b9d0b7-1b70-4ddc-b6cd-2dbf5f50888f tempest-VolumesActionsTest-1819649853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:54:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-23b9d0b7-1b70-4ddc-b6cd-2dbf5f50888f tempest-VolumesActionsTest-1819649853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:54:25 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-23b9d0b7-1b70-4ddc-b6cd-2dbf5f50888f tempest-VolumesActionsTest-1819649853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:54:25 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-23b9d0b7-1b70-4ddc-b6cd-2dbf5f50888f tempest-VolumesActionsTest-1819649853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:54:25 devstack sudo[104440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7a804568-a5f3-4227-a735-f362c93aa76e Sep 04 22:54:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-23b9d0b7-1b70-4ddc-b6cd-2dbf5f50888f tempest-VolumesActionsTest-1819649853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:54:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-23b9d0b7-1b70-4ddc-b6cd-2dbf5f50888f tempest-VolumesActionsTest-1819649853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:25 devstack sudo[104440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:25 devstack sudo[104442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:54:25 devstack sudo[104442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:25 devstack sudo[104442]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-23b9d0b7-1b70-4ddc-b6cd-2dbf5f50888f tempest-VolumesActionsTest-1819649853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.261s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:25 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-23b9d0b7-1b70-4ddc-b6cd-2dbf5f50888f tempest-VolumesActionsTest-1819649853 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:54:25 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-23b9d0b7-1b70-4ddc-b6cd-2dbf5f50888f tempest-VolumesActionsTest-1819649853 None] Deleted volume successfully. Sep 04 22:54:25 devstack sudo[104440]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e81f8c4c-649e-4e8c-bb13-b767bc053c09 tempest-CinderUnicodeTest-1310483767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7a804568-a5f3-4227-a735-f362c93aa76e" returned: 0 in 0.402s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e81f8c4c-649e-4e8c-bb13-b767bc053c09 tempest-CinderUnicodeTest-1310483767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7a804568-a5f3-4227-a735-f362c93aa76e {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:25 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-23b9d0b7-1b70-4ddc-b6cd-2dbf5f50888f tempest-VolumesActionsTest-1819649853 None] Lock "cinder-b3ec120e-353b-47cf-9068-3491bc663595-delete_volume" released by "delete_volume" :: held 1.215s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:54:25 devstack sudo[104449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7a804568-a5f3-4227-a735-f362c93aa76e Sep 04 22:54:25 devstack sudo[104449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:25 devstack sudo[104449]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e81f8c4c-649e-4e8c-bb13-b767bc053c09 tempest-CinderUnicodeTest-1310483767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7a804568-a5f3-4227-a735-f362c93aa76e" returned: 0 in 0.253s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:25 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-e81f8c4c-649e-4e8c-bb13-b767bc053c09 tempest-CinderUnicodeTest-1310483767 None] Lock "cinder-quobyte-7a804568-a5f3-4227-a735-f362c93aa76e" released by "delete_volume" :: held 0.703s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:54:25 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-e81f8c4c-649e-4e8c-bb13-b767bc053c09 tempest-CinderUnicodeTest-1310483767 None] Created reservations ['8b0bfd86-720c-4134-8a36-2395e54e334a', '8ba9a69a-892d-48e8-947f-c9c6151e5f00', '53ab189c-6f61-4fc1-9d3d-2e50e95dd87a', 'a64d01d3-593d-4c83-bc1f-2ba72069edca'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:54:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-e81f8c4c-649e-4e8c-bb13-b767bc053c09 tempest-CinderUnicodeTest-1310483767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:54:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-e81f8c4c-649e-4e8c-bb13-b767bc053c09 tempest-CinderUnicodeTest-1310483767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:54:25 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-e81f8c4c-649e-4e8c-bb13-b767bc053c09 tempest-CinderUnicodeTest-1310483767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:54:25 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-e81f8c4c-649e-4e8c-bb13-b767bc053c09 tempest-CinderUnicodeTest-1310483767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:54:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-e81f8c4c-649e-4e8c-bb13-b767bc053c09 tempest-CinderUnicodeTest-1310483767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:54:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e81f8c4c-649e-4e8c-bb13-b767bc053c09 tempest-CinderUnicodeTest-1310483767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:25 devstack sudo[104452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:54:25 devstack sudo[104452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:25 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c279dcd-5784-4a09-90b7-955edbf707b1 tempest-VolumesActionsTest-1832300490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:54:25 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2c279dcd-5784-4a09-90b7-955edbf707b1 tempest-VolumesActionsTest-1832300490 None] Flow 'volume_create_manager' (38bc574b-f0e8-44ff-9b55-00bd27a7c9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:54:25 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2c279dcd-5784-4a09-90b7-955edbf707b1 tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc926c08-533f-4a73-b946-a0e95f35cf69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:25 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2c279dcd-5784-4a09-90b7-955edbf707b1 tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc926c08-533f-4a73-b946-a0e95f35cf69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:54:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-517790343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e01cbc2d-834a-4602-b81a-95522424705b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d95843e4152441bbbbfbfa2e77795605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:54:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:54:26Z,use_quota=True,user_id='a4b20ec1c95842f4bbf9f2645d24e5fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:25 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2c279dcd-5784-4a09-90b7-955edbf707b1 tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (404c5d17-b53b-4c6e-9950-31f96f4cddfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:25 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2c279dcd-5784-4a09-90b7-955edbf707b1 tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (404c5d17-b53b-4c6e-9950-31f96f4cddfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:25 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2c279dcd-5784-4a09-90b7-955edbf707b1 tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a95f5e18-d51b-45ed-ab79-79091e662517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:25 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2c279dcd-5784-4a09-90b7-955edbf707b1 tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a95f5e18-d51b-45ed-ab79-79091e662517) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e01cbc2d-834a-4602-b81a-95522424705b', 'volume_name': 'volume-e01cbc2d-834a-4602-b81a-95522424705b', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:25 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2c279dcd-5784-4a09-90b7-955edbf707b1 tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0524f6bf-cc1e-45e6-8b98-7bd1e5cc7bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:25 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2c279dcd-5784-4a09-90b7-955edbf707b1 tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0524f6bf-cc1e-45e6-8b98-7bd1e5cc7bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:25 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2c279dcd-5784-4a09-90b7-955edbf707b1 tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad643c04-2979-4918-be12-7f9e0ccec047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:25 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-2c279dcd-5784-4a09-90b7-955edbf707b1 tempest-VolumesActionsTest-1832300490 None] Volume e01cbc2d-834a-4602-b81a-95522424705b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e01cbc2d-834a-4602-b81a-95522424705b', 'volume_size': 1} Sep 04 22:54:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-2c279dcd-5784-4a09-90b7-955edbf707b1 tempest-VolumesActionsTest-1832300490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:54:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-2c279dcd-5784-4a09-90b7-955edbf707b1 tempest-VolumesActionsTest-1832300490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:54:25 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-2c279dcd-5784-4a09-90b7-955edbf707b1 tempest-VolumesActionsTest-1832300490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:54:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-517790343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e01cbc2d-834a-4602-b81a-95522424705b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d95843e4152441bbbbfbfa2e77795605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:54:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:54:26Z,use_quota=True,user_id='a4b20ec1c95842f4bbf9f2645d24e5fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:54:25 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-2c279dcd-5784-4a09-90b7-955edbf707b1 tempest-VolumesActionsTest-1832300490 None] Creating volume e01cbc2d-834a-4602-b81a-95522424705b {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:54:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-2c279dcd-5784-4a09-90b7-955edbf707b1 tempest-VolumesActionsTest-1832300490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:54:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-2c279dcd-5784-4a09-90b7-955edbf707b1 tempest-VolumesActionsTest-1832300490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:54:25 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-2c279dcd-5784-4a09-90b7-955edbf707b1 tempest-VolumesActionsTest-1832300490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:54:25 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-2c279dcd-5784-4a09-90b7-955edbf707b1 tempest-VolumesActionsTest-1832300490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:54:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-2c279dcd-5784-4a09-90b7-955edbf707b1 tempest-VolumesActionsTest-1832300490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:54:25 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-2c279dcd-5784-4a09-90b7-955edbf707b1 tempest-VolumesActionsTest-1832300490 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:54:25 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-2c279dcd-5784-4a09-90b7-955edbf707b1 tempest-VolumesActionsTest-1832300490 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:54:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2c279dcd-5784-4a09-90b7-955edbf707b1 tempest-VolumesActionsTest-1832300490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e01cbc2d-834a-4602-b81a-95522424705b 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:26 devstack sudo[104454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e01cbc2d-834a-4602-b81a-95522424705b 1073741824 Sep 04 22:54:26 devstack sudo[104454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:26 devstack sudo[104452]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e81f8c4c-649e-4e8c-bb13-b767bc053c09 tempest-CinderUnicodeTest-1310483767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.262s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:26 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-e81f8c4c-649e-4e8c-bb13-b767bc053c09 tempest-CinderUnicodeTest-1310483767 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:54:26 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-e81f8c4c-649e-4e8c-bb13-b767bc053c09 tempest-CinderUnicodeTest-1310483767 None] Deleted volume successfully. Sep 04 22:54:26 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-e81f8c4c-649e-4e8c-bb13-b767bc053c09 tempest-CinderUnicodeTest-1310483767 None] Lock "cinder-7a804568-a5f3-4227-a735-f362c93aa76e-delete_volume" released by "delete_volume" :: held 1.184s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:54:26 devstack sudo[104454]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2c279dcd-5784-4a09-90b7-955edbf707b1 tempest-VolumesActionsTest-1832300490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e01cbc2d-834a-4602-b81a-95522424705b 1073741824" returned: 0 in 0.468s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2c279dcd-5784-4a09-90b7-955edbf707b1 tempest-VolumesActionsTest-1832300490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e01cbc2d-834a-4602-b81a-95522424705b {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:26 devstack sudo[104461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e01cbc2d-834a-4602-b81a-95522424705b Sep 04 22:54:26 devstack sudo[104461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:26 devstack sudo[104461]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2c279dcd-5784-4a09-90b7-955edbf707b1 tempest-VolumesActionsTest-1832300490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e01cbc2d-834a-4602-b81a-95522424705b" returned: 0 in 0.257s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:26 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-2c279dcd-5784-4a09-90b7-955edbf707b1 tempest-VolumesActionsTest-1832300490 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:54:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-2c279dcd-5784-4a09-90b7-955edbf707b1 tempest-VolumesActionsTest-1832300490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:54:26 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2c279dcd-5784-4a09-90b7-955edbf707b1 tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad643c04-2979-4918-be12-7f9e0ccec047) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e01cbc2d-834a-4602-b81a-95522424705b', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:26 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2c279dcd-5784-4a09-90b7-955edbf707b1 tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53ff4808-5302-4eed-ae4e-dc4777fbfd6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:26 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-2c279dcd-5784-4a09-90b7-955edbf707b1 tempest-VolumesActionsTest-1832300490 None] Volume volume-e01cbc2d-834a-4602-b81a-95522424705b (e01cbc2d-834a-4602-b81a-95522424705b): created successfully Sep 04 22:54:26 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2c279dcd-5784-4a09-90b7-955edbf707b1 tempest-VolumesActionsTest-1832300490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53ff4808-5302-4eed-ae4e-dc4777fbfd6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:26 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2c279dcd-5784-4a09-90b7-955edbf707b1 tempest-VolumesActionsTest-1832300490 None] Flow 'volume_create_manager' (38bc574b-f0e8-44ff-9b55-00bd27a7c9d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:54:26 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-2c279dcd-5784-4a09-90b7-955edbf707b1 tempest-VolumesActionsTest-1832300490 None] Created volume successfully. Sep 04 22:54:28 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-0b09bb57-de8f-428d-b4e9-fe8049717680 tempest-VolumesActionsTest-1832300490 None] Acquiring lock "cinder-e01cbc2d-834a-4602-b81a-95522424705b-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:54:28 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-0b09bb57-de8f-428d-b4e9-fe8049717680 tempest-VolumesActionsTest-1832300490 None] Lock "cinder-e01cbc2d-834a-4602-b81a-95522424705b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:54:28 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-0b09bb57-de8f-428d-b4e9-fe8049717680 tempest-VolumesActionsTest-1832300490 None] Acquiring lock "cinder-quobyte-e01cbc2d-834a-4602-b81a-95522424705b" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:54:28 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-0b09bb57-de8f-428d-b4e9-fe8049717680 tempest-VolumesActionsTest-1832300490 None] Lock "cinder-quobyte-e01cbc2d-834a-4602-b81a-95522424705b" acquired by "delete_volume" :: waited 0.016s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:54:28 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[778f8818-5cc7-4f4e-95e7-73a9407f5a85]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:54:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0b09bb57-de8f-428d-b4e9-fe8049717680 tempest-VolumesActionsTest-1832300490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e01cbc2d-834a-4602-b81a-95522424705b {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:28 devstack sudo[104464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e01cbc2d-834a-4602-b81a-95522424705b Sep 04 22:54:28 devstack sudo[104464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:28 devstack sudo[104464]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0b09bb57-de8f-428d-b4e9-fe8049717680 tempest-VolumesActionsTest-1832300490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e01cbc2d-834a-4602-b81a-95522424705b" returned: 0 in 0.373s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0b09bb57-de8f-428d-b4e9-fe8049717680 tempest-VolumesActionsTest-1832300490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e01cbc2d-834a-4602-b81a-95522424705b {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:29 devstack sudo[104469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e01cbc2d-834a-4602-b81a-95522424705b Sep 04 22:54:29 devstack sudo[104469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:29 devstack sudo[104469]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0b09bb57-de8f-428d-b4e9-fe8049717680 tempest-VolumesActionsTest-1832300490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e01cbc2d-834a-4602-b81a-95522424705b" returned: 0 in 0.256s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:29 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-0b09bb57-de8f-428d-b4e9-fe8049717680 tempest-VolumesActionsTest-1832300490 None] Lock "cinder-quobyte-e01cbc2d-834a-4602-b81a-95522424705b" released by "delete_volume" :: held 0.670s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:54:29 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-0b09bb57-de8f-428d-b4e9-fe8049717680 tempest-VolumesActionsTest-1832300490 None] Created reservations ['f8a75ab7-5637-4008-ad53-e4d7fbe951dc', '0300d5bd-dac2-4ad6-8646-0c632caed686', 'd79f4111-b67a-404b-9339-b093239a5885', '28214163-cfda-4840-984b-0dab7fbfa833'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:54:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-0b09bb57-de8f-428d-b4e9-fe8049717680 tempest-VolumesActionsTest-1832300490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:54:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-0b09bb57-de8f-428d-b4e9-fe8049717680 tempest-VolumesActionsTest-1832300490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:54:29 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-0b09bb57-de8f-428d-b4e9-fe8049717680 tempest-VolumesActionsTest-1832300490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:54:29 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-0b09bb57-de8f-428d-b4e9-fe8049717680 tempest-VolumesActionsTest-1832300490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:54:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-0b09bb57-de8f-428d-b4e9-fe8049717680 tempest-VolumesActionsTest-1832300490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:54:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0b09bb57-de8f-428d-b4e9-fe8049717680 tempest-VolumesActionsTest-1832300490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:29 devstack sudo[104473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:54:29 devstack sudo[104473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:29 devstack sudo[104473]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0b09bb57-de8f-428d-b4e9-fe8049717680 tempest-VolumesActionsTest-1832300490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.266s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:29 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-0b09bb57-de8f-428d-b4e9-fe8049717680 tempest-VolumesActionsTest-1832300490 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:54:29 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-0b09bb57-de8f-428d-b4e9-fe8049717680 tempest-VolumesActionsTest-1832300490 None] Deleted volume successfully. Sep 04 22:54:29 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-0b09bb57-de8f-428d-b4e9-fe8049717680 tempest-VolumesActionsTest-1832300490 None] Lock "cinder-e01cbc2d-834a-4602-b81a-95522424705b-delete_volume" released by "delete_volume" :: held 1.157s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:54:39 devstack cinder-volume[87576]: DEBUG dbcounter [-] [87576] Writing DB stats cinder:UPDATE=207,cinder:SELECT=141,cinder:INSERT=51,cinder:DELETE=17 {{(pid=87576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 22:54:39 devstack cinder-volume[87576]: DEBUG dbcounter [-] [87576] Writing DB stats cinder:SELECT=159,cinder:UPDATE=233,cinder:INSERT=51,cinder:DELETE=22 {{(pid=87576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 22:54:42 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-703cc2ba-cb73-4705-86f3-afa6a0e9a811 tempest-VolumesTransfersV357Test-756899653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:54:42 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-703cc2ba-cb73-4705-86f3-afa6a0e9a811 tempest-VolumesTransfersV357Test-756899653 None] Flow 'volume_create_manager' (865abb9f-a8d5-468c-b490-e5398adbd9b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:54:42 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-703cc2ba-cb73-4705-86f3-afa6a0e9a811 tempest-VolumesTransfersV357Test-756899653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d18a2813-58d4-4f92-ba2c-5d23509a2017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:42 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-703cc2ba-cb73-4705-86f3-afa6a0e9a811 tempest-VolumesTransfersV357Test-756899653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d18a2813-58d4-4f92-ba2c-5d23509a2017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:54:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-594886011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d12c7349-3218-45bc-8acd-c223961ee350,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c01340dc216a4e81bf9ec0a1f5a8cc0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:54:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:54:42Z,use_quota=True,user_id='667e09db96c341819faa1df2e9a27688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:42 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-703cc2ba-cb73-4705-86f3-afa6a0e9a811 tempest-VolumesTransfersV357Test-756899653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf8723fc-5ad7-496d-979d-6324aec13479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:42 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-703cc2ba-cb73-4705-86f3-afa6a0e9a811 tempest-VolumesTransfersV357Test-756899653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf8723fc-5ad7-496d-979d-6324aec13479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:42 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-703cc2ba-cb73-4705-86f3-afa6a0e9a811 tempest-VolumesTransfersV357Test-756899653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7826e43-ae38-4c11-a851-855f980a936d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:42 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-703cc2ba-cb73-4705-86f3-afa6a0e9a811 tempest-VolumesTransfersV357Test-756899653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7826e43-ae38-4c11-a851-855f980a936d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd12c7349-3218-45bc-8acd-c223961ee350', 'volume_name': 'volume-d12c7349-3218-45bc-8acd-c223961ee350', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:42 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-703cc2ba-cb73-4705-86f3-afa6a0e9a811 tempest-VolumesTransfersV357Test-756899653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d00606f0-34d7-4c0b-8963-9c88a44725f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:42 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-703cc2ba-cb73-4705-86f3-afa6a0e9a811 tempest-VolumesTransfersV357Test-756899653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d00606f0-34d7-4c0b-8963-9c88a44725f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:42 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-703cc2ba-cb73-4705-86f3-afa6a0e9a811 tempest-VolumesTransfersV357Test-756899653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffc73ddd-adab-483b-9e68-250bc29560d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:42 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-703cc2ba-cb73-4705-86f3-afa6a0e9a811 tempest-VolumesTransfersV357Test-756899653 None] Volume d12c7349-3218-45bc-8acd-c223961ee350: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d12c7349-3218-45bc-8acd-c223961ee350', 'volume_size': 1} Sep 04 22:54:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-703cc2ba-cb73-4705-86f3-afa6a0e9a811 tempest-VolumesTransfersV357Test-756899653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:54:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-703cc2ba-cb73-4705-86f3-afa6a0e9a811 tempest-VolumesTransfersV357Test-756899653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:54:42 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-703cc2ba-cb73-4705-86f3-afa6a0e9a811 tempest-VolumesTransfersV357Test-756899653 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:54:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-594886011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d12c7349-3218-45bc-8acd-c223961ee350,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c01340dc216a4e81bf9ec0a1f5a8cc0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:54:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:54:42Z,use_quota=True,user_id='667e09db96c341819faa1df2e9a27688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:54:42 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-703cc2ba-cb73-4705-86f3-afa6a0e9a811 tempest-VolumesTransfersV357Test-756899653 None] Creating volume d12c7349-3218-45bc-8acd-c223961ee350 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:54:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-703cc2ba-cb73-4705-86f3-afa6a0e9a811 tempest-VolumesTransfersV357Test-756899653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:54:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-703cc2ba-cb73-4705-86f3-afa6a0e9a811 tempest-VolumesTransfersV357Test-756899653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:54:42 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-703cc2ba-cb73-4705-86f3-afa6a0e9a811 tempest-VolumesTransfersV357Test-756899653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:54:42 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-703cc2ba-cb73-4705-86f3-afa6a0e9a811 tempest-VolumesTransfersV357Test-756899653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:54:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-703cc2ba-cb73-4705-86f3-afa6a0e9a811 tempest-VolumesTransfersV357Test-756899653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:54:42 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-703cc2ba-cb73-4705-86f3-afa6a0e9a811 tempest-VolumesTransfersV357Test-756899653 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:54:42 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-703cc2ba-cb73-4705-86f3-afa6a0e9a811 tempest-VolumesTransfersV357Test-756899653 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:54:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-703cc2ba-cb73-4705-86f3-afa6a0e9a811 tempest-VolumesTransfersV357Test-756899653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d12c7349-3218-45bc-8acd-c223961ee350 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:42 devstack sudo[104517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d12c7349-3218-45bc-8acd-c223961ee350 1073741824 Sep 04 22:54:42 devstack sudo[104517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:42 devstack sudo[104517]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-703cc2ba-cb73-4705-86f3-afa6a0e9a811 tempest-VolumesTransfersV357Test-756899653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d12c7349-3218-45bc-8acd-c223961ee350 1073741824" returned: 0 in 0.406s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-703cc2ba-cb73-4705-86f3-afa6a0e9a811 tempest-VolumesTransfersV357Test-756899653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d12c7349-3218-45bc-8acd-c223961ee350 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:42 devstack sudo[104522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d12c7349-3218-45bc-8acd-c223961ee350 Sep 04 22:54:42 devstack sudo[104522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:42 devstack sudo[104522]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-703cc2ba-cb73-4705-86f3-afa6a0e9a811 tempest-VolumesTransfersV357Test-756899653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d12c7349-3218-45bc-8acd-c223961ee350" returned: 0 in 0.237s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:42 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-703cc2ba-cb73-4705-86f3-afa6a0e9a811 tempest-VolumesTransfersV357Test-756899653 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:54:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-703cc2ba-cb73-4705-86f3-afa6a0e9a811 tempest-VolumesTransfersV357Test-756899653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:54:42 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-703cc2ba-cb73-4705-86f3-afa6a0e9a811 tempest-VolumesTransfersV357Test-756899653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffc73ddd-adab-483b-9e68-250bc29560d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d12c7349-3218-45bc-8acd-c223961ee350', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:42 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-703cc2ba-cb73-4705-86f3-afa6a0e9a811 tempest-VolumesTransfersV357Test-756899653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b204828-ee7e-40c7-b979-efc7246bb157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:42 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-703cc2ba-cb73-4705-86f3-afa6a0e9a811 tempest-VolumesTransfersV357Test-756899653 None] Volume volume-d12c7349-3218-45bc-8acd-c223961ee350 (d12c7349-3218-45bc-8acd-c223961ee350): created successfully Sep 04 22:54:42 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-703cc2ba-cb73-4705-86f3-afa6a0e9a811 tempest-VolumesTransfersV357Test-756899653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b204828-ee7e-40c7-b979-efc7246bb157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:42 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-703cc2ba-cb73-4705-86f3-afa6a0e9a811 tempest-VolumesTransfersV357Test-756899653 None] Flow 'volume_create_manager' (865abb9f-a8d5-468c-b490-e5398adbd9b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:54:42 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-703cc2ba-cb73-4705-86f3-afa6a0e9a811 tempest-VolumesTransfersV357Test-756899653 None] Created volume successfully. Sep 04 22:54:43 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-87e7c40d-0d46-4a53-a255-a9df3f4fbe1c tempest-VolumesTransfersV357Test-811769955 None] Transfer volume completed successfully. Sep 04 22:54:44 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-db4fb237-2653-45c5-b696-43b8e9d0cf80 tempest-VolumesTransfersV357Test-1169843516 None] Acquiring lock "cinder-d12c7349-3218-45bc-8acd-c223961ee350-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:54:44 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-db4fb237-2653-45c5-b696-43b8e9d0cf80 tempest-VolumesTransfersV357Test-1169843516 None] Lock "cinder-d12c7349-3218-45bc-8acd-c223961ee350-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:54:44 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-db4fb237-2653-45c5-b696-43b8e9d0cf80 tempest-VolumesTransfersV357Test-1169843516 None] Acquiring lock "cinder-quobyte-d12c7349-3218-45bc-8acd-c223961ee350" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:54:44 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-db4fb237-2653-45c5-b696-43b8e9d0cf80 tempest-VolumesTransfersV357Test-1169843516 None] Lock "cinder-quobyte-d12c7349-3218-45bc-8acd-c223961ee350" acquired by "delete_volume" :: waited 0.016s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:54:44 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35fe2ad-26b1-46ae-a343-7b1db70eb8a9]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:54:44 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-db4fb237-2653-45c5-b696-43b8e9d0cf80 tempest-VolumesTransfersV357Test-1169843516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d12c7349-3218-45bc-8acd-c223961ee350 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:44 devstack sudo[104527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d12c7349-3218-45bc-8acd-c223961ee350 Sep 04 22:54:44 devstack sudo[104527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:44 devstack sudo[104527]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:44 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-db4fb237-2653-45c5-b696-43b8e9d0cf80 tempest-VolumesTransfersV357Test-1169843516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d12c7349-3218-45bc-8acd-c223961ee350" returned: 0 in 0.359s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:44 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-db4fb237-2653-45c5-b696-43b8e9d0cf80 tempest-VolumesTransfersV357Test-1169843516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d12c7349-3218-45bc-8acd-c223961ee350 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:44 devstack sudo[104532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d12c7349-3218-45bc-8acd-c223961ee350 Sep 04 22:54:44 devstack sudo[104532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:44 devstack sudo[104532]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:44 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-db4fb237-2653-45c5-b696-43b8e9d0cf80 tempest-VolumesTransfersV357Test-1169843516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d12c7349-3218-45bc-8acd-c223961ee350" returned: 0 in 0.257s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:44 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-db4fb237-2653-45c5-b696-43b8e9d0cf80 tempest-VolumesTransfersV357Test-1169843516 None] Lock "cinder-quobyte-d12c7349-3218-45bc-8acd-c223961ee350" released by "delete_volume" :: held 0.655s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:54:44 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-db4fb237-2653-45c5-b696-43b8e9d0cf80 tempest-VolumesTransfersV357Test-1169843516 None] Created reservations ['265869ed-b4a6-483d-8c4c-73ddb098da95', '3515ce4d-fece-4e7a-ac9f-5ee84aee8362', '2c66acc7-b124-4709-8dac-5b0b8e3765c0', '102d77db-07a5-43c1-af78-a119dff8407d'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:54:44 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-db4fb237-2653-45c5-b696-43b8e9d0cf80 tempest-VolumesTransfersV357Test-1169843516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:54:44 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-db4fb237-2653-45c5-b696-43b8e9d0cf80 tempest-VolumesTransfersV357Test-1169843516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:54:44 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-db4fb237-2653-45c5-b696-43b8e9d0cf80 tempest-VolumesTransfersV357Test-1169843516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:54:44 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-db4fb237-2653-45c5-b696-43b8e9d0cf80 tempest-VolumesTransfersV357Test-1169843516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:54:44 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-db4fb237-2653-45c5-b696-43b8e9d0cf80 tempest-VolumesTransfersV357Test-1169843516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:54:44 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-db4fb237-2653-45c5-b696-43b8e9d0cf80 tempest-VolumesTransfersV357Test-1169843516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:44 devstack sudo[104535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:54:44 devstack sudo[104535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:45 devstack sudo[104535]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:45 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-db4fb237-2653-45c5-b696-43b8e9d0cf80 tempest-VolumesTransfersV357Test-1169843516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.237s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:45 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-db4fb237-2653-45c5-b696-43b8e9d0cf80 tempest-VolumesTransfersV357Test-1169843516 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:54:45 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-db4fb237-2653-45c5-b696-43b8e9d0cf80 tempest-VolumesTransfersV357Test-1169843516 None] Deleted volume successfully. Sep 04 22:54:45 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-db4fb237-2653-45c5-b696-43b8e9d0cf80 tempest-VolumesTransfersV357Test-1169843516 None] Lock "cinder-d12c7349-3218-45bc-8acd-c223961ee350-delete_volume" released by "delete_volume" :: held 1.072s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:54:45 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-9792ad2a-7f55-46fa-a12a-903ae830b951 tempest-VolumesTransfersV357Test-756899653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:54:45 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9792ad2a-7f55-46fa-a12a-903ae830b951 tempest-VolumesTransfersV357Test-756899653 None] Flow 'volume_create_manager' (c020dbea-49a9-4396-b8f9-5b24d796397e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:54:45 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9792ad2a-7f55-46fa-a12a-903ae830b951 tempest-VolumesTransfersV357Test-756899653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abd919ed-5aa6-40e2-bdff-0d64cba96683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:45 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9792ad2a-7f55-46fa-a12a-903ae830b951 tempest-VolumesTransfersV357Test-756899653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abd919ed-5aa6-40e2-bdff-0d64cba96683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:54:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1320664602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=618ccdc0-f6b6-43b9-b957-54c39547c94e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c01340dc216a4e81bf9ec0a1f5a8cc0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:54:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:54:46Z,use_quota=True,user_id='667e09db96c341819faa1df2e9a27688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:45 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9792ad2a-7f55-46fa-a12a-903ae830b951 tempest-VolumesTransfersV357Test-756899653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f41ac2a-5437-4c4e-b9f3-d6e2515da8b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:45 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9792ad2a-7f55-46fa-a12a-903ae830b951 tempest-VolumesTransfersV357Test-756899653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f41ac2a-5437-4c4e-b9f3-d6e2515da8b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:45 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9792ad2a-7f55-46fa-a12a-903ae830b951 tempest-VolumesTransfersV357Test-756899653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f851f0ed-88db-4ed4-9b87-f44ab5beaeb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:45 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9792ad2a-7f55-46fa-a12a-903ae830b951 tempest-VolumesTransfersV357Test-756899653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f851f0ed-88db-4ed4-9b87-f44ab5beaeb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '618ccdc0-f6b6-43b9-b957-54c39547c94e', 'volume_name': 'volume-618ccdc0-f6b6-43b9-b957-54c39547c94e', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:45 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9792ad2a-7f55-46fa-a12a-903ae830b951 tempest-VolumesTransfersV357Test-756899653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25910569-c900-41ef-81e3-52642243f372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:45 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9792ad2a-7f55-46fa-a12a-903ae830b951 tempest-VolumesTransfersV357Test-756899653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25910569-c900-41ef-81e3-52642243f372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:45 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9792ad2a-7f55-46fa-a12a-903ae830b951 tempest-VolumesTransfersV357Test-756899653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb156b56-9e01-421d-bd2e-de0620cdbdf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:45 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-9792ad2a-7f55-46fa-a12a-903ae830b951 tempest-VolumesTransfersV357Test-756899653 None] Volume 618ccdc0-f6b6-43b9-b957-54c39547c94e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-618ccdc0-f6b6-43b9-b957-54c39547c94e', 'volume_size': 1} Sep 04 22:54:45 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-9792ad2a-7f55-46fa-a12a-903ae830b951 tempest-VolumesTransfersV357Test-756899653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:54:45 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-9792ad2a-7f55-46fa-a12a-903ae830b951 tempest-VolumesTransfersV357Test-756899653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:54:45 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-9792ad2a-7f55-46fa-a12a-903ae830b951 tempest-VolumesTransfersV357Test-756899653 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:54:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1320664602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=618ccdc0-f6b6-43b9-b957-54c39547c94e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c01340dc216a4e81bf9ec0a1f5a8cc0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:54:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:54:46Z,use_quota=True,user_id='667e09db96c341819faa1df2e9a27688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:54:45 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-9792ad2a-7f55-46fa-a12a-903ae830b951 tempest-VolumesTransfersV357Test-756899653 None] Creating volume 618ccdc0-f6b6-43b9-b957-54c39547c94e {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:54:45 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-9792ad2a-7f55-46fa-a12a-903ae830b951 tempest-VolumesTransfersV357Test-756899653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:54:45 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-9792ad2a-7f55-46fa-a12a-903ae830b951 tempest-VolumesTransfersV357Test-756899653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:54:45 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-9792ad2a-7f55-46fa-a12a-903ae830b951 tempest-VolumesTransfersV357Test-756899653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:54:45 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-9792ad2a-7f55-46fa-a12a-903ae830b951 tempest-VolumesTransfersV357Test-756899653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:54:45 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-9792ad2a-7f55-46fa-a12a-903ae830b951 tempest-VolumesTransfersV357Test-756899653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:54:45 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-9792ad2a-7f55-46fa-a12a-903ae830b951 tempest-VolumesTransfersV357Test-756899653 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:54:45 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-9792ad2a-7f55-46fa-a12a-903ae830b951 tempest-VolumesTransfersV357Test-756899653 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:54:45 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-9792ad2a-7f55-46fa-a12a-903ae830b951 tempest-VolumesTransfersV357Test-756899653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-618ccdc0-f6b6-43b9-b957-54c39547c94e 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:45 devstack sudo[104538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-618ccdc0-f6b6-43b9-b957-54c39547c94e 1073741824 Sep 04 22:54:45 devstack sudo[104538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:46 devstack sudo[104538]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:46 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-9792ad2a-7f55-46fa-a12a-903ae830b951 tempest-VolumesTransfersV357Test-756899653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-618ccdc0-f6b6-43b9-b957-54c39547c94e 1073741824" returned: 0 in 0.395s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:46 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-9792ad2a-7f55-46fa-a12a-903ae830b951 tempest-VolumesTransfersV357Test-756899653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-618ccdc0-f6b6-43b9-b957-54c39547c94e {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:46 devstack sudo[104546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-618ccdc0-f6b6-43b9-b957-54c39547c94e Sep 04 22:54:46 devstack sudo[104546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:46 devstack sudo[104546]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:46 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-9792ad2a-7f55-46fa-a12a-903ae830b951 tempest-VolumesTransfersV357Test-756899653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-618ccdc0-f6b6-43b9-b957-54c39547c94e" returned: 0 in 0.244s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:46 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-9792ad2a-7f55-46fa-a12a-903ae830b951 tempest-VolumesTransfersV357Test-756899653 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:54:46 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-9792ad2a-7f55-46fa-a12a-903ae830b951 tempest-VolumesTransfersV357Test-756899653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:54:46 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9792ad2a-7f55-46fa-a12a-903ae830b951 tempest-VolumesTransfersV357Test-756899653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb156b56-9e01-421d-bd2e-de0620cdbdf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-618ccdc0-f6b6-43b9-b957-54c39547c94e', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:46 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9792ad2a-7f55-46fa-a12a-903ae830b951 tempest-VolumesTransfersV357Test-756899653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c919f7e3-9bf9-41cd-b8e0-cec8ee1f2406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:46 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-9792ad2a-7f55-46fa-a12a-903ae830b951 tempest-VolumesTransfersV357Test-756899653 None] Volume volume-618ccdc0-f6b6-43b9-b957-54c39547c94e (618ccdc0-f6b6-43b9-b957-54c39547c94e): created successfully Sep 04 22:54:46 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9792ad2a-7f55-46fa-a12a-903ae830b951 tempest-VolumesTransfersV357Test-756899653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c919f7e3-9bf9-41cd-b8e0-cec8ee1f2406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:46 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9792ad2a-7f55-46fa-a12a-903ae830b951 tempest-VolumesTransfersV357Test-756899653 None] Flow 'volume_create_manager' (c020dbea-49a9-4396-b8f9-5b24d796397e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:54:46 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-9792ad2a-7f55-46fa-a12a-903ae830b951 tempest-VolumesTransfersV357Test-756899653 None] Created volume successfully. Sep 04 22:54:46 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-1610dc29-dd42-4021-b12d-a67d9ff96feb tempest-VolumesTransfersV357Test-1169843516 None] Acquiring lock "cinder-618ccdc0-f6b6-43b9-b957-54c39547c94e-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:54:46 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-1610dc29-dd42-4021-b12d-a67d9ff96feb tempest-VolumesTransfersV357Test-1169843516 None] Lock "cinder-618ccdc0-f6b6-43b9-b957-54c39547c94e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:54:47 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-1610dc29-dd42-4021-b12d-a67d9ff96feb tempest-VolumesTransfersV357Test-1169843516 None] Acquiring lock "cinder-quobyte-618ccdc0-f6b6-43b9-b957-54c39547c94e" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:54:47 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-1610dc29-dd42-4021-b12d-a67d9ff96feb tempest-VolumesTransfersV357Test-1169843516 None] Lock "cinder-quobyte-618ccdc0-f6b6-43b9-b957-54c39547c94e" acquired by "delete_volume" :: waited 0.016s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:54:47 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3693a99-8e0a-4cb5-ac88-910538b1f915]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:54:47 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-1610dc29-dd42-4021-b12d-a67d9ff96feb tempest-VolumesTransfersV357Test-1169843516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-618ccdc0-f6b6-43b9-b957-54c39547c94e {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:47 devstack sudo[104549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-618ccdc0-f6b6-43b9-b957-54c39547c94e Sep 04 22:54:47 devstack sudo[104549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:47 devstack sudo[104549]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:47 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-1610dc29-dd42-4021-b12d-a67d9ff96feb tempest-VolumesTransfersV357Test-1169843516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-618ccdc0-f6b6-43b9-b957-54c39547c94e" returned: 0 in 0.356s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:47 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-1610dc29-dd42-4021-b12d-a67d9ff96feb tempest-VolumesTransfersV357Test-1169843516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-618ccdc0-f6b6-43b9-b957-54c39547c94e {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:47 devstack sudo[104554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-618ccdc0-f6b6-43b9-b957-54c39547c94e Sep 04 22:54:47 devstack sudo[104554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:47 devstack sudo[104554]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:47 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-1610dc29-dd42-4021-b12d-a67d9ff96feb tempest-VolumesTransfersV357Test-1169843516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-618ccdc0-f6b6-43b9-b957-54c39547c94e" returned: 0 in 0.249s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:47 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-1610dc29-dd42-4021-b12d-a67d9ff96feb tempest-VolumesTransfersV357Test-1169843516 None] Lock "cinder-quobyte-618ccdc0-f6b6-43b9-b957-54c39547c94e" released by "delete_volume" :: held 0.640s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:54:47 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-1610dc29-dd42-4021-b12d-a67d9ff96feb tempest-VolumesTransfersV357Test-1169843516 None] Created reservations ['cf313667-7788-4c80-a8b8-e753d3247208', '0248caa7-e321-4edf-9701-72ce072ca99a', '538183e9-6dc4-45f7-adce-139745eb4581', '1a5d1a6e-ff67-4e12-bd06-8f066d3e055f'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:54:47 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-1610dc29-dd42-4021-b12d-a67d9ff96feb tempest-VolumesTransfersV357Test-1169843516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:54:47 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-1610dc29-dd42-4021-b12d-a67d9ff96feb tempest-VolumesTransfersV357Test-1169843516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:54:47 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-1610dc29-dd42-4021-b12d-a67d9ff96feb tempest-VolumesTransfersV357Test-1169843516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:54:47 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-1610dc29-dd42-4021-b12d-a67d9ff96feb tempest-VolumesTransfersV357Test-1169843516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:54:47 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-1610dc29-dd42-4021-b12d-a67d9ff96feb tempest-VolumesTransfersV357Test-1169843516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:54:47 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-1610dc29-dd42-4021-b12d-a67d9ff96feb tempest-VolumesTransfersV357Test-1169843516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:47 devstack sudo[104563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:54:47 devstack sudo[104563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:48 devstack sudo[104563]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:48 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-1610dc29-dd42-4021-b12d-a67d9ff96feb tempest-VolumesTransfersV357Test-1169843516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.246s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:48 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-1610dc29-dd42-4021-b12d-a67d9ff96feb tempest-VolumesTransfersV357Test-1169843516 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:54:48 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-1610dc29-dd42-4021-b12d-a67d9ff96feb tempest-VolumesTransfersV357Test-1169843516 None] Deleted volume successfully. Sep 04 22:54:48 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-1610dc29-dd42-4021-b12d-a67d9ff96feb tempest-VolumesTransfersV357Test-1169843516 None] Lock "cinder-618ccdc0-f6b6-43b9-b957-54c39547c94e-delete_volume" released by "delete_volume" :: held 1.133s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:54:52 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-284bdfd9-90bb-460a-98e9-3eea8cf0d86b tempest-VolumesCloneTest-1387177791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:54:52 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-284bdfd9-90bb-460a-98e9-3eea8cf0d86b tempest-VolumesCloneTest-1387177791 None] Flow 'volume_create_manager' (cf51d504-46b8-4ee9-bd28-5042ad24f20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:54:52 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-284bdfd9-90bb-460a-98e9-3eea8cf0d86b tempest-VolumesCloneTest-1387177791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57cdf0e1-ae5b-4aa2-8ec6-37529308eb00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:52 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-284bdfd9-90bb-460a-98e9-3eea8cf0d86b tempest-VolumesCloneTest-1387177791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57cdf0e1-ae5b-4aa2-8ec6-37529308eb00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:54:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-55487723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=051354d2-84a0-42df-9954-76f6c73a305c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f0796f96a434bf8b2d05e3c24fbfa0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:54:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:54:53Z,use_quota=True,user_id='bd809f65627f4ef1b30132c0cf731cc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:52 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-284bdfd9-90bb-460a-98e9-3eea8cf0d86b tempest-VolumesCloneTest-1387177791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (547ef013-6152-47ab-a368-a518fde1d8fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:52 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-284bdfd9-90bb-460a-98e9-3eea8cf0d86b tempest-VolumesCloneTest-1387177791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (547ef013-6152-47ab-a368-a518fde1d8fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:53 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-284bdfd9-90bb-460a-98e9-3eea8cf0d86b tempest-VolumesCloneTest-1387177791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8b8350a-6fb5-4375-87f7-53cbd844440b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:53 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-284bdfd9-90bb-460a-98e9-3eea8cf0d86b tempest-VolumesCloneTest-1387177791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8b8350a-6fb5-4375-87f7-53cbd844440b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '051354d2-84a0-42df-9954-76f6c73a305c', 'volume_name': 'volume-051354d2-84a0-42df-9954-76f6c73a305c', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:53 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-284bdfd9-90bb-460a-98e9-3eea8cf0d86b tempest-VolumesCloneTest-1387177791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2266ecfa-989e-490b-a8ed-bf50af96f5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:53 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-284bdfd9-90bb-460a-98e9-3eea8cf0d86b tempest-VolumesCloneTest-1387177791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2266ecfa-989e-490b-a8ed-bf50af96f5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:53 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-284bdfd9-90bb-460a-98e9-3eea8cf0d86b tempest-VolumesCloneTest-1387177791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (085b2991-24d4-4dc4-a769-50b581bc8142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:53 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-284bdfd9-90bb-460a-98e9-3eea8cf0d86b tempest-VolumesCloneTest-1387177791 None] Volume 051354d2-84a0-42df-9954-76f6c73a305c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-051354d2-84a0-42df-9954-76f6c73a305c', 'volume_size': 1} Sep 04 22:54:53 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-284bdfd9-90bb-460a-98e9-3eea8cf0d86b tempest-VolumesCloneTest-1387177791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:54:53 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-284bdfd9-90bb-460a-98e9-3eea8cf0d86b tempest-VolumesCloneTest-1387177791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:54:53 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-284bdfd9-90bb-460a-98e9-3eea8cf0d86b tempest-VolumesCloneTest-1387177791 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:54:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-55487723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=051354d2-84a0-42df-9954-76f6c73a305c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f0796f96a434bf8b2d05e3c24fbfa0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:54:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:54:53Z,use_quota=True,user_id='bd809f65627f4ef1b30132c0cf731cc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:54:53 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-284bdfd9-90bb-460a-98e9-3eea8cf0d86b tempest-VolumesCloneTest-1387177791 None] Creating volume 051354d2-84a0-42df-9954-76f6c73a305c {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:54:53 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-284bdfd9-90bb-460a-98e9-3eea8cf0d86b tempest-VolumesCloneTest-1387177791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:54:53 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-284bdfd9-90bb-460a-98e9-3eea8cf0d86b tempest-VolumesCloneTest-1387177791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:54:53 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-284bdfd9-90bb-460a-98e9-3eea8cf0d86b tempest-VolumesCloneTest-1387177791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:54:53 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-284bdfd9-90bb-460a-98e9-3eea8cf0d86b tempest-VolumesCloneTest-1387177791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:54:53 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-284bdfd9-90bb-460a-98e9-3eea8cf0d86b tempest-VolumesCloneTest-1387177791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:54:53 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-284bdfd9-90bb-460a-98e9-3eea8cf0d86b tempest-VolumesCloneTest-1387177791 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:54:53 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-284bdfd9-90bb-460a-98e9-3eea8cf0d86b tempest-VolumesCloneTest-1387177791 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:54:53 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-284bdfd9-90bb-460a-98e9-3eea8cf0d86b tempest-VolumesCloneTest-1387177791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-051354d2-84a0-42df-9954-76f6c73a305c 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:53 devstack sudo[104567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-051354d2-84a0-42df-9954-76f6c73a305c 1073741824 Sep 04 22:54:53 devstack sudo[104567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:53 devstack sudo[104567]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:53 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-284bdfd9-90bb-460a-98e9-3eea8cf0d86b tempest-VolumesCloneTest-1387177791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-051354d2-84a0-42df-9954-76f6c73a305c 1073741824" returned: 0 in 0.394s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:53 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-284bdfd9-90bb-460a-98e9-3eea8cf0d86b tempest-VolumesCloneTest-1387177791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-051354d2-84a0-42df-9954-76f6c73a305c {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:53 devstack sudo[104573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-051354d2-84a0-42df-9954-76f6c73a305c Sep 04 22:54:53 devstack sudo[104573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:53 devstack sudo[104573]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:53 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-284bdfd9-90bb-460a-98e9-3eea8cf0d86b tempest-VolumesCloneTest-1387177791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-051354d2-84a0-42df-9954-76f6c73a305c" returned: 0 in 0.242s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:53 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-284bdfd9-90bb-460a-98e9-3eea8cf0d86b tempest-VolumesCloneTest-1387177791 None] <== create_volume: return (674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:54:53 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-284bdfd9-90bb-460a-98e9-3eea8cf0d86b tempest-VolumesCloneTest-1387177791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.676s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:54:53 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-284bdfd9-90bb-460a-98e9-3eea8cf0d86b tempest-VolumesCloneTest-1387177791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (085b2991-24d4-4dc4-a769-50b581bc8142) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-051354d2-84a0-42df-9954-76f6c73a305c', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:53 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-284bdfd9-90bb-460a-98e9-3eea8cf0d86b tempest-VolumesCloneTest-1387177791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78f5274c-e505-4337-beed-b6cbf06e780e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:53 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-284bdfd9-90bb-460a-98e9-3eea8cf0d86b tempest-VolumesCloneTest-1387177791 None] Volume volume-051354d2-84a0-42df-9954-76f6c73a305c (051354d2-84a0-42df-9954-76f6c73a305c): created successfully Sep 04 22:54:53 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-284bdfd9-90bb-460a-98e9-3eea8cf0d86b tempest-VolumesCloneTest-1387177791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78f5274c-e505-4337-beed-b6cbf06e780e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:53 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-284bdfd9-90bb-460a-98e9-3eea8cf0d86b tempest-VolumesCloneTest-1387177791 None] Flow 'volume_create_manager' (cf51d504-46b8-4ee9-bd28-5042ad24f20b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:54:53 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-284bdfd9-90bb-460a-98e9-3eea8cf0d86b tempest-VolumesCloneTest-1387177791 None] Created volume successfully. Sep 04 22:54:54 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:54:54 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] Flow 'volume_create_manager' (19afbec5-e3ca-4b66-a54c-022ff61f4460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:54:54 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc8d6896-f8bb-42df-ae48-e2b5581c086a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:54 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc8d6896-f8bb-42df-ae48-e2b5581c086a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:54:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-162676649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b4e4295-f077-434f-86d9-c1de89dca054,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f0796f96a434bf8b2d05e3c24fbfa0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:54:54Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=051354d2-84a0-42df-9954-76f6c73a305c,status='creating',terminated_at=None,updated_at=2026-09-04T20:54:54Z,use_quota=True,user_id='bd809f65627f4ef1b30132c0cf731cc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:54 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ee080f5-37b3-45fb-abcb-425c9168bf60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:54 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ee080f5-37b3-45fb-abcb-425c9168bf60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:54 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af76ff9d-ed47-407f-bb5f-228c494f857f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:54 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af76ff9d-ed47-407f-bb5f-228c494f857f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '9b4e4295-f077-434f-86d9-c1de89dca054', 'volume_name': 'volume-9b4e4295-f077-434f-86d9-c1de89dca054', 'volume_size': 2, 'source_volid': '051354d2-84a0-42df-9954-76f6c73a305c', 'source_volstatus': 'available'}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:54 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e99373e3-c6e3-4f72-8af0-8705f1686a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:54 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e99373e3-c6e3-4f72-8af0-8705f1686a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:54:54 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9688e6e-2e2c-42b4-b4ff-929a09e364ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:54:54 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] Volume 9b4e4295-f077-434f-86d9-c1de89dca054: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-9b4e4295-f077-434f-86d9-c1de89dca054', 'volume_size': 2, 'source_volid': '051354d2-84a0-42df-9954-76f6c73a305c', 'source_volstatus': 'available'} Sep 04 22:54:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:54:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:54:54 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] Cloning volume 051354d2-84a0-42df-9954-76f6c73a305c to volume 9b4e4295-f077-434f-86d9-c1de89dca054 Sep 04 22:54:54 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] Creating offline snapshot 74f0c4fd-e396-4f29-bca9-aa5b59194567 of volume 051354d2-84a0-42df-9954-76f6c73a305c {{(pid=87576) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 22:54:54 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[250b3666-3268-4347-a1a3-3d53d8c95b7b]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:54:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-051354d2-84a0-42df-9954-76f6c73a305c {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:54 devstack sudo[104576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-051354d2-84a0-42df-9954-76f6c73a305c Sep 04 22:54:54 devstack sudo[104576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:54 devstack sudo[104576]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-051354d2-84a0-42df-9954-76f6c73a305c" returned: 0 in 0.354s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-051354d2-84a0-42df-9954-76f6c73a305c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-051354d2-84a0-42df-9954-76f6c73a305c.74f0c4fd-e396-4f29-bca9-aa5b59194567 1G {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:54 devstack sudo[104581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-051354d2-84a0-42df-9954-76f6c73a305c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-051354d2-84a0-42df-9954-76f6c73a305c.74f0c4fd-e396-4f29-bca9-aa5b59194567 1G Sep 04 22:54:54 devstack sudo[104581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:55 devstack sudo[104581]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-051354d2-84a0-42df-9954-76f6c73a305c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-051354d2-84a0-42df-9954-76f6c73a305c.74f0c4fd-e396-4f29-bca9-aa5b59194567 1G" returned: 0 in 0.400s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-051354d2-84a0-42df-9954-76f6c73a305c -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-051354d2-84a0-42df-9954-76f6c73a305c.74f0c4fd-e396-4f29-bca9-aa5b59194567 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:55 devstack sudo[104587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-051354d2-84a0-42df-9954-76f6c73a305c -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-051354d2-84a0-42df-9954-76f6c73a305c.74f0c4fd-e396-4f29-bca9-aa5b59194567 Sep 04 22:54:55 devstack sudo[104587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:55 devstack sudo[104587]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-051354d2-84a0-42df-9954-76f6c73a305c -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-051354d2-84a0-42df-9954-76f6c73a305c.74f0c4fd-e396-4f29-bca9-aa5b59194567" returned: 0 in 0.297s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:55 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-051354d2-84a0-42df-9954-76f6c73a305c.74f0c4fd-e396-4f29-bca9-aa5b59194567 is being set with open permissions: ugo+rw Sep 04 22:54:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-051354d2-84a0-42df-9954-76f6c73a305c.74f0c4fd-e396-4f29-bca9-aa5b59194567 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:55 devstack sudo[104592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-051354d2-84a0-42df-9954-76f6c73a305c.74f0c4fd-e396-4f29-bca9-aa5b59194567 Sep 04 22:54:55 devstack sudo[104592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:55 devstack sudo[104592]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-051354d2-84a0-42df-9954-76f6c73a305c.74f0c4fd-e396-4f29-bca9-aa5b59194567" returned: 0 in 0.245s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-051354d2-84a0-42df-9954-76f6c73a305c.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:55 devstack sudo[104595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-051354d2-84a0-42df-9954-76f6c73a305c.info Sep 04 22:54:55 devstack sudo[104595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:56 devstack sudo[104595]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-051354d2-84a0-42df-9954-76f6c73a305c.info" returned: 0 in 0.249s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:56 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-051354d2-84a0-42df-9954-76f6c73a305c.info is being set with open permissions: ugo+rw Sep 04 22:54:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-051354d2-84a0-42df-9954-76f6c73a305c.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:56 devstack sudo[104598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-051354d2-84a0-42df-9954-76f6c73a305c.info Sep 04 22:54:56 devstack sudo[104598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:56 devstack sudo[104598]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-051354d2-84a0-42df-9954-76f6c73a305c.info" returned: 0 in 0.247s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:56 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] Acquiring lock "cinder-quobyte-9b4e4295-f077-434f-86d9-c1de89dca054" by "_copy_volume_from_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:54:56 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] Lock "cinder-quobyte-9b4e4295-f077-434f-86d9-c1de89dca054" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:54:56 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] snapshot: 74f0c4fd-e396-4f29-bca9-aa5b59194567, volume: 9b4e4295-f077-434f-86d9-c1de89dca054, {{(pid=87576) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 04 22:54:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:54:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:54:56 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:54:56 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:54:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:54:56 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf47843-c546-4487-a709-03922aaa8e5f]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:54:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-051354d2-84a0-42df-9954-76f6c73a305c.74f0c4fd-e396-4f29-bca9-aa5b59194567 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:56 devstack sudo[104601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-051354d2-84a0-42df-9954-76f6c73a305c.74f0c4fd-e396-4f29-bca9-aa5b59194567 Sep 04 22:54:56 devstack sudo[104601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:56 devstack sudo[104601]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-051354d2-84a0-42df-9954-76f6c73a305c.74f0c4fd-e396-4f29-bca9-aa5b59194567" returned: 0 in 0.373s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:56 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-051354d2-84a0-42df-9954-76f6c73a305c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 22:54:56 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[f27bc44b-0d76-40c3-a195-18a276eb219d]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:54:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-051354d2-84a0-42df-9954-76f6c73a305c {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:56 devstack sudo[104606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-051354d2-84a0-42df-9954-76f6c73a305c Sep 04 22:54:56 devstack sudo[104606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:54:57 devstack sudo[104606]: pam_unix(sudo:session): session closed for user root Sep 04 22:54:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-051354d2-84a0-42df-9954-76f6c73a305c" returned: 0 in 0.356s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:54:57 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-051354d2-84a0-42df-9954-76f6c73a305c {{(pid=87576) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 04 22:54:57 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] Creating direct copy from snapshot {{(pid=87576) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 04 22:54:57 devstack cinder-volume[87576]: DEBUG cinder.utils [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] Path /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9b4e4295-f077-434f-86d9-c1de89dca054 not found in is_blk_device check {{(pid=87576) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 04 22:54:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-051354d2-84a0-42df-9954-76f6c73a305c /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9b4e4295-f077-434f-86d9-c1de89dca054 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:54:57 devstack sudo[104612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-051354d2-84a0-42df-9954-76f6c73a305c /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9b4e4295-f077-434f-86d9-c1de89dca054 Sep 04 22:54:57 devstack sudo[104612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:55:01 devstack sudo[104612]: pam_unix(sudo:session): session closed for user root Sep 04 22:55:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-051354d2-84a0-42df-9954-76f6c73a305c /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9b4e4295-f077-434f-86d9-c1de89dca054" returned: 0 in 4.180s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:55:01 devstack cinder-volume[87576]: DEBUG cinder.image.image_utils [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] Image conversion details: src /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-051354d2-84a0-42df-9954-76f6c73a305c, size 1024.00 MB, duration 4.18 sec, destination /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9b4e4295-f077-434f-86d9-c1de89dca054 {{(pid=87576) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 22:55:01 devstack cinder-volume[87576]: INFO cinder.image.image_utils [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] Converted 1024.00 MB image at 244.89 MB/s Sep 04 22:55:01 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9b4e4295-f077-434f-86d9-c1de89dca054 is being set with open permissions: ugo+rw Sep 04 22:55:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9b4e4295-f077-434f-86d9-c1de89dca054 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:55:01 devstack sudo[104624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9b4e4295-f077-434f-86d9-c1de89dca054 Sep 04 22:55:01 devstack sudo[104624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:55:01 devstack sudo[104624]: pam_unix(sudo:session): session closed for user root Sep 04 22:55:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9b4e4295-f077-434f-86d9-c1de89dca054" returned: 0 in 0.234s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:55:01 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] Lock "cinder-quobyte-9b4e4295-f077-434f-86d9-c1de89dca054" released by "_copy_volume_from_snapshot" :: held 5.205s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:55:01 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] Acquiring lock "cinder-quobyte-74f0c4fd-e396-4f29-bca9-aa5b59194567" by "_delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:55:01 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] Lock "cinder-quobyte-74f0c4fd-e396-4f29-bca9-aa5b59194567" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:55:01 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] Deleting offline snapshot 74f0c4fd-e396-4f29-bca9-aa5b59194567 of volume 051354d2-84a0-42df-9954-76f6c73a305c {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 22:55:01 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] snapshot_file for this snap is: volume-051354d2-84a0-42df-9954-76f6c73a305c.74f0c4fd-e396-4f29-bca9-aa5b59194567 {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 22:55:01 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[45cb7e45-4225-4847-bfc9-6767006ef7c5]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:55:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-051354d2-84a0-42df-9954-76f6c73a305c.74f0c4fd-e396-4f29-bca9-aa5b59194567 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:55:01 devstack sudo[104627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-051354d2-84a0-42df-9954-76f6c73a305c.74f0c4fd-e396-4f29-bca9-aa5b59194567 Sep 04 22:55:01 devstack sudo[104627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:55:02 devstack sudo[104627]: pam_unix(sudo:session): session closed for user root Sep 04 22:55:02 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-051354d2-84a0-42df-9954-76f6c73a305c.74f0c4fd-e396-4f29-bca9-aa5b59194567" returned: 0 in 0.424s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:55:02 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-051354d2-84a0-42df-9954-76f6c73a305c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 22:55:02 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f747ceb-b395-413c-8e5c-bd65b4f4b72d]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:55:02 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-051354d2-84a0-42df-9954-76f6c73a305c {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:55:02 devstack sudo[104818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-051354d2-84a0-42df-9954-76f6c73a305c Sep 04 22:55:02 devstack sudo[104818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:55:02 devstack sudo[104818]: pam_unix(sudo:session): session closed for user root Sep 04 22:55:02 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-051354d2-84a0-42df-9954-76f6c73a305c" returned: 0 in 0.555s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:55:02 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-051354d2-84a0-42df-9954-76f6c73a305c.74f0c4fd-e396-4f29-bca9-aa5b59194567 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:55:02 devstack sudo[104973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-051354d2-84a0-42df-9954-76f6c73a305c.74f0c4fd-e396-4f29-bca9-aa5b59194567 Sep 04 22:55:02 devstack sudo[104973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:55:03 devstack sudo[104973]: pam_unix(sudo:session): session closed for user root Sep 04 22:55:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-051354d2-84a0-42df-9954-76f6c73a305c.74f0c4fd-e396-4f29-bca9-aa5b59194567" returned: 0 in 0.348s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:55:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-051354d2-84a0-42df-9954-76f6c73a305c.74f0c4fd-e396-4f29-bca9-aa5b59194567 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:55:03 devstack sudo[104979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-051354d2-84a0-42df-9954-76f6c73a305c.74f0c4fd-e396-4f29-bca9-aa5b59194567 Sep 04 22:55:03 devstack sudo[104979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:55:03 devstack sudo[104979]: pam_unix(sudo:session): session closed for user root Sep 04 22:55:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-051354d2-84a0-42df-9954-76f6c73a305c.74f0c4fd-e396-4f29-bca9-aa5b59194567" returned: 0 in 0.246s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:55:03 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] Lock "cinder-quobyte-74f0c4fd-e396-4f29-bca9-aa5b59194567" released by "_delete_snapshot" :: held 1.660s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:55:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.840s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:55:03 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9688e6e-2e2c-42b4-b4ff-929a09e364ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b4e4295-f077-434f-86d9-c1de89dca054', 'volume_size': 2, 'source_volid': '051354d2-84a0-42df-9954-76f6c73a305c', 'source_volstatus': 'available'}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:55:03 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2fc3ee5-43b3-42a1-be13-81c735ef5bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:55:03 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] Volume volume-9b4e4295-f077-434f-86d9-c1de89dca054 (9b4e4295-f077-434f-86d9-c1de89dca054): created successfully Sep 04 22:55:03 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2fc3ee5-43b3-42a1-be13-81c735ef5bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:55:03 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] Flow 'volume_create_manager' (19afbec5-e3ca-4b66-a54c-022ff61f4460) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:55:03 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-e4891c9d-89ac-42d1-abc1-705f8ecd7f52 tempest-VolumesCloneTest-1387177791 None] Created volume successfully. Sep 04 22:55:04 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-1209e5fa-53a5-4b40-a801-40f0381708c6 tempest-VolumesCloneTest-1387177791 None] Acquiring lock "cinder-9b4e4295-f077-434f-86d9-c1de89dca054-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:55:04 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-1209e5fa-53a5-4b40-a801-40f0381708c6 tempest-VolumesCloneTest-1387177791 None] Lock "cinder-9b4e4295-f077-434f-86d9-c1de89dca054-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:55:04 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-1209e5fa-53a5-4b40-a801-40f0381708c6 tempest-VolumesCloneTest-1387177791 None] Acquiring lock "cinder-quobyte-9b4e4295-f077-434f-86d9-c1de89dca054" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:55:04 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-1209e5fa-53a5-4b40-a801-40f0381708c6 tempest-VolumesCloneTest-1387177791 None] Lock "cinder-quobyte-9b4e4295-f077-434f-86d9-c1de89dca054" acquired by "delete_volume" :: waited 0.017s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:55:04 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[21373906-bc8d-461d-8b4d-256846b62ba6]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:55:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-1209e5fa-53a5-4b40-a801-40f0381708c6 tempest-VolumesCloneTest-1387177791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9b4e4295-f077-434f-86d9-c1de89dca054 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:55:04 devstack sudo[104983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9b4e4295-f077-434f-86d9-c1de89dca054 Sep 04 22:55:04 devstack sudo[104983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:55:04 devstack sudo[104983]: pam_unix(sudo:session): session closed for user root Sep 04 22:55:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-1209e5fa-53a5-4b40-a801-40f0381708c6 tempest-VolumesCloneTest-1387177791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9b4e4295-f077-434f-86d9-c1de89dca054" returned: 0 in 0.386s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:55:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-1209e5fa-53a5-4b40-a801-40f0381708c6 tempest-VolumesCloneTest-1387177791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9b4e4295-f077-434f-86d9-c1de89dca054 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:55:04 devstack sudo[104988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9b4e4295-f077-434f-86d9-c1de89dca054 Sep 04 22:55:04 devstack sudo[104988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:55:05 devstack sudo[104988]: pam_unix(sudo:session): session closed for user root Sep 04 22:55:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-1209e5fa-53a5-4b40-a801-40f0381708c6 tempest-VolumesCloneTest-1387177791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9b4e4295-f077-434f-86d9-c1de89dca054" returned: 0 in 0.268s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:55:05 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-1209e5fa-53a5-4b40-a801-40f0381708c6 tempest-VolumesCloneTest-1387177791 None] Lock "cinder-quobyte-9b4e4295-f077-434f-86d9-c1de89dca054" released by "delete_volume" :: held 0.695s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:55:05 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-1209e5fa-53a5-4b40-a801-40f0381708c6 tempest-VolumesCloneTest-1387177791 None] Created reservations ['297f53b2-15cc-45c8-8bb1-1bb2f3fa6597', '31bf8c48-dd47-4cf8-b4ee-9f29c2aa2a56', 'ca666037-0fb6-4bd4-a1d9-71a5b1a074c8', 'd37c4ae4-53ed-4798-b3f6-c05c399136e3'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:55:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-1209e5fa-53a5-4b40-a801-40f0381708c6 tempest-VolumesCloneTest-1387177791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:55:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-1209e5fa-53a5-4b40-a801-40f0381708c6 tempest-VolumesCloneTest-1387177791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:55:05 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-1209e5fa-53a5-4b40-a801-40f0381708c6 tempest-VolumesCloneTest-1387177791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:55:05 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-1209e5fa-53a5-4b40-a801-40f0381708c6 tempest-VolumesCloneTest-1387177791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:55:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-1209e5fa-53a5-4b40-a801-40f0381708c6 tempest-VolumesCloneTest-1387177791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:55:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-1209e5fa-53a5-4b40-a801-40f0381708c6 tempest-VolumesCloneTest-1387177791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:55:05 devstack sudo[104991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:55:05 devstack sudo[104991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:55:05 devstack sudo[104991]: pam_unix(sudo:session): session closed for user root Sep 04 22:55:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-1209e5fa-53a5-4b40-a801-40f0381708c6 tempest-VolumesCloneTest-1387177791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.238s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:55:05 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-1209e5fa-53a5-4b40-a801-40f0381708c6 tempest-VolumesCloneTest-1387177791 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:55:05 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-1209e5fa-53a5-4b40-a801-40f0381708c6 tempest-VolumesCloneTest-1387177791 None] Deleted volume successfully. Sep 04 22:55:05 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-1209e5fa-53a5-4b40-a801-40f0381708c6 tempest-VolumesCloneTest-1387177791 None] Lock "cinder-9b4e4295-f077-434f-86d9-c1de89dca054-delete_volume" released by "delete_volume" :: held 1.120s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:55:05 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-bc51b0e5-a8ec-4c6e-a016-015470f25bdf tempest-VolumesCloneTest-1387177791 None] Acquiring lock "cinder-051354d2-84a0-42df-9954-76f6c73a305c-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:55:05 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-bc51b0e5-a8ec-4c6e-a016-015470f25bdf tempest-VolumesCloneTest-1387177791 None] Lock "cinder-051354d2-84a0-42df-9954-76f6c73a305c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:55:05 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-bc51b0e5-a8ec-4c6e-a016-015470f25bdf tempest-VolumesCloneTest-1387177791 None] Acquiring lock "cinder-quobyte-051354d2-84a0-42df-9954-76f6c73a305c" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:55:05 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-bc51b0e5-a8ec-4c6e-a016-015470f25bdf tempest-VolumesCloneTest-1387177791 None] Lock "cinder-quobyte-051354d2-84a0-42df-9954-76f6c73a305c" acquired by "delete_volume" :: waited 0.014s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:55:05 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e1b45d-1712-42ac-9eb9-55413f53e0af]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:55:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-bc51b0e5-a8ec-4c6e-a016-015470f25bdf tempest-VolumesCloneTest-1387177791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-051354d2-84a0-42df-9954-76f6c73a305c {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:55:05 devstack sudo[104994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-051354d2-84a0-42df-9954-76f6c73a305c Sep 04 22:55:05 devstack sudo[104994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:55:05 devstack sudo[104994]: pam_unix(sudo:session): session closed for user root Sep 04 22:55:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-bc51b0e5-a8ec-4c6e-a016-015470f25bdf tempest-VolumesCloneTest-1387177791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-051354d2-84a0-42df-9954-76f6c73a305c" returned: 0 in 0.355s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:55:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-bc51b0e5-a8ec-4c6e-a016-015470f25bdf tempest-VolumesCloneTest-1387177791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-051354d2-84a0-42df-9954-76f6c73a305c {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:55:05 devstack sudo[104999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-051354d2-84a0-42df-9954-76f6c73a305c Sep 04 22:55:05 devstack sudo[104999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:55:06 devstack sudo[104999]: pam_unix(sudo:session): session closed for user root Sep 04 22:55:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-bc51b0e5-a8ec-4c6e-a016-015470f25bdf tempest-VolumesCloneTest-1387177791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-051354d2-84a0-42df-9954-76f6c73a305c" returned: 0 in 0.260s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:55:06 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-bc51b0e5-a8ec-4c6e-a016-015470f25bdf tempest-VolumesCloneTest-1387177791 None] Lock "cinder-quobyte-051354d2-84a0-42df-9954-76f6c73a305c" released by "delete_volume" :: held 0.675s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:55:06 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-bc51b0e5-a8ec-4c6e-a016-015470f25bdf tempest-VolumesCloneTest-1387177791 None] Created reservations ['489efbc1-0c64-480e-894c-fe6d9949c463', '82713a7a-622d-42d5-b8e7-a40318ff5581', 'dc337a16-cf86-430f-add4-161de5c1246b', '2009d813-79f2-4c70-b10c-21f11474f980'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:55:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-bc51b0e5-a8ec-4c6e-a016-015470f25bdf tempest-VolumesCloneTest-1387177791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:55:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-bc51b0e5-a8ec-4c6e-a016-015470f25bdf tempest-VolumesCloneTest-1387177791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:55:06 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-bc51b0e5-a8ec-4c6e-a016-015470f25bdf tempest-VolumesCloneTest-1387177791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:55:06 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-bc51b0e5-a8ec-4c6e-a016-015470f25bdf tempest-VolumesCloneTest-1387177791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:55:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-bc51b0e5-a8ec-4c6e-a016-015470f25bdf tempest-VolumesCloneTest-1387177791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:55:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-bc51b0e5-a8ec-4c6e-a016-015470f25bdf tempest-VolumesCloneTest-1387177791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:55:06 devstack sudo[105002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:55:06 devstack sudo[105002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:55:06 devstack sudo[105002]: pam_unix(sudo:session): session closed for user root Sep 04 22:55:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-bc51b0e5-a8ec-4c6e-a016-015470f25bdf tempest-VolumesCloneTest-1387177791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.244s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:55:06 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-bc51b0e5-a8ec-4c6e-a016-015470f25bdf tempest-VolumesCloneTest-1387177791 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:55:06 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-bc51b0e5-a8ec-4c6e-a016-015470f25bdf tempest-VolumesCloneTest-1387177791 None] Deleted volume successfully. Sep 04 22:55:06 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-bc51b0e5-a8ec-4c6e-a016-015470f25bdf tempest-VolumesCloneTest-1387177791 None] Lock "cinder-051354d2-84a0-42df-9954-76f6c73a305c-delete_volume" released by "delete_volume" :: held 1.124s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:55:09 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-560efb31-0189-4be2-b3e7-57fd01956f1e tempest-VolumesGetTest-1720378588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:55:09 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-560efb31-0189-4be2-b3e7-57fd01956f1e tempest-VolumesGetTest-1720378588 None] Flow 'volume_create_manager' (97252c9e-fffc-40cf-b3e3-36ccc3f96647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:55:09 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-560efb31-0189-4be2-b3e7-57fd01956f1e tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f88dd2a-1dac-4cc8-8e9b-cae64bcb475e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:55:09 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-560efb31-0189-4be2-b3e7-57fd01956f1e tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f88dd2a-1dac-4cc8-8e9b-cae64bcb475e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:55:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-513828468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31141e1c-9aac-44ed-b17c-76db3dce41d4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='63005c5628c5451e83490fb0eefa253a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:55:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:55:09Z,use_quota=True,user_id='7d2849723d644fd492c510b0f6965e32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:55:09 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-560efb31-0189-4be2-b3e7-57fd01956f1e tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4872ddd-7994-4834-ae39-671be2eca1d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:55:09 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-560efb31-0189-4be2-b3e7-57fd01956f1e tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4872ddd-7994-4834-ae39-671be2eca1d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:55:09 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-560efb31-0189-4be2-b3e7-57fd01956f1e tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0855c04f-d964-4c7a-a447-481dbf468b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:55:09 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-560efb31-0189-4be2-b3e7-57fd01956f1e tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0855c04f-d964-4c7a-a447-481dbf468b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31141e1c-9aac-44ed-b17c-76db3dce41d4', 'volume_name': 'volume-31141e1c-9aac-44ed-b17c-76db3dce41d4', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:55:09 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-560efb31-0189-4be2-b3e7-57fd01956f1e tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79282a03-3708-4f4f-a69d-a6dff733d776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:55:09 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-560efb31-0189-4be2-b3e7-57fd01956f1e tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79282a03-3708-4f4f-a69d-a6dff733d776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:55:09 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-560efb31-0189-4be2-b3e7-57fd01956f1e tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ba6634b-fda0-4f13-a4f1-28e825a20206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:55:09 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-560efb31-0189-4be2-b3e7-57fd01956f1e tempest-VolumesGetTest-1720378588 None] Volume 31141e1c-9aac-44ed-b17c-76db3dce41d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31141e1c-9aac-44ed-b17c-76db3dce41d4', 'volume_size': 1} Sep 04 22:55:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-560efb31-0189-4be2-b3e7-57fd01956f1e tempest-VolumesGetTest-1720378588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:55:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-560efb31-0189-4be2-b3e7-57fd01956f1e tempest-VolumesGetTest-1720378588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:55:09 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-560efb31-0189-4be2-b3e7-57fd01956f1e tempest-VolumesGetTest-1720378588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:55:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-513828468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31141e1c-9aac-44ed-b17c-76db3dce41d4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='63005c5628c5451e83490fb0eefa253a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:55:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:55:09Z,use_quota=True,user_id='7d2849723d644fd492c510b0f6965e32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:55:09 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-560efb31-0189-4be2-b3e7-57fd01956f1e tempest-VolumesGetTest-1720378588 None] Creating volume 31141e1c-9aac-44ed-b17c-76db3dce41d4 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:55:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-560efb31-0189-4be2-b3e7-57fd01956f1e tempest-VolumesGetTest-1720378588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:55:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-560efb31-0189-4be2-b3e7-57fd01956f1e tempest-VolumesGetTest-1720378588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:55:09 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-560efb31-0189-4be2-b3e7-57fd01956f1e tempest-VolumesGetTest-1720378588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:55:09 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-560efb31-0189-4be2-b3e7-57fd01956f1e tempest-VolumesGetTest-1720378588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:55:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-560efb31-0189-4be2-b3e7-57fd01956f1e tempest-VolumesGetTest-1720378588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:55:09 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-560efb31-0189-4be2-b3e7-57fd01956f1e tempest-VolumesGetTest-1720378588 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:55:09 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-560efb31-0189-4be2-b3e7-57fd01956f1e tempest-VolumesGetTest-1720378588 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:55:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-560efb31-0189-4be2-b3e7-57fd01956f1e tempest-VolumesGetTest-1720378588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-31141e1c-9aac-44ed-b17c-76db3dce41d4 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:55:09 devstack sudo[105005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-31141e1c-9aac-44ed-b17c-76db3dce41d4 1073741824 Sep 04 22:55:09 devstack sudo[105005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:55:09 devstack sudo[105005]: pam_unix(sudo:session): session closed for user root Sep 04 22:55:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-560efb31-0189-4be2-b3e7-57fd01956f1e tempest-VolumesGetTest-1720378588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-31141e1c-9aac-44ed-b17c-76db3dce41d4 1073741824" returned: 0 in 0.412s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:55:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-560efb31-0189-4be2-b3e7-57fd01956f1e tempest-VolumesGetTest-1720378588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-31141e1c-9aac-44ed-b17c-76db3dce41d4 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:55:09 devstack sudo[105011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-31141e1c-9aac-44ed-b17c-76db3dce41d4 Sep 04 22:55:09 devstack sudo[105011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:55:10 devstack sudo[105011]: pam_unix(sudo:session): session closed for user root Sep 04 22:55:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-560efb31-0189-4be2-b3e7-57fd01956f1e tempest-VolumesGetTest-1720378588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-31141e1c-9aac-44ed-b17c-76db3dce41d4" returned: 0 in 0.239s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:55:10 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-560efb31-0189-4be2-b3e7-57fd01956f1e tempest-VolumesGetTest-1720378588 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:55:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-560efb31-0189-4be2-b3e7-57fd01956f1e tempest-VolumesGetTest-1720378588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:55:10 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-560efb31-0189-4be2-b3e7-57fd01956f1e tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ba6634b-fda0-4f13-a4f1-28e825a20206) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31141e1c-9aac-44ed-b17c-76db3dce41d4', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:55:10 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-560efb31-0189-4be2-b3e7-57fd01956f1e tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8be17c0a-b838-4bfb-a587-7a828b693cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:55:10 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-560efb31-0189-4be2-b3e7-57fd01956f1e tempest-VolumesGetTest-1720378588 None] Volume volume-31141e1c-9aac-44ed-b17c-76db3dce41d4 (31141e1c-9aac-44ed-b17c-76db3dce41d4): created successfully Sep 04 22:55:10 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-560efb31-0189-4be2-b3e7-57fd01956f1e tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8be17c0a-b838-4bfb-a587-7a828b693cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:55:10 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-560efb31-0189-4be2-b3e7-57fd01956f1e tempest-VolumesGetTest-1720378588 None] Flow 'volume_create_manager' (97252c9e-fffc-40cf-b3e3-36ccc3f96647) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:55:10 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-560efb31-0189-4be2-b3e7-57fd01956f1e tempest-VolumesGetTest-1720378588 None] Created volume successfully. Sep 04 22:55:10 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf4f7467-2c5b-40d4-abb7-d31a929422f1 tempest-VolumesGetTest-1720378588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:55:10 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-cf4f7467-2c5b-40d4-abb7-d31a929422f1 tempest-VolumesGetTest-1720378588 None] Flow 'volume_create_manager' (7c4cd2b8-260c-4073-a3d5-8143a7ff0bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:55:10 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-cf4f7467-2c5b-40d4-abb7-d31a929422f1 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6131b64a-d569-499a-baf4-b2e1ba69879b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:55:11 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-cf4f7467-2c5b-40d4-abb7-d31a929422f1 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6131b64a-d569-499a-baf4-b2e1ba69879b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:55:11Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-319907698',display_name='tempest-VolumesGetTest-Volume-834005851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52e3d63a-d36b-4783-9e77-ff35e8f8db28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63005c5628c5451e83490fb0eefa253a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:55:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:55:11Z,use_quota=True,user_id='7d2849723d644fd492c510b0f6965e32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:55:11 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-cf4f7467-2c5b-40d4-abb7-d31a929422f1 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abc9a0a4-859e-4a65-bc0e-c9727e9e79f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:55:11 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-cf4f7467-2c5b-40d4-abb7-d31a929422f1 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abc9a0a4-859e-4a65-bc0e-c9727e9e79f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:55:11 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-cf4f7467-2c5b-40d4-abb7-d31a929422f1 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95d9f936-7e41-40c8-b57d-d00b5630d3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:55:11 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-cf4f7467-2c5b-40d4-abb7-d31a929422f1 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95d9f936-7e41-40c8-b57d-d00b5630d3ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52e3d63a-d36b-4783-9e77-ff35e8f8db28', 'volume_name': 'volume-52e3d63a-d36b-4783-9e77-ff35e8f8db28', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:55:11 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-cf4f7467-2c5b-40d4-abb7-d31a929422f1 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95b5a485-6480-463b-8d04-3ca7936c1563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:55:11 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-cf4f7467-2c5b-40d4-abb7-d31a929422f1 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95b5a485-6480-463b-8d04-3ca7936c1563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:55:11 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-cf4f7467-2c5b-40d4-abb7-d31a929422f1 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (326c5822-1a0e-464d-b0d7-8c4828a75fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:55:11 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-cf4f7467-2c5b-40d4-abb7-d31a929422f1 tempest-VolumesGetTest-1720378588 None] Volume 52e3d63a-d36b-4783-9e77-ff35e8f8db28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52e3d63a-d36b-4783-9e77-ff35e8f8db28', 'volume_size': 1} Sep 04 22:55:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-cf4f7467-2c5b-40d4-abb7-d31a929422f1 tempest-VolumesGetTest-1720378588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:55:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-cf4f7467-2c5b-40d4-abb7-d31a929422f1 tempest-VolumesGetTest-1720378588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:55:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-cf4f7467-2c5b-40d4-abb7-d31a929422f1 tempest-VolumesGetTest-1720378588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:55:11Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-319907698',display_name='tempest-VolumesGetTest-Volume-834005851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52e3d63a-d36b-4783-9e77-ff35e8f8db28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63005c5628c5451e83490fb0eefa253a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:55:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:55:11Z,use_quota=True,user_id='7d2849723d644fd492c510b0f6965e32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:55:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-cf4f7467-2c5b-40d4-abb7-d31a929422f1 tempest-VolumesGetTest-1720378588 None] Creating volume 52e3d63a-d36b-4783-9e77-ff35e8f8db28 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:55:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-cf4f7467-2c5b-40d4-abb7-d31a929422f1 tempest-VolumesGetTest-1720378588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:55:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-cf4f7467-2c5b-40d4-abb7-d31a929422f1 tempest-VolumesGetTest-1720378588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:55:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-cf4f7467-2c5b-40d4-abb7-d31a929422f1 tempest-VolumesGetTest-1720378588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:55:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-cf4f7467-2c5b-40d4-abb7-d31a929422f1 tempest-VolumesGetTest-1720378588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:55:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-cf4f7467-2c5b-40d4-abb7-d31a929422f1 tempest-VolumesGetTest-1720378588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:55:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-cf4f7467-2c5b-40d4-abb7-d31a929422f1 tempest-VolumesGetTest-1720378588 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:55:11 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-cf4f7467-2c5b-40d4-abb7-d31a929422f1 tempest-VolumesGetTest-1720378588 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:55:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-cf4f7467-2c5b-40d4-abb7-d31a929422f1 tempest-VolumesGetTest-1720378588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-52e3d63a-d36b-4783-9e77-ff35e8f8db28 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:55:11 devstack sudo[105014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-52e3d63a-d36b-4783-9e77-ff35e8f8db28 1073741824 Sep 04 22:55:11 devstack sudo[105014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:55:11 devstack sudo[105014]: pam_unix(sudo:session): session closed for user root Sep 04 22:55:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-cf4f7467-2c5b-40d4-abb7-d31a929422f1 tempest-VolumesGetTest-1720378588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-52e3d63a-d36b-4783-9e77-ff35e8f8db28 1073741824" returned: 0 in 0.398s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:55:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-cf4f7467-2c5b-40d4-abb7-d31a929422f1 tempest-VolumesGetTest-1720378588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-52e3d63a-d36b-4783-9e77-ff35e8f8db28 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:55:11 devstack sudo[105019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-52e3d63a-d36b-4783-9e77-ff35e8f8db28 Sep 04 22:55:11 devstack sudo[105019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:55:11 devstack sudo[105019]: pam_unix(sudo:session): session closed for user root Sep 04 22:55:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-cf4f7467-2c5b-40d4-abb7-d31a929422f1 tempest-VolumesGetTest-1720378588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-52e3d63a-d36b-4783-9e77-ff35e8f8db28" returned: 0 in 0.239s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:55:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-cf4f7467-2c5b-40d4-abb7-d31a929422f1 tempest-VolumesGetTest-1720378588 None] <== create_volume: return (678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:55:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-cf4f7467-2c5b-40d4-abb7-d31a929422f1 tempest-VolumesGetTest-1720378588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.680s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:55:11 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-cf4f7467-2c5b-40d4-abb7-d31a929422f1 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (326c5822-1a0e-464d-b0d7-8c4828a75fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52e3d63a-d36b-4783-9e77-ff35e8f8db28', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:55:11 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-cf4f7467-2c5b-40d4-abb7-d31a929422f1 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ebd7c99-0bf5-450f-b0f3-8ab524ba8d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:55:11 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-cf4f7467-2c5b-40d4-abb7-d31a929422f1 tempest-VolumesGetTest-1720378588 None] Volume volume-52e3d63a-d36b-4783-9e77-ff35e8f8db28 (52e3d63a-d36b-4783-9e77-ff35e8f8db28): created successfully Sep 04 22:55:11 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-cf4f7467-2c5b-40d4-abb7-d31a929422f1 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ebd7c99-0bf5-450f-b0f3-8ab524ba8d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:55:11 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-cf4f7467-2c5b-40d4-abb7-d31a929422f1 tempest-VolumesGetTest-1720378588 None] Flow 'volume_create_manager' (7c4cd2b8-260c-4073-a3d5-8143a7ff0bac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:55:11 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-cf4f7467-2c5b-40d4-abb7-d31a929422f1 tempest-VolumesGetTest-1720378588 None] Created volume successfully. Sep 04 22:55:11 devstack cinder-volume[87576]: DEBUG oslo_service.periodic_task [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87576) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 22:55:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:55:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:55:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:55:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:55:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:55:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:55:11 devstack sudo[105022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:55:11 devstack sudo[105022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:55:12 devstack sudo[105022]: pam_unix(sudo:session): session closed for user root Sep 04 22:55:12 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-555976ae-8c77-46b2-9fbe-cd7c64d54907 tempest-VolumesGetTest-1720378588 None] Acquiring lock "cinder-52e3d63a-d36b-4783-9e77-ff35e8f8db28-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:55:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.273s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:55:12 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:55:12 devstack cinder-volume[87576]: DEBUG oslo_service.periodic_task [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Running periodic task VolumeManager._thread_info {{(pid=87576) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 22:55:12 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] thread count: 28 {{(pid=87576) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 22:55:12 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] thread info: [<_MainThread(MainThread, started 125730416963712)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87576) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 22:55:12 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-555976ae-8c77-46b2-9fbe-cd7c64d54907 tempest-VolumesGetTest-1720378588 None] Lock "cinder-52e3d63a-d36b-4783-9e77-ff35e8f8db28-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:55:12 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-555976ae-8c77-46b2-9fbe-cd7c64d54907 tempest-VolumesGetTest-1720378588 None] Acquiring lock "cinder-quobyte-52e3d63a-d36b-4783-9e77-ff35e8f8db28" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:55:12 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-555976ae-8c77-46b2-9fbe-cd7c64d54907 tempest-VolumesGetTest-1720378588 None] Lock "cinder-quobyte-52e3d63a-d36b-4783-9e77-ff35e8f8db28" acquired by "delete_volume" :: waited 0.017s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:55:12 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a022c1-190b-4ab4-81d3-4428dec8ced0]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:55:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-555976ae-8c77-46b2-9fbe-cd7c64d54907 tempest-VolumesGetTest-1720378588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-52e3d63a-d36b-4783-9e77-ff35e8f8db28 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:55:12 devstack sudo[105025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-52e3d63a-d36b-4783-9e77-ff35e8f8db28 Sep 04 22:55:12 devstack sudo[105025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:55:12 devstack sudo[105025]: pam_unix(sudo:session): session closed for user root Sep 04 22:55:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-555976ae-8c77-46b2-9fbe-cd7c64d54907 tempest-VolumesGetTest-1720378588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-52e3d63a-d36b-4783-9e77-ff35e8f8db28" returned: 0 in 0.347s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:55:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-555976ae-8c77-46b2-9fbe-cd7c64d54907 tempest-VolumesGetTest-1720378588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-52e3d63a-d36b-4783-9e77-ff35e8f8db28 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:55:12 devstack sudo[105030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-52e3d63a-d36b-4783-9e77-ff35e8f8db28 Sep 04 22:55:12 devstack sudo[105030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:55:12 devstack sudo[105030]: pam_unix(sudo:session): session closed for user root Sep 04 22:55:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-555976ae-8c77-46b2-9fbe-cd7c64d54907 tempest-VolumesGetTest-1720378588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-52e3d63a-d36b-4783-9e77-ff35e8f8db28" returned: 0 in 0.248s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:55:12 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-555976ae-8c77-46b2-9fbe-cd7c64d54907 tempest-VolumesGetTest-1720378588 None] Lock "cinder-quobyte-52e3d63a-d36b-4783-9e77-ff35e8f8db28" released by "delete_volume" :: held 0.635s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:55:12 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-555976ae-8c77-46b2-9fbe-cd7c64d54907 tempest-VolumesGetTest-1720378588 None] Created reservations ['89db1ff8-97ab-4996-9a62-9d072c4c8921', '3f3292fc-0bb0-4c6a-948e-30bae0bdf8fe', 'f1cc5fb3-9f08-4acb-94dd-3cbe81752940', '52d99e3e-93ac-433a-aee3-3e947a310d77'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:55:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-555976ae-8c77-46b2-9fbe-cd7c64d54907 tempest-VolumesGetTest-1720378588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:55:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-555976ae-8c77-46b2-9fbe-cd7c64d54907 tempest-VolumesGetTest-1720378588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:55:12 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-555976ae-8c77-46b2-9fbe-cd7c64d54907 tempest-VolumesGetTest-1720378588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:55:12 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-555976ae-8c77-46b2-9fbe-cd7c64d54907 tempest-VolumesGetTest-1720378588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:55:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-555976ae-8c77-46b2-9fbe-cd7c64d54907 tempest-VolumesGetTest-1720378588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:55:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-555976ae-8c77-46b2-9fbe-cd7c64d54907 tempest-VolumesGetTest-1720378588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:55:12 devstack sudo[105034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:55:12 devstack sudo[105034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:55:13 devstack sudo[105034]: pam_unix(sudo:session): session closed for user root Sep 04 22:55:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-555976ae-8c77-46b2-9fbe-cd7c64d54907 tempest-VolumesGetTest-1720378588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.259s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:55:13 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-555976ae-8c77-46b2-9fbe-cd7c64d54907 tempest-VolumesGetTest-1720378588 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:55:13 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-555976ae-8c77-46b2-9fbe-cd7c64d54907 tempest-VolumesGetTest-1720378588 None] Deleted volume successfully. Sep 04 22:55:13 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-555976ae-8c77-46b2-9fbe-cd7c64d54907 tempest-VolumesGetTest-1720378588 None] Lock "cinder-52e3d63a-d36b-4783-9e77-ff35e8f8db28-delete_volume" released by "delete_volume" :: held 1.090s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:55:13 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-68c6ea31-2616-4808-81b2-34d11ab40972 tempest-VolumesGetTest-1720378588 None] Acquiring lock "cinder-31141e1c-9aac-44ed-b17c-76db3dce41d4-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:55:13 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-68c6ea31-2616-4808-81b2-34d11ab40972 tempest-VolumesGetTest-1720378588 None] Lock "cinder-31141e1c-9aac-44ed-b17c-76db3dce41d4-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:55:13 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-68c6ea31-2616-4808-81b2-34d11ab40972 tempest-VolumesGetTest-1720378588 None] Acquiring lock "cinder-quobyte-31141e1c-9aac-44ed-b17c-76db3dce41d4" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:55:13 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-68c6ea31-2616-4808-81b2-34d11ab40972 tempest-VolumesGetTest-1720378588 None] Lock "cinder-quobyte-31141e1c-9aac-44ed-b17c-76db3dce41d4" acquired by "delete_volume" :: waited 0.015s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:55:13 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d2ba8a-cd3e-4a82-878f-f0fa2f5998c1]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:55:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-68c6ea31-2616-4808-81b2-34d11ab40972 tempest-VolumesGetTest-1720378588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-31141e1c-9aac-44ed-b17c-76db3dce41d4 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:55:13 devstack sudo[105038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-31141e1c-9aac-44ed-b17c-76db3dce41d4 Sep 04 22:55:13 devstack sudo[105038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:55:13 devstack sudo[105038]: pam_unix(sudo:session): session closed for user root Sep 04 22:55:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-68c6ea31-2616-4808-81b2-34d11ab40972 tempest-VolumesGetTest-1720378588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-31141e1c-9aac-44ed-b17c-76db3dce41d4" returned: 0 in 0.354s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:55:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-68c6ea31-2616-4808-81b2-34d11ab40972 tempest-VolumesGetTest-1720378588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-31141e1c-9aac-44ed-b17c-76db3dce41d4 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:55:13 devstack sudo[105043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-31141e1c-9aac-44ed-b17c-76db3dce41d4 Sep 04 22:55:13 devstack sudo[105043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:55:14 devstack sudo[105043]: pam_unix(sudo:session): session closed for user root Sep 04 22:55:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-68c6ea31-2616-4808-81b2-34d11ab40972 tempest-VolumesGetTest-1720378588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-31141e1c-9aac-44ed-b17c-76db3dce41d4" returned: 0 in 0.259s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:55:14 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-68c6ea31-2616-4808-81b2-34d11ab40972 tempest-VolumesGetTest-1720378588 None] Lock "cinder-quobyte-31141e1c-9aac-44ed-b17c-76db3dce41d4" released by "delete_volume" :: held 0.657s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:55:14 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-68c6ea31-2616-4808-81b2-34d11ab40972 tempest-VolumesGetTest-1720378588 None] Created reservations ['a28f617d-5543-4e9c-9b9e-a1cb689c9a9a', 'd7310ccb-2398-46a8-a135-bedd816684fc', '1a603377-934a-441f-b8f3-bb77268aaa14', '5b2b3229-6c39-42c9-aea3-2622910c30a2'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:55:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-68c6ea31-2616-4808-81b2-34d11ab40972 tempest-VolumesGetTest-1720378588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:55:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-68c6ea31-2616-4808-81b2-34d11ab40972 tempest-VolumesGetTest-1720378588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:55:14 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-68c6ea31-2616-4808-81b2-34d11ab40972 tempest-VolumesGetTest-1720378588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:55:14 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-68c6ea31-2616-4808-81b2-34d11ab40972 tempest-VolumesGetTest-1720378588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:55:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-68c6ea31-2616-4808-81b2-34d11ab40972 tempest-VolumesGetTest-1720378588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:55:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-68c6ea31-2616-4808-81b2-34d11ab40972 tempest-VolumesGetTest-1720378588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:55:14 devstack sudo[105132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:55:14 devstack sudo[105132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:55:14 devstack sudo[105132]: pam_unix(sudo:session): session closed for user root Sep 04 22:55:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-68c6ea31-2616-4808-81b2-34d11ab40972 tempest-VolumesGetTest-1720378588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.258s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:55:14 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-68c6ea31-2616-4808-81b2-34d11ab40972 tempest-VolumesGetTest-1720378588 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:55:14 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-68c6ea31-2616-4808-81b2-34d11ab40972 tempest-VolumesGetTest-1720378588 None] Deleted volume successfully. Sep 04 22:55:14 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-68c6ea31-2616-4808-81b2-34d11ab40972 tempest-VolumesGetTest-1720378588 None] Lock "cinder-31141e1c-9aac-44ed-b17c-76db3dce41d4-delete_volume" released by "delete_volume" :: held 1.109s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:55:14 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa31fdcb-29cb-4faf-b9ef-5f9cfc7a3247 tempest-VolumesGetTest-1720378588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:55:14 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-fa31fdcb-29cb-4faf-b9ef-5f9cfc7a3247 tempest-VolumesGetTest-1720378588 None] Flow 'volume_create_manager' (02a41c69-db88-495b-ad6b-d34eaa47acc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:55:14 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-fa31fdcb-29cb-4faf-b9ef-5f9cfc7a3247 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b9c3941-01c0-4972-8f51-b7498a3e3413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:55:14 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-fa31fdcb-29cb-4faf-b9ef-5f9cfc7a3247 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b9c3941-01c0-4972-8f51-b7498a3e3413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:55:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-641236346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a137c24-d72b-4ec6-8799-d79d10fcd4fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63005c5628c5451e83490fb0eefa253a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:55:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:55:15Z,use_quota=True,user_id='7d2849723d644fd492c510b0f6965e32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:55:14 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-fa31fdcb-29cb-4faf-b9ef-5f9cfc7a3247 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9c53f9c-49e7-4001-9513-9810a56080da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:55:14 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-fa31fdcb-29cb-4faf-b9ef-5f9cfc7a3247 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9c53f9c-49e7-4001-9513-9810a56080da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:55:14 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-fa31fdcb-29cb-4faf-b9ef-5f9cfc7a3247 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f81b0859-a297-410f-abaf-f7c1a5a66be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:55:14 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-fa31fdcb-29cb-4faf-b9ef-5f9cfc7a3247 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f81b0859-a297-410f-abaf-f7c1a5a66be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a137c24-d72b-4ec6-8799-d79d10fcd4fa', 'volume_name': 'volume-6a137c24-d72b-4ec6-8799-d79d10fcd4fa', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:55:14 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-fa31fdcb-29cb-4faf-b9ef-5f9cfc7a3247 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (106a18f5-cc05-43b5-a09b-2f74e686dc59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:55:14 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-fa31fdcb-29cb-4faf-b9ef-5f9cfc7a3247 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (106a18f5-cc05-43b5-a09b-2f74e686dc59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:55:15 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-fa31fdcb-29cb-4faf-b9ef-5f9cfc7a3247 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24905bb1-3ea1-4042-8c4d-242e9f0690e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:55:15 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-fa31fdcb-29cb-4faf-b9ef-5f9cfc7a3247 tempest-VolumesGetTest-1720378588 None] Volume 6a137c24-d72b-4ec6-8799-d79d10fcd4fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a137c24-d72b-4ec6-8799-d79d10fcd4fa', 'volume_size': 1} Sep 04 22:55:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-fa31fdcb-29cb-4faf-b9ef-5f9cfc7a3247 tempest-VolumesGetTest-1720378588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:55:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-fa31fdcb-29cb-4faf-b9ef-5f9cfc7a3247 tempest-VolumesGetTest-1720378588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:55:15 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-fa31fdcb-29cb-4faf-b9ef-5f9cfc7a3247 tempest-VolumesGetTest-1720378588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:55:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-641236346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a137c24-d72b-4ec6-8799-d79d10fcd4fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63005c5628c5451e83490fb0eefa253a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:55:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:55:15Z,use_quota=True,user_id='7d2849723d644fd492c510b0f6965e32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:55:15 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-fa31fdcb-29cb-4faf-b9ef-5f9cfc7a3247 tempest-VolumesGetTest-1720378588 None] Creating volume 6a137c24-d72b-4ec6-8799-d79d10fcd4fa {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:55:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-fa31fdcb-29cb-4faf-b9ef-5f9cfc7a3247 tempest-VolumesGetTest-1720378588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:55:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-fa31fdcb-29cb-4faf-b9ef-5f9cfc7a3247 tempest-VolumesGetTest-1720378588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:55:15 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-fa31fdcb-29cb-4faf-b9ef-5f9cfc7a3247 tempest-VolumesGetTest-1720378588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:55:15 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-fa31fdcb-29cb-4faf-b9ef-5f9cfc7a3247 tempest-VolumesGetTest-1720378588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:55:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-fa31fdcb-29cb-4faf-b9ef-5f9cfc7a3247 tempest-VolumesGetTest-1720378588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:55:15 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-fa31fdcb-29cb-4faf-b9ef-5f9cfc7a3247 tempest-VolumesGetTest-1720378588 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:55:15 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-fa31fdcb-29cb-4faf-b9ef-5f9cfc7a3247 tempest-VolumesGetTest-1720378588 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:55:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-fa31fdcb-29cb-4faf-b9ef-5f9cfc7a3247 tempest-VolumesGetTest-1720378588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6a137c24-d72b-4ec6-8799-d79d10fcd4fa 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:55:15 devstack sudo[105135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6a137c24-d72b-4ec6-8799-d79d10fcd4fa 1073741824 Sep 04 22:55:15 devstack sudo[105135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:55:15 devstack sudo[105135]: pam_unix(sudo:session): session closed for user root Sep 04 22:55:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-fa31fdcb-29cb-4faf-b9ef-5f9cfc7a3247 tempest-VolumesGetTest-1720378588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6a137c24-d72b-4ec6-8799-d79d10fcd4fa 1073741824" returned: 0 in 0.430s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:55:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-fa31fdcb-29cb-4faf-b9ef-5f9cfc7a3247 tempest-VolumesGetTest-1720378588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6a137c24-d72b-4ec6-8799-d79d10fcd4fa {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:55:15 devstack sudo[105141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6a137c24-d72b-4ec6-8799-d79d10fcd4fa Sep 04 22:55:15 devstack sudo[105141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:55:15 devstack sudo[105141]: pam_unix(sudo:session): session closed for user root Sep 04 22:55:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-fa31fdcb-29cb-4faf-b9ef-5f9cfc7a3247 tempest-VolumesGetTest-1720378588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6a137c24-d72b-4ec6-8799-d79d10fcd4fa" returned: 0 in 0.250s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:55:15 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-fa31fdcb-29cb-4faf-b9ef-5f9cfc7a3247 tempest-VolumesGetTest-1720378588 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:55:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-fa31fdcb-29cb-4faf-b9ef-5f9cfc7a3247 tempest-VolumesGetTest-1720378588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:55:15 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-fa31fdcb-29cb-4faf-b9ef-5f9cfc7a3247 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24905bb1-3ea1-4042-8c4d-242e9f0690e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a137c24-d72b-4ec6-8799-d79d10fcd4fa', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:55:15 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-fa31fdcb-29cb-4faf-b9ef-5f9cfc7a3247 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f10a6fa-a9d6-4d46-b8b2-14cfc97ed225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:55:15 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-fa31fdcb-29cb-4faf-b9ef-5f9cfc7a3247 tempest-VolumesGetTest-1720378588 None] Volume volume-6a137c24-d72b-4ec6-8799-d79d10fcd4fa (6a137c24-d72b-4ec6-8799-d79d10fcd4fa): created successfully Sep 04 22:55:15 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-fa31fdcb-29cb-4faf-b9ef-5f9cfc7a3247 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f10a6fa-a9d6-4d46-b8b2-14cfc97ed225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:55:15 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-fa31fdcb-29cb-4faf-b9ef-5f9cfc7a3247 tempest-VolumesGetTest-1720378588 None] Flow 'volume_create_manager' (02a41c69-db88-495b-ad6b-d34eaa47acc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:55:15 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-fa31fdcb-29cb-4faf-b9ef-5f9cfc7a3247 tempest-VolumesGetTest-1720378588 None] Created volume successfully. Sep 04 22:55:16 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:55:16 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] Flow 'volume_create_manager' (48d331df-de79-48f6-a42f-da88c65d3c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:55:16 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd169d4e-ce2c-4cde-9e90-0f227b818701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:55:16 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd169d4e-ce2c-4cde-9e90-0f227b818701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:55:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1591093412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdd8aecc-03a9-459c-9717-5a833849bb39,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='63005c5628c5451e83490fb0eefa253a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:55:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=6a137c24-d72b-4ec6-8799-d79d10fcd4fa,status='creating',terminated_at=None,updated_at=2026-09-04T20:55:16Z,use_quota=True,user_id='7d2849723d644fd492c510b0f6965e32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:55:16 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c964f489-1552-4e59-9172-25c7b858d50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:55:16 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c964f489-1552-4e59-9172-25c7b858d50f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:55:16 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dca88b97-aa61-4a38-a0e5-613f3e34f511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:55:16 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dca88b97-aa61-4a38-a0e5-613f3e34f511) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'fdd8aecc-03a9-459c-9717-5a833849bb39', 'volume_name': 'volume-fdd8aecc-03a9-459c-9717-5a833849bb39', 'volume_size': 1, 'source_volid': '6a137c24-d72b-4ec6-8799-d79d10fcd4fa', 'source_volstatus': 'available'}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:55:16 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ccfaf67-dd16-471b-93c4-c6ca7f7ca6ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:55:16 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ccfaf67-dd16-471b-93c4-c6ca7f7ca6ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:55:16 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cbc200c-c47a-4761-bcc1-220fcfbb7ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:55:16 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] Volume fdd8aecc-03a9-459c-9717-5a833849bb39: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-fdd8aecc-03a9-459c-9717-5a833849bb39', 'volume_size': 1, 'source_volid': '6a137c24-d72b-4ec6-8799-d79d10fcd4fa', 'source_volstatus': 'available'} Sep 04 22:55:16 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:55:16 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:55:16 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] Cloning volume 6a137c24-d72b-4ec6-8799-d79d10fcd4fa to volume fdd8aecc-03a9-459c-9717-5a833849bb39 Sep 04 22:55:16 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] Creating offline snapshot 4e1cbb87-82a0-4090-9789-a52b9288a517 of volume 6a137c24-d72b-4ec6-8799-d79d10fcd4fa {{(pid=87576) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 22:55:16 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b9d4f9-4104-4f90-8fd4-2e1d28c3d68a]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:55:16 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6a137c24-d72b-4ec6-8799-d79d10fcd4fa {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:55:16 devstack sudo[105144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6a137c24-d72b-4ec6-8799-d79d10fcd4fa Sep 04 22:55:16 devstack sudo[105144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:55:16 devstack sudo[105144]: pam_unix(sudo:session): session closed for user root Sep 04 22:55:16 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6a137c24-d72b-4ec6-8799-d79d10fcd4fa" returned: 0 in 0.363s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:55:16 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6a137c24-d72b-4ec6-8799-d79d10fcd4fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6a137c24-d72b-4ec6-8799-d79d10fcd4fa.4e1cbb87-82a0-4090-9789-a52b9288a517 1G {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:55:16 devstack sudo[105149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6a137c24-d72b-4ec6-8799-d79d10fcd4fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6a137c24-d72b-4ec6-8799-d79d10fcd4fa.4e1cbb87-82a0-4090-9789-a52b9288a517 1G Sep 04 22:55:16 devstack sudo[105149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:55:17 devstack sudo[105149]: pam_unix(sudo:session): session closed for user root Sep 04 22:55:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6a137c24-d72b-4ec6-8799-d79d10fcd4fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6a137c24-d72b-4ec6-8799-d79d10fcd4fa.4e1cbb87-82a0-4090-9789-a52b9288a517 1G" returned: 0 in 0.385s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:55:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a137c24-d72b-4ec6-8799-d79d10fcd4fa -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6a137c24-d72b-4ec6-8799-d79d10fcd4fa.4e1cbb87-82a0-4090-9789-a52b9288a517 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:55:17 devstack sudo[105154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a137c24-d72b-4ec6-8799-d79d10fcd4fa -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6a137c24-d72b-4ec6-8799-d79d10fcd4fa.4e1cbb87-82a0-4090-9789-a52b9288a517 Sep 04 22:55:17 devstack sudo[105154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:55:17 devstack sudo[105154]: pam_unix(sudo:session): session closed for user root Sep 04 22:55:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a137c24-d72b-4ec6-8799-d79d10fcd4fa -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6a137c24-d72b-4ec6-8799-d79d10fcd4fa.4e1cbb87-82a0-4090-9789-a52b9288a517" returned: 0 in 0.288s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:55:17 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6a137c24-d72b-4ec6-8799-d79d10fcd4fa.4e1cbb87-82a0-4090-9789-a52b9288a517 is being set with open permissions: ugo+rw Sep 04 22:55:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6a137c24-d72b-4ec6-8799-d79d10fcd4fa.4e1cbb87-82a0-4090-9789-a52b9288a517 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:55:17 devstack sudo[105159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6a137c24-d72b-4ec6-8799-d79d10fcd4fa.4e1cbb87-82a0-4090-9789-a52b9288a517 Sep 04 22:55:17 devstack sudo[105159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:55:17 devstack sudo[105159]: pam_unix(sudo:session): session closed for user root Sep 04 22:55:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6a137c24-d72b-4ec6-8799-d79d10fcd4fa.4e1cbb87-82a0-4090-9789-a52b9288a517" returned: 0 in 0.248s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:55:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6a137c24-d72b-4ec6-8799-d79d10fcd4fa.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:55:17 devstack sudo[105162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6a137c24-d72b-4ec6-8799-d79d10fcd4fa.info Sep 04 22:55:17 devstack sudo[105162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:55:18 devstack sudo[105162]: pam_unix(sudo:session): session closed for user root Sep 04 22:55:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6a137c24-d72b-4ec6-8799-d79d10fcd4fa.info" returned: 0 in 0.248s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:55:18 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6a137c24-d72b-4ec6-8799-d79d10fcd4fa.info is being set with open permissions: ugo+rw Sep 04 22:55:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6a137c24-d72b-4ec6-8799-d79d10fcd4fa.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:55:18 devstack sudo[105165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6a137c24-d72b-4ec6-8799-d79d10fcd4fa.info Sep 04 22:55:18 devstack sudo[105165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:55:18 devstack sudo[105165]: pam_unix(sudo:session): session closed for user root Sep 04 22:55:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6a137c24-d72b-4ec6-8799-d79d10fcd4fa.info" returned: 0 in 0.244s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:55:18 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] Acquiring lock "cinder-quobyte-fdd8aecc-03a9-459c-9717-5a833849bb39" by "_copy_volume_from_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:55:18 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] Lock "cinder-quobyte-fdd8aecc-03a9-459c-9717-5a833849bb39" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:55:18 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] snapshot: 4e1cbb87-82a0-4090-9789-a52b9288a517, volume: fdd8aecc-03a9-459c-9717-5a833849bb39, {{(pid=87576) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 04 22:55:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:55:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:55:18 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:55:18 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:55:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:55:18 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a2d84f-f718-4883-ac80-817edcb3ab42]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:55:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6a137c24-d72b-4ec6-8799-d79d10fcd4fa.4e1cbb87-82a0-4090-9789-a52b9288a517 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:55:18 devstack sudo[105168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6a137c24-d72b-4ec6-8799-d79d10fcd4fa.4e1cbb87-82a0-4090-9789-a52b9288a517 Sep 04 22:55:18 devstack sudo[105168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:55:18 devstack sudo[105168]: pam_unix(sudo:session): session closed for user root Sep 04 22:55:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6a137c24-d72b-4ec6-8799-d79d10fcd4fa.4e1cbb87-82a0-4090-9789-a52b9288a517" returned: 0 in 0.368s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:55:18 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a137c24-d72b-4ec6-8799-d79d10fcd4fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 22:55:18 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[86fed037-84c0-409b-8fe9-7ea1cdbfb2f5]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:55:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6a137c24-d72b-4ec6-8799-d79d10fcd4fa {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:55:18 devstack sudo[105174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6a137c24-d72b-4ec6-8799-d79d10fcd4fa Sep 04 22:55:18 devstack sudo[105174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:55:19 devstack sudo[105174]: pam_unix(sudo:session): session closed for user root Sep 04 22:55:19 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6a137c24-d72b-4ec6-8799-d79d10fcd4fa" returned: 0 in 0.355s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:55:19 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6a137c24-d72b-4ec6-8799-d79d10fcd4fa {{(pid=87576) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 04 22:55:19 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] Creating direct copy from snapshot {{(pid=87576) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 04 22:55:19 devstack cinder-volume[87576]: DEBUG cinder.utils [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] Path /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fdd8aecc-03a9-459c-9717-5a833849bb39 not found in is_blk_device check {{(pid=87576) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 04 22:55:19 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6a137c24-d72b-4ec6-8799-d79d10fcd4fa /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fdd8aecc-03a9-459c-9717-5a833849bb39 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:55:19 devstack sudo[105179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6a137c24-d72b-4ec6-8799-d79d10fcd4fa /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fdd8aecc-03a9-459c-9717-5a833849bb39 Sep 04 22:55:19 devstack sudo[105179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:55:23 devstack sudo[105179]: pam_unix(sudo:session): session closed for user root Sep 04 22:55:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6a137c24-d72b-4ec6-8799-d79d10fcd4fa /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fdd8aecc-03a9-459c-9717-5a833849bb39" returned: 0 in 4.093s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:55:23 devstack cinder-volume[87576]: DEBUG cinder.image.image_utils [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] Image conversion details: src /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6a137c24-d72b-4ec6-8799-d79d10fcd4fa, size 1024.00 MB, duration 4.09 sec, destination /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fdd8aecc-03a9-459c-9717-5a833849bb39 {{(pid=87576) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 22:55:23 devstack cinder-volume[87576]: INFO cinder.image.image_utils [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] Converted 1024.00 MB image at 250.13 MB/s Sep 04 22:55:23 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fdd8aecc-03a9-459c-9717-5a833849bb39 is being set with open permissions: ugo+rw Sep 04 22:55:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fdd8aecc-03a9-459c-9717-5a833849bb39 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:55:23 devstack sudo[105193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fdd8aecc-03a9-459c-9717-5a833849bb39 Sep 04 22:55:23 devstack sudo[105193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:55:23 devstack sudo[105193]: pam_unix(sudo:session): session closed for user root Sep 04 22:55:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fdd8aecc-03a9-459c-9717-5a833849bb39" returned: 0 in 0.259s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:55:23 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] Lock "cinder-quobyte-fdd8aecc-03a9-459c-9717-5a833849bb39" released by "_copy_volume_from_snapshot" :: held 5.139s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:55:23 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] Acquiring lock "cinder-quobyte-4e1cbb87-82a0-4090-9789-a52b9288a517" by "_delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:55:23 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] Lock "cinder-quobyte-4e1cbb87-82a0-4090-9789-a52b9288a517" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:55:23 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] Deleting offline snapshot 4e1cbb87-82a0-4090-9789-a52b9288a517 of volume 6a137c24-d72b-4ec6-8799-d79d10fcd4fa {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 22:55:23 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] snapshot_file for this snap is: volume-6a137c24-d72b-4ec6-8799-d79d10fcd4fa.4e1cbb87-82a0-4090-9789-a52b9288a517 {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 22:55:23 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[5791b48b-99aa-497b-b380-af4c898defff]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:55:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6a137c24-d72b-4ec6-8799-d79d10fcd4fa.4e1cbb87-82a0-4090-9789-a52b9288a517 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:55:23 devstack sudo[105196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6a137c24-d72b-4ec6-8799-d79d10fcd4fa.4e1cbb87-82a0-4090-9789-a52b9288a517 Sep 04 22:55:23 devstack sudo[105196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:55:24 devstack sudo[105196]: pam_unix(sudo:session): session closed for user root Sep 04 22:55:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6a137c24-d72b-4ec6-8799-d79d10fcd4fa.4e1cbb87-82a0-4090-9789-a52b9288a517" returned: 0 in 0.374s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:55:24 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a137c24-d72b-4ec6-8799-d79d10fcd4fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 22:55:24 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c9a94e-bce5-49ac-8575-54df6c52e70c]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:55:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6a137c24-d72b-4ec6-8799-d79d10fcd4fa {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:55:24 devstack sudo[105201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6a137c24-d72b-4ec6-8799-d79d10fcd4fa Sep 04 22:55:24 devstack sudo[105201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:55:24 devstack sudo[105201]: pam_unix(sudo:session): session closed for user root Sep 04 22:55:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6a137c24-d72b-4ec6-8799-d79d10fcd4fa" returned: 0 in 0.576s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:55:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6a137c24-d72b-4ec6-8799-d79d10fcd4fa.4e1cbb87-82a0-4090-9789-a52b9288a517 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:55:24 devstack sudo[105206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6a137c24-d72b-4ec6-8799-d79d10fcd4fa.4e1cbb87-82a0-4090-9789-a52b9288a517 Sep 04 22:55:24 devstack sudo[105206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:55:24 devstack sudo[105206]: pam_unix(sudo:session): session closed for user root Sep 04 22:55:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6a137c24-d72b-4ec6-8799-d79d10fcd4fa.4e1cbb87-82a0-4090-9789-a52b9288a517" returned: 0 in 0.342s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:55:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6a137c24-d72b-4ec6-8799-d79d10fcd4fa.4e1cbb87-82a0-4090-9789-a52b9288a517 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:55:24 devstack sudo[105211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6a137c24-d72b-4ec6-8799-d79d10fcd4fa.4e1cbb87-82a0-4090-9789-a52b9288a517 Sep 04 22:55:24 devstack sudo[105211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:55:25 devstack sudo[105211]: pam_unix(sudo:session): session closed for user root Sep 04 22:55:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6a137c24-d72b-4ec6-8799-d79d10fcd4fa.4e1cbb87-82a0-4090-9789-a52b9288a517" returned: 0 in 0.256s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:55:25 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] Lock "cinder-quobyte-4e1cbb87-82a0-4090-9789-a52b9288a517" released by "_delete_snapshot" :: held 1.629s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:55:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.742s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:55:25 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cbc200c-c47a-4761-bcc1-220fcfbb7ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdd8aecc-03a9-459c-9717-5a833849bb39', 'volume_size': 1, 'source_volid': '6a137c24-d72b-4ec6-8799-d79d10fcd4fa', 'source_volstatus': 'available'}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:55:25 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66ef0021-c9d3-4fcc-bff1-116ca91f5493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:55:25 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] Volume volume-fdd8aecc-03a9-459c-9717-5a833849bb39 (fdd8aecc-03a9-459c-9717-5a833849bb39): created successfully Sep 04 22:55:25 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66ef0021-c9d3-4fcc-bff1-116ca91f5493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:55:25 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] Flow 'volume_create_manager' (48d331df-de79-48f6-a42f-da88c65d3c93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:55:25 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-99ca98c2-09e4-47aa-8bc5-226ea2d7e121 tempest-VolumesGetTest-1720378588 None] Created volume successfully. Sep 04 22:55:26 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-92cfb4a2-72a8-413e-8370-43085d7a5821 tempest-VolumesGetTest-1720378588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:55:26 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-92cfb4a2-72a8-413e-8370-43085d7a5821 tempest-VolumesGetTest-1720378588 None] Flow 'volume_create_manager' (344587b8-9d75-48de-9368-fbd76e56d7f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:55:26 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-92cfb4a2-72a8-413e-8370-43085d7a5821 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (542c352f-8f0b-41e0-82d5-0c9e51c62485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:55:26 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-92cfb4a2-72a8-413e-8370-43085d7a5821 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (542c352f-8f0b-41e0-82d5-0c9e51c62485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:55:27Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1519503969',display_name='tempest-VolumesGetTest-Volume-2082751232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f5951e1-c717-4b07-90e1-359d67bc622f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63005c5628c5451e83490fb0eefa253a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:55:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:55:27Z,use_quota=True,user_id='7d2849723d644fd492c510b0f6965e32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:55:26 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-92cfb4a2-72a8-413e-8370-43085d7a5821 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcec1c39-b80c-43a8-8600-497c1fbc90cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:55:26 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-92cfb4a2-72a8-413e-8370-43085d7a5821 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcec1c39-b80c-43a8-8600-497c1fbc90cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:55:26 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-92cfb4a2-72a8-413e-8370-43085d7a5821 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16ce47fa-3212-4aa5-a38a-da08155a22ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:55:26 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-92cfb4a2-72a8-413e-8370-43085d7a5821 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16ce47fa-3212-4aa5-a38a-da08155a22ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f5951e1-c717-4b07-90e1-359d67bc622f', 'volume_name': 'volume-0f5951e1-c717-4b07-90e1-359d67bc622f', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:55:26 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-92cfb4a2-72a8-413e-8370-43085d7a5821 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (779470cb-fb21-492b-9d09-4acde186d5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:55:26 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-92cfb4a2-72a8-413e-8370-43085d7a5821 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (779470cb-fb21-492b-9d09-4acde186d5f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:55:26 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-92cfb4a2-72a8-413e-8370-43085d7a5821 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1b5cbad-c12b-48b0-ab07-496014457034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:55:26 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-92cfb4a2-72a8-413e-8370-43085d7a5821 tempest-VolumesGetTest-1720378588 None] Volume 0f5951e1-c717-4b07-90e1-359d67bc622f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f5951e1-c717-4b07-90e1-359d67bc622f', 'volume_size': 1} Sep 04 22:55:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-92cfb4a2-72a8-413e-8370-43085d7a5821 tempest-VolumesGetTest-1720378588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:55:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-92cfb4a2-72a8-413e-8370-43085d7a5821 tempest-VolumesGetTest-1720378588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:55:26 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-92cfb4a2-72a8-413e-8370-43085d7a5821 tempest-VolumesGetTest-1720378588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:55:27Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1519503969',display_name='tempest-VolumesGetTest-Volume-2082751232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f5951e1-c717-4b07-90e1-359d67bc622f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63005c5628c5451e83490fb0eefa253a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:55:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:55:27Z,use_quota=True,user_id='7d2849723d644fd492c510b0f6965e32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:55:26 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-92cfb4a2-72a8-413e-8370-43085d7a5821 tempest-VolumesGetTest-1720378588 None] Creating volume 0f5951e1-c717-4b07-90e1-359d67bc622f {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:55:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-92cfb4a2-72a8-413e-8370-43085d7a5821 tempest-VolumesGetTest-1720378588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:55:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-92cfb4a2-72a8-413e-8370-43085d7a5821 tempest-VolumesGetTest-1720378588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:55:26 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-92cfb4a2-72a8-413e-8370-43085d7a5821 tempest-VolumesGetTest-1720378588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:55:27 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-92cfb4a2-72a8-413e-8370-43085d7a5821 tempest-VolumesGetTest-1720378588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:55:27 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-92cfb4a2-72a8-413e-8370-43085d7a5821 tempest-VolumesGetTest-1720378588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:55:27 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-92cfb4a2-72a8-413e-8370-43085d7a5821 tempest-VolumesGetTest-1720378588 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:55:27 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-92cfb4a2-72a8-413e-8370-43085d7a5821 tempest-VolumesGetTest-1720378588 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:55:27 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-92cfb4a2-72a8-413e-8370-43085d7a5821 tempest-VolumesGetTest-1720378588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-0f5951e1-c717-4b07-90e1-359d67bc622f 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:55:27 devstack sudo[105214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-0f5951e1-c717-4b07-90e1-359d67bc622f 1073741824 Sep 04 22:55:27 devstack sudo[105214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:55:27 devstack sudo[105214]: pam_unix(sudo:session): session closed for user root Sep 04 22:55:27 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-92cfb4a2-72a8-413e-8370-43085d7a5821 tempest-VolumesGetTest-1720378588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-0f5951e1-c717-4b07-90e1-359d67bc622f 1073741824" returned: 0 in 0.424s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:55:27 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-92cfb4a2-72a8-413e-8370-43085d7a5821 tempest-VolumesGetTest-1720378588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-0f5951e1-c717-4b07-90e1-359d67bc622f {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:55:27 devstack sudo[105219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-0f5951e1-c717-4b07-90e1-359d67bc622f Sep 04 22:55:27 devstack sudo[105219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:55:27 devstack sudo[105219]: pam_unix(sudo:session): session closed for user root Sep 04 22:55:27 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-92cfb4a2-72a8-413e-8370-43085d7a5821 tempest-VolumesGetTest-1720378588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-0f5951e1-c717-4b07-90e1-359d67bc622f" returned: 0 in 0.239s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:55:27 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-92cfb4a2-72a8-413e-8370-43085d7a5821 tempest-VolumesGetTest-1720378588 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:55:27 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-92cfb4a2-72a8-413e-8370-43085d7a5821 tempest-VolumesGetTest-1720378588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:55:27 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-92cfb4a2-72a8-413e-8370-43085d7a5821 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1b5cbad-c12b-48b0-ab07-496014457034) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f5951e1-c717-4b07-90e1-359d67bc622f', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:55:27 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-92cfb4a2-72a8-413e-8370-43085d7a5821 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffd2a40f-6820-465c-8565-4472d4beac64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:55:27 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-92cfb4a2-72a8-413e-8370-43085d7a5821 tempest-VolumesGetTest-1720378588 None] Volume volume-0f5951e1-c717-4b07-90e1-359d67bc622f (0f5951e1-c717-4b07-90e1-359d67bc622f): created successfully Sep 04 22:55:27 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-92cfb4a2-72a8-413e-8370-43085d7a5821 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffd2a40f-6820-465c-8565-4472d4beac64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:55:27 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-92cfb4a2-72a8-413e-8370-43085d7a5821 tempest-VolumesGetTest-1720378588 None] Flow 'volume_create_manager' (344587b8-9d75-48de-9368-fbd76e56d7f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:55:27 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-92cfb4a2-72a8-413e-8370-43085d7a5821 tempest-VolumesGetTest-1720378588 None] Created volume successfully. Sep 04 22:55:28 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-85027619-b92e-4105-8aa0-ecf67f27f4df tempest-VolumesGetTest-1720378588 None] Acquiring lock "cinder-0f5951e1-c717-4b07-90e1-359d67bc622f-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:55:28 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-85027619-b92e-4105-8aa0-ecf67f27f4df tempest-VolumesGetTest-1720378588 None] Lock "cinder-0f5951e1-c717-4b07-90e1-359d67bc622f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:55:28 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-85027619-b92e-4105-8aa0-ecf67f27f4df tempest-VolumesGetTest-1720378588 None] Acquiring lock "cinder-quobyte-0f5951e1-c717-4b07-90e1-359d67bc622f" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:55:28 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-85027619-b92e-4105-8aa0-ecf67f27f4df tempest-VolumesGetTest-1720378588 None] Lock "cinder-quobyte-0f5951e1-c717-4b07-90e1-359d67bc622f" acquired by "delete_volume" :: waited 0.016s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:55:28 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3d8e7a-7950-47dc-81af-b384153f8027]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:55:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-85027619-b92e-4105-8aa0-ecf67f27f4df tempest-VolumesGetTest-1720378588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-0f5951e1-c717-4b07-90e1-359d67bc622f {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:55:28 devstack sudo[105222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-0f5951e1-c717-4b07-90e1-359d67bc622f Sep 04 22:55:28 devstack sudo[105222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:55:28 devstack sudo[105222]: pam_unix(sudo:session): session closed for user root Sep 04 22:55:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-85027619-b92e-4105-8aa0-ecf67f27f4df tempest-VolumesGetTest-1720378588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-0f5951e1-c717-4b07-90e1-359d67bc622f" returned: 0 in 0.366s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:55:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-85027619-b92e-4105-8aa0-ecf67f27f4df tempest-VolumesGetTest-1720378588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-0f5951e1-c717-4b07-90e1-359d67bc622f {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:55:28 devstack sudo[105227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-0f5951e1-c717-4b07-90e1-359d67bc622f Sep 04 22:55:28 devstack sudo[105227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:55:28 devstack sudo[105227]: pam_unix(sudo:session): session closed for user root Sep 04 22:55:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-85027619-b92e-4105-8aa0-ecf67f27f4df tempest-VolumesGetTest-1720378588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-0f5951e1-c717-4b07-90e1-359d67bc622f" returned: 0 in 0.241s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:55:28 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-85027619-b92e-4105-8aa0-ecf67f27f4df tempest-VolumesGetTest-1720378588 None] Lock "cinder-quobyte-0f5951e1-c717-4b07-90e1-359d67bc622f" released by "delete_volume" :: held 0.644s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:55:28 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-85027619-b92e-4105-8aa0-ecf67f27f4df tempest-VolumesGetTest-1720378588 None] Created reservations ['ef957514-b4c6-4070-a8a1-63066dcf451c', '550c65d7-9b2d-4c23-931a-cac481a041b6', 'e139c379-71db-4ff6-b5f5-56bb6438e4bf', '0c01aeb8-814f-41fa-a58d-63c4e448970c'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:55:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-85027619-b92e-4105-8aa0-ecf67f27f4df tempest-VolumesGetTest-1720378588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:55:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-85027619-b92e-4105-8aa0-ecf67f27f4df tempest-VolumesGetTest-1720378588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:55:28 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-85027619-b92e-4105-8aa0-ecf67f27f4df tempest-VolumesGetTest-1720378588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:55:28 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-85027619-b92e-4105-8aa0-ecf67f27f4df tempest-VolumesGetTest-1720378588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:55:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-85027619-b92e-4105-8aa0-ecf67f27f4df tempest-VolumesGetTest-1720378588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:55:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-85027619-b92e-4105-8aa0-ecf67f27f4df tempest-VolumesGetTest-1720378588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:55:28 devstack sudo[105230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:55:28 devstack sudo[105230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:55:29 devstack sudo[105230]: pam_unix(sudo:session): session closed for user root Sep 04 22:55:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-85027619-b92e-4105-8aa0-ecf67f27f4df tempest-VolumesGetTest-1720378588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.244s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:55:29 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-85027619-b92e-4105-8aa0-ecf67f27f4df tempest-VolumesGetTest-1720378588 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:55:29 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-85027619-b92e-4105-8aa0-ecf67f27f4df tempest-VolumesGetTest-1720378588 None] Deleted volume successfully. Sep 04 22:55:29 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-85027619-b92e-4105-8aa0-ecf67f27f4df tempest-VolumesGetTest-1720378588 None] Lock "cinder-0f5951e1-c717-4b07-90e1-359d67bc622f-delete_volume" released by "delete_volume" :: held 1.103s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:55:29 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-a8337a78-08d1-48b3-8d27-3291ec696461 tempest-VolumesGetTest-1720378588 None] Acquiring lock "cinder-fdd8aecc-03a9-459c-9717-5a833849bb39-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:55:29 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-a8337a78-08d1-48b3-8d27-3291ec696461 tempest-VolumesGetTest-1720378588 None] Lock "cinder-fdd8aecc-03a9-459c-9717-5a833849bb39-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:55:29 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-a8337a78-08d1-48b3-8d27-3291ec696461 tempest-VolumesGetTest-1720378588 None] Acquiring lock "cinder-quobyte-fdd8aecc-03a9-459c-9717-5a833849bb39" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:55:29 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-a8337a78-08d1-48b3-8d27-3291ec696461 tempest-VolumesGetTest-1720378588 None] Lock "cinder-quobyte-fdd8aecc-03a9-459c-9717-5a833849bb39" acquired by "delete_volume" :: waited 0.014s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:55:29 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[248b2f87-a379-4575-b4ae-7e5a5b6aa4c7]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:55:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a8337a78-08d1-48b3-8d27-3291ec696461 tempest-VolumesGetTest-1720378588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fdd8aecc-03a9-459c-9717-5a833849bb39 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:55:29 devstack sudo[105233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fdd8aecc-03a9-459c-9717-5a833849bb39 Sep 04 22:55:29 devstack sudo[105233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:55:29 devstack sudo[105233]: pam_unix(sudo:session): session closed for user root Sep 04 22:55:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a8337a78-08d1-48b3-8d27-3291ec696461 tempest-VolumesGetTest-1720378588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fdd8aecc-03a9-459c-9717-5a833849bb39" returned: 0 in 0.361s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:55:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a8337a78-08d1-48b3-8d27-3291ec696461 tempest-VolumesGetTest-1720378588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fdd8aecc-03a9-459c-9717-5a833849bb39 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:55:29 devstack sudo[105238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fdd8aecc-03a9-459c-9717-5a833849bb39 Sep 04 22:55:29 devstack sudo[105238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:55:29 devstack sudo[105238]: pam_unix(sudo:session): session closed for user root Sep 04 22:55:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a8337a78-08d1-48b3-8d27-3291ec696461 tempest-VolumesGetTest-1720378588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fdd8aecc-03a9-459c-9717-5a833849bb39" returned: 0 in 0.253s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:55:29 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-a8337a78-08d1-48b3-8d27-3291ec696461 tempest-VolumesGetTest-1720378588 None] Lock "cinder-quobyte-fdd8aecc-03a9-459c-9717-5a833849bb39" released by "delete_volume" :: held 0.653s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:55:30 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-a8337a78-08d1-48b3-8d27-3291ec696461 tempest-VolumesGetTest-1720378588 None] Created reservations ['a9b8ee28-f2fe-4868-8465-69e547798bab', '0d2c7b9f-2c34-45b6-b4fa-f20fb559d485', '532778ec-7a77-4fca-a4f0-7e862f00f89c', '288d6399-866f-4133-bdae-6fd5652c1702'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:55:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-a8337a78-08d1-48b3-8d27-3291ec696461 tempest-VolumesGetTest-1720378588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:55:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-a8337a78-08d1-48b3-8d27-3291ec696461 tempest-VolumesGetTest-1720378588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:55:30 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-a8337a78-08d1-48b3-8d27-3291ec696461 tempest-VolumesGetTest-1720378588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:55:30 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-a8337a78-08d1-48b3-8d27-3291ec696461 tempest-VolumesGetTest-1720378588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:55:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-a8337a78-08d1-48b3-8d27-3291ec696461 tempest-VolumesGetTest-1720378588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:55:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a8337a78-08d1-48b3-8d27-3291ec696461 tempest-VolumesGetTest-1720378588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:55:30 devstack sudo[105241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:55:30 devstack sudo[105241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:55:30 devstack sudo[105241]: pam_unix(sudo:session): session closed for user root Sep 04 22:55:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a8337a78-08d1-48b3-8d27-3291ec696461 tempest-VolumesGetTest-1720378588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.255s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:55:30 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-a8337a78-08d1-48b3-8d27-3291ec696461 tempest-VolumesGetTest-1720378588 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:55:30 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-a8337a78-08d1-48b3-8d27-3291ec696461 tempest-VolumesGetTest-1720378588 None] Deleted volume successfully. Sep 04 22:55:30 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-a8337a78-08d1-48b3-8d27-3291ec696461 tempest-VolumesGetTest-1720378588 None] Lock "cinder-fdd8aecc-03a9-459c-9717-5a833849bb39-delete_volume" released by "delete_volume" :: held 1.093s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:55:30 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-bb1b070e-5b65-4e46-80ad-760d4ef25bdd tempest-VolumesGetTest-1720378588 None] Acquiring lock "cinder-6a137c24-d72b-4ec6-8799-d79d10fcd4fa-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:55:30 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-bb1b070e-5b65-4e46-80ad-760d4ef25bdd tempest-VolumesGetTest-1720378588 None] Lock "cinder-6a137c24-d72b-4ec6-8799-d79d10fcd4fa-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:55:30 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-bb1b070e-5b65-4e46-80ad-760d4ef25bdd tempest-VolumesGetTest-1720378588 None] Acquiring lock "cinder-quobyte-6a137c24-d72b-4ec6-8799-d79d10fcd4fa" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:55:30 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-bb1b070e-5b65-4e46-80ad-760d4ef25bdd tempest-VolumesGetTest-1720378588 None] Lock "cinder-quobyte-6a137c24-d72b-4ec6-8799-d79d10fcd4fa" acquired by "delete_volume" :: waited 0.015s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:55:30 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[5029fa42-d41e-44bc-bbd0-a073daa0e849]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:55:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-bb1b070e-5b65-4e46-80ad-760d4ef25bdd tempest-VolumesGetTest-1720378588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6a137c24-d72b-4ec6-8799-d79d10fcd4fa {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:55:30 devstack sudo[105244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6a137c24-d72b-4ec6-8799-d79d10fcd4fa Sep 04 22:55:30 devstack sudo[105244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:55:30 devstack sudo[105244]: pam_unix(sudo:session): session closed for user root Sep 04 22:55:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-bb1b070e-5b65-4e46-80ad-760d4ef25bdd tempest-VolumesGetTest-1720378588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6a137c24-d72b-4ec6-8799-d79d10fcd4fa" returned: 0 in 0.353s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:55:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-bb1b070e-5b65-4e46-80ad-760d4ef25bdd tempest-VolumesGetTest-1720378588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6a137c24-d72b-4ec6-8799-d79d10fcd4fa {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:55:30 devstack sudo[105249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6a137c24-d72b-4ec6-8799-d79d10fcd4fa Sep 04 22:55:30 devstack sudo[105249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:55:31 devstack sudo[105249]: pam_unix(sudo:session): session closed for user root Sep 04 22:55:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-bb1b070e-5b65-4e46-80ad-760d4ef25bdd tempest-VolumesGetTest-1720378588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6a137c24-d72b-4ec6-8799-d79d10fcd4fa" returned: 0 in 0.244s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:55:31 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-bb1b070e-5b65-4e46-80ad-760d4ef25bdd tempest-VolumesGetTest-1720378588 None] Lock "cinder-quobyte-6a137c24-d72b-4ec6-8799-d79d10fcd4fa" released by "delete_volume" :: held 0.649s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:55:31 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-bb1b070e-5b65-4e46-80ad-760d4ef25bdd tempest-VolumesGetTest-1720378588 None] Created reservations ['73494172-3dbd-41b0-8804-0249b3c56366', '0bc51bfa-0ee7-49b1-8f9c-394db08d3e6c', '24c436d6-1b08-454d-b281-69d365cec0f6', '58b60c46-4045-4fa7-9802-ccb1df9d243e'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:55:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-bb1b070e-5b65-4e46-80ad-760d4ef25bdd tempest-VolumesGetTest-1720378588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:55:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-bb1b070e-5b65-4e46-80ad-760d4ef25bdd tempest-VolumesGetTest-1720378588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:55:31 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-bb1b070e-5b65-4e46-80ad-760d4ef25bdd tempest-VolumesGetTest-1720378588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:55:31 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-bb1b070e-5b65-4e46-80ad-760d4ef25bdd tempest-VolumesGetTest-1720378588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:55:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-bb1b070e-5b65-4e46-80ad-760d4ef25bdd tempest-VolumesGetTest-1720378588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:55:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-bb1b070e-5b65-4e46-80ad-760d4ef25bdd tempest-VolumesGetTest-1720378588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:55:31 devstack sudo[105252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:55:31 devstack sudo[105252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:55:31 devstack sudo[105252]: pam_unix(sudo:session): session closed for user root Sep 04 22:55:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-bb1b070e-5b65-4e46-80ad-760d4ef25bdd tempest-VolumesGetTest-1720378588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.239s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:55:31 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-bb1b070e-5b65-4e46-80ad-760d4ef25bdd tempest-VolumesGetTest-1720378588 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:55:31 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-bb1b070e-5b65-4e46-80ad-760d4ef25bdd tempest-VolumesGetTest-1720378588 None] Deleted volume successfully. Sep 04 22:55:31 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-bb1b070e-5b65-4e46-80ad-760d4ef25bdd tempest-VolumesGetTest-1720378588 None] Lock "cinder-6a137c24-d72b-4ec6-8799-d79d10fcd4fa-delete_volume" released by "delete_volume" :: held 1.069s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:55:32 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ff5c4b2-aa76-40ec-9188-1c6aecdc3772 tempest-VolumesGetTest-1720378588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:55:32 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2ff5c4b2-aa76-40ec-9188-1c6aecdc3772 tempest-VolumesGetTest-1720378588 None] Flow 'volume_create_manager' (d178c7bd-38e7-4829-a58d-5cbc3b4ae71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:55:32 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2ff5c4b2-aa76-40ec-9188-1c6aecdc3772 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cab95f2a-57d7-4416-bb73-c6a48ca79bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:55:32 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2ff5c4b2-aa76-40ec-9188-1c6aecdc3772 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cab95f2a-57d7-4416-bb73-c6a48ca79bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:55:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1203826517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75bf16b1-59e8-4182-9805-2f28ead33e89,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='63005c5628c5451e83490fb0eefa253a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:55:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:55:32Z,use_quota=True,user_id='7d2849723d644fd492c510b0f6965e32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:55:32 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2ff5c4b2-aa76-40ec-9188-1c6aecdc3772 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9722ca02-d9f9-48e1-95f7-acb692683559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:55:32 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2ff5c4b2-aa76-40ec-9188-1c6aecdc3772 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9722ca02-d9f9-48e1-95f7-acb692683559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:55:32 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2ff5c4b2-aa76-40ec-9188-1c6aecdc3772 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c5aeb3e-a409-429e-8c3c-01e2c3d3ad6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:55:32 devstack cinder-volume[87576]: DEBUG cinder.image.glance [None req-2ff5c4b2-aa76-40ec-9188-1c6aecdc3772 tempest-VolumesGetTest-1720378588 None] Creating Keystone auth plugin from conf {{(pid=87576) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 04 22:55:32 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2ff5c4b2-aa76-40ec-9188-1c6aecdc3772 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c5aeb3e-a409-429e-8c3c-01e2c3d3ad6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '75bf16b1-59e8-4182-9805-2f28ead33e89', 'volume_name': 'volume-75bf16b1-59e8-4182-9805-2f28ead33e89', 'volume_size': 1, 'image_id': '4f8d7a81-6282-4f52-a601-d840d8973365', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4f8d7a81-6282-4f52-a601-d840d8973365', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5d1fd1f571ef419184ac7eda6748fdd3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4f8d7a81-6282-4f52-a601-d840d8973365', 'created_at': datetime.datetime(2026, 9, 4, 20, 33, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 20, 33, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f8d7a81-6282-4f52-a601-d840d8973365/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:55:32 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2ff5c4b2-aa76-40ec-9188-1c6aecdc3772 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d113621d-a61a-4420-8176-8e0d7d9fdb57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:55:32 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2ff5c4b2-aa76-40ec-9188-1c6aecdc3772 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d113621d-a61a-4420-8176-8e0d7d9fdb57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:55:32 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2ff5c4b2-aa76-40ec-9188-1c6aecdc3772 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93541e7b-8e92-4884-8f66-4fee4b8728d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:55:32 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-2ff5c4b2-aa76-40ec-9188-1c6aecdc3772 tempest-VolumesGetTest-1720378588 None] Volume 75bf16b1-59e8-4182-9805-2f28ead33e89: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-75bf16b1-59e8-4182-9805-2f28ead33e89', 'volume_size': 1, 'image_id': '4f8d7a81-6282-4f52-a601-d840d8973365', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4f8d7a81-6282-4f52-a601-d840d8973365', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5d1fd1f571ef419184ac7eda6748fdd3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4f8d7a81-6282-4f52-a601-d840d8973365', 'created_at': datetime.datetime(2026, 9, 4, 20, 33, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 20, 33, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f8d7a81-6282-4f52-a601-d840d8973365/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 04 22:55:32 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ff5c4b2-aa76-40ec-9188-1c6aecdc3772 tempest-VolumesGetTest-1720378588 None] Trying to clone 75bf16b1-59e8-4182-9805-2f28ead33e89 from image 4f8d7a81-6282-4f52-a601-d840d8973365 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4f8d7a81-6282-4f52-a601-d840d8973365', 'metadata': {}}]). {{(pid=87576) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 04 22:55:33 devstack cinder-volume[87576]: DEBUG cinder.image.image_utils [None req-2ff5c4b2-aa76-40ec-9188-1c6aecdc3772 tempest-VolumesGetTest-1720378588 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4f8d7a81-6282-4f52-a601-d840d8973365_jvummaqkdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87576) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 04 22:55:33 devstack cinder-volume[87576]: INFO cinder.image.image_utils [None req-2ff5c4b2-aa76-40ec-9188-1c6aecdc3772 tempest-VolumesGetTest-1720378588 None] Image download 20.69 MB at 20.69 MB/s Sep 04 22:55:33 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac135b7-0bcb-4395-81a7-ee121199cace]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:55:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2ff5c4b2-aa76-40ec-9188-1c6aecdc3772 tempest-VolumesGetTest-1720378588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f8d7a81-6282-4f52-a601-d840d8973365_jvummaqkdevstack@QuobyteHD {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:55:33 devstack sudo[105257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f8d7a81-6282-4f52-a601-d840d8973365_jvummaqkdevstack@QuobyteHD Sep 04 22:55:33 devstack sudo[105257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:55:33 devstack sudo[105257]: pam_unix(sudo:session): session closed for user root Sep 04 22:55:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2ff5c4b2-aa76-40ec-9188-1c6aecdc3772 tempest-VolumesGetTest-1720378588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f8d7a81-6282-4f52-a601-d840d8973365_jvummaqkdevstack@QuobyteHD" returned: 0 in 0.339s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:55:33 devstack cinder-volume[87576]: DEBUG cinder.image.image_utils [None req-2ff5c4b2-aa76-40ec-9188-1c6aecdc3772 tempest-VolumesGetTest-1720378588 None] Temporary image 4f8d7a81-6282-4f52-a601-d840d8973365 is fetched for user 7d2849723d644fd492c510b0f6965e32. {{(pid=87576) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 04 22:55:33 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f10844-974e-41ef-96d5-4f8b6c99ca61]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:55:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2ff5c4b2-aa76-40ec-9188-1c6aecdc3772 tempest-VolumesGetTest-1720378588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f8d7a81-6282-4f52-a601-d840d8973365_jvummaqkdevstack@QuobyteHD {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:55:33 devstack sudo[105262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f8d7a81-6282-4f52-a601-d840d8973365_jvummaqkdevstack@QuobyteHD Sep 04 22:55:33 devstack sudo[105262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:55:33 devstack sudo[105262]: pam_unix(sudo:session): session closed for user root Sep 04 22:55:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2ff5c4b2-aa76-40ec-9188-1c6aecdc3772 tempest-VolumesGetTest-1720378588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f8d7a81-6282-4f52-a601-d840d8973365_jvummaqkdevstack@QuobyteHD" returned: 0 in 0.336s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:55:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-2ff5c4b2-aa76-40ec-9188-1c6aecdc3772 tempest-VolumesGetTest-1720378588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:55:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-2ff5c4b2-aa76-40ec-9188-1c6aecdc3772 tempest-VolumesGetTest-1720378588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:55:33 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-2ff5c4b2-aa76-40ec-9188-1c6aecdc3772 tempest-VolumesGetTest-1720378588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:55:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1203826517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75bf16b1-59e8-4182-9805-2f28ead33e89,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='63005c5628c5451e83490fb0eefa253a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:55:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:55:32Z,use_quota=True,user_id='7d2849723d644fd492c510b0f6965e32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:55:33 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-2ff5c4b2-aa76-40ec-9188-1c6aecdc3772 tempest-VolumesGetTest-1720378588 None] Creating volume 75bf16b1-59e8-4182-9805-2f28ead33e89 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:55:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-2ff5c4b2-aa76-40ec-9188-1c6aecdc3772 tempest-VolumesGetTest-1720378588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:55:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-2ff5c4b2-aa76-40ec-9188-1c6aecdc3772 tempest-VolumesGetTest-1720378588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:55:33 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-2ff5c4b2-aa76-40ec-9188-1c6aecdc3772 tempest-VolumesGetTest-1720378588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:55:33 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-2ff5c4b2-aa76-40ec-9188-1c6aecdc3772 tempest-VolumesGetTest-1720378588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:55:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-2ff5c4b2-aa76-40ec-9188-1c6aecdc3772 tempest-VolumesGetTest-1720378588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:55:33 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-2ff5c4b2-aa76-40ec-9188-1c6aecdc3772 tempest-VolumesGetTest-1720378588 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:55:33 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-2ff5c4b2-aa76-40ec-9188-1c6aecdc3772 tempest-VolumesGetTest-1720378588 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:55:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2ff5c4b2-aa76-40ec-9188-1c6aecdc3772 tempest-VolumesGetTest-1720378588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-75bf16b1-59e8-4182-9805-2f28ead33e89 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:55:34 devstack sudo[105267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-75bf16b1-59e8-4182-9805-2f28ead33e89 1073741824 Sep 04 22:55:34 devstack sudo[105267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:55:34 devstack sudo[105267]: pam_unix(sudo:session): session closed for user root Sep 04 22:55:34 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2ff5c4b2-aa76-40ec-9188-1c6aecdc3772 tempest-VolumesGetTest-1720378588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-75bf16b1-59e8-4182-9805-2f28ead33e89 1073741824" returned: 0 in 0.418s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:55:34 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2ff5c4b2-aa76-40ec-9188-1c6aecdc3772 tempest-VolumesGetTest-1720378588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-75bf16b1-59e8-4182-9805-2f28ead33e89 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:55:34 devstack sudo[105272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-75bf16b1-59e8-4182-9805-2f28ead33e89 Sep 04 22:55:34 devstack sudo[105272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:55:34 devstack sudo[105272]: pam_unix(sudo:session): session closed for user root Sep 04 22:55:34 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2ff5c4b2-aa76-40ec-9188-1c6aecdc3772 tempest-VolumesGetTest-1720378588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-75bf16b1-59e8-4182-9805-2f28ead33e89" returned: 0 in 0.255s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:55:34 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-2ff5c4b2-aa76-40ec-9188-1c6aecdc3772 tempest-VolumesGetTest-1720378588 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:55:34 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-2ff5c4b2-aa76-40ec-9188-1c6aecdc3772 tempest-VolumesGetTest-1720378588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:55:34 devstack cinder-volume[87576]: DEBUG cinder.volume.volume_utils [None req-2ff5c4b2-aa76-40ec-9188-1c6aecdc3772 tempest-VolumesGetTest-1720378588 None] Attempting download of 4f8d7a81-6282-4f52-a601-d840d8973365 ((None, [{'url': 'file:///opt/stack/data/glance/images/4f8d7a81-6282-4f52-a601-d840d8973365', 'metadata': {}}])) to volume 75bf16b1-59e8-4182-9805-2f28ead33e89. {{(pid=87576) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 04 22:55:34 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[48dd2c96-6a3c-4096-a213-d5f95947d251]: (4, 'raw') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:55:34 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2ff5c4b2-aa76-40ec-9188-1c6aecdc3772 tempest-VolumesGetTest-1720378588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4f8d7a81-6282-4f52-a601-d840d8973365_lpkqumbm {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:55:34 devstack sudo[105275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4f8d7a81-6282-4f52-a601-d840d8973365_lpkqumbm Sep 04 22:55:34 devstack sudo[105275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:55:35 devstack sudo[105275]: pam_unix(sudo:session): session closed for user root Sep 04 22:55:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2ff5c4b2-aa76-40ec-9188-1c6aecdc3772 tempest-VolumesGetTest-1720378588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4f8d7a81-6282-4f52-a601-d840d8973365_lpkqumbm" returned: 0 in 0.320s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:55:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2ff5c4b2-aa76-40ec-9188-1c6aecdc3772 tempest-VolumesGetTest-1720378588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4f8d7a81-6282-4f52-a601-d840d8973365_lpkqumbm {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:55:35 devstack sudo[105279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4f8d7a81-6282-4f52-a601-d840d8973365_lpkqumbm Sep 04 22:55:35 devstack sudo[105279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:55:35 devstack sudo[105279]: pam_unix(sudo:session): session closed for user root Sep 04 22:55:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2ff5c4b2-aa76-40ec-9188-1c6aecdc3772 tempest-VolumesGetTest-1720378588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4f8d7a81-6282-4f52-a601-d840d8973365_lpkqumbm" returned: 1 in 0.329s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:55:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2ff5c4b2-aa76-40ec-9188-1c6aecdc3772 tempest-VolumesGetTest-1720378588 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4f8d7a81-6282-4f52-a601-d840d8973365_lpkqumbm' failed. Not Retrying. {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 22:55:35 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[70bb1fa7-afc1-4b2c-8193-bb101ea68b92]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:55:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2ff5c4b2-aa76-40ec-9188-1c6aecdc3772 tempest-VolumesGetTest-1720378588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f8d7a81-6282-4f52-a601-d840d8973365_jvummaqkdevstack@QuobyteHD {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:55:35 devstack sudo[105283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f8d7a81-6282-4f52-a601-d840d8973365_jvummaqkdevstack@QuobyteHD Sep 04 22:55:35 devstack sudo[105283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:55:35 devstack sudo[105283]: pam_unix(sudo:session): session closed for user root Sep 04 22:55:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2ff5c4b2-aa76-40ec-9188-1c6aecdc3772 tempest-VolumesGetTest-1720378588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f8d7a81-6282-4f52-a601-d840d8973365_jvummaqkdevstack@QuobyteHD" returned: 0 in 0.331s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:55:35 devstack cinder-volume[87576]: DEBUG cinder.image.image_utils [None req-2ff5c4b2-aa76-40ec-9188-1c6aecdc3772 tempest-VolumesGetTest-1720378588 None] 4f8d7a81-6282-4f52-a601-d840d8973365 was qcow2, converting to qcow2 {{(pid=87576) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 04 22:55:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2ff5c4b2-aa76-40ec-9188-1c6aecdc3772 tempest-VolumesGetTest-1720378588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4f8d7a81-6282-4f52-a601-d840d8973365_jvummaqkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-75bf16b1-59e8-4182-9805-2f28ead33e89 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:55:35 devstack sudo[105288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4f8d7a81-6282-4f52-a601-d840d8973365_jvummaqkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-75bf16b1-59e8-4182-9805-2f28ead33e89 Sep 04 22:55:35 devstack sudo[105288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:55:37 devstack sudo[105288]: pam_unix(sudo:session): session closed for user root Sep 04 22:55:37 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2ff5c4b2-aa76-40ec-9188-1c6aecdc3772 tempest-VolumesGetTest-1720378588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4f8d7a81-6282-4f52-a601-d840d8973365_jvummaqkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-75bf16b1-59e8-4182-9805-2f28ead33e89" returned: 0 in 1.599s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:55:37 devstack cinder-volume[87576]: DEBUG cinder.image.image_utils [None req-2ff5c4b2-aa76-40ec-9188-1c6aecdc3772 tempest-VolumesGetTest-1720378588 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4f8d7a81-6282-4f52-a601-d840d8973365_jvummaqkdevstack@QuobyteHD, size 112.00 MB, duration 1.60 sec, destination /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-75bf16b1-59e8-4182-9805-2f28ead33e89 {{(pid=87576) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 22:55:37 devstack cinder-volume[87576]: INFO cinder.image.image_utils [None req-2ff5c4b2-aa76-40ec-9188-1c6aecdc3772 tempest-VolumesGetTest-1720378588 None] Converted 112.00 MB image at 69.99 MB/s Sep 04 22:55:37 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2ff5c4b2-aa76-40ec-9188-1c6aecdc3772 tempest-VolumesGetTest-1720378588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-75bf16b1-59e8-4182-9805-2f28ead33e89 1G {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:55:37 devstack sudo[105333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-75bf16b1-59e8-4182-9805-2f28ead33e89 1G Sep 04 22:55:37 devstack sudo[105333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:55:37 devstack sudo[105333]: pam_unix(sudo:session): session closed for user root Sep 04 22:55:37 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2ff5c4b2-aa76-40ec-9188-1c6aecdc3772 tempest-VolumesGetTest-1720378588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-75bf16b1-59e8-4182-9805-2f28ead33e89 1G" returned: 0 in 0.325s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:55:37 devstack cinder-volume[87576]: DEBUG cinder.volume.volume_utils [None req-2ff5c4b2-aa76-40ec-9188-1c6aecdc3772 tempest-VolumesGetTest-1720378588 None] Downloaded image 4f8d7a81-6282-4f52-a601-d840d8973365 ((None, [{'url': 'file:///opt/stack/data/glance/images/4f8d7a81-6282-4f52-a601-d840d8973365', 'metadata': {}}])) to volume 75bf16b1-59e8-4182-9805-2f28ead33e89 successfully. {{(pid=87576) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 04 22:55:37 devstack cinder-volume[87576]: DEBUG cinder.image.image_utils [None req-2ff5c4b2-aa76-40ec-9188-1c6aecdc3772 tempest-VolumesGetTest-1720378588 None] Temporary image 4f8d7a81-6282-4f52-a601-d840d8973365 for user 7d2849723d644fd492c510b0f6965e32 is deleted. {{(pid=87576) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 04 22:55:37 devstack cinder-volume[87576]: DEBUG cinder.volume.volume_utils [None req-2ff5c4b2-aa76-40ec-9188-1c6aecdc3772 tempest-VolumesGetTest-1720378588 None] Marking volume 75bf16b1-59e8-4182-9805-2f28ead33e89 as bootable. {{(pid=87576) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 04 22:55:37 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ff5c4b2-aa76-40ec-9188-1c6aecdc3772 tempest-VolumesGetTest-1720378588 None] Copying metadata from image 4f8d7a81-6282-4f52-a601-d840d8973365 to 75bf16b1-59e8-4182-9805-2f28ead33e89. {{(pid=87576) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 04 22:55:37 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ff5c4b2-aa76-40ec-9188-1c6aecdc3772 tempest-VolumesGetTest-1720378588 None] Creating volume glance metadata for volume 75bf16b1-59e8-4182-9805-2f28ead33e89 backed by image 4f8d7a81-6282-4f52-a601-d840d8973365 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4f8d7a81-6282-4f52-a601-d840d8973365', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87576) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 04 22:55:37 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2ff5c4b2-aa76-40ec-9188-1c6aecdc3772 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93541e7b-8e92-4884-8f66-4fee4b8728d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75bf16b1-59e8-4182-9805-2f28ead33e89', 'volume_size': 1, 'image_id': '4f8d7a81-6282-4f52-a601-d840d8973365', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4f8d7a81-6282-4f52-a601-d840d8973365', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5d1fd1f571ef419184ac7eda6748fdd3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4f8d7a81-6282-4f52-a601-d840d8973365', 'created_at': datetime.datetime(2026, 9, 4, 20, 33, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 20, 33, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f8d7a81-6282-4f52-a601-d840d8973365/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:55:37 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2ff5c4b2-aa76-40ec-9188-1c6aecdc3772 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (135ce08c-f136-4b2c-8d44-6a627c54c8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:55:37 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-2ff5c4b2-aa76-40ec-9188-1c6aecdc3772 tempest-VolumesGetTest-1720378588 None] Volume volume-75bf16b1-59e8-4182-9805-2f28ead33e89 (75bf16b1-59e8-4182-9805-2f28ead33e89): created successfully Sep 04 22:55:37 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2ff5c4b2-aa76-40ec-9188-1c6aecdc3772 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (135ce08c-f136-4b2c-8d44-6a627c54c8a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:55:37 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2ff5c4b2-aa76-40ec-9188-1c6aecdc3772 tempest-VolumesGetTest-1720378588 None] Flow 'volume_create_manager' (d178c7bd-38e7-4829-a58d-5cbc3b4ae71e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:55:37 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-2ff5c4b2-aa76-40ec-9188-1c6aecdc3772 tempest-VolumesGetTest-1720378588 None] Created volume successfully. Sep 04 22:55:39 devstack cinder-volume[87576]: DEBUG dbcounter [-] [87576] Writing DB stats cinder:SELECT=78,cinder:INSERT=39,cinder:UPDATE=102,cinder:DELETE=10 {{(pid=87576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 22:55:39 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-99a59dcd-4837-4907-b142-0bb5bbe39b99 tempest-VolumesGetTest-1720378588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:55:39 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-99a59dcd-4837-4907-b142-0bb5bbe39b99 tempest-VolumesGetTest-1720378588 None] Flow 'volume_create_manager' (9519dab7-bbbd-4a52-9d46-92007c40204f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:55:39 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-99a59dcd-4837-4907-b142-0bb5bbe39b99 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e6a037b-00a4-4469-93ee-a0143ad1d240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:55:39 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-99a59dcd-4837-4907-b142-0bb5bbe39b99 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e6a037b-00a4-4469-93ee-a0143ad1d240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:55:39Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1531609134',display_name='tempest-VolumesGetTest-Volume-295878175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90e4ebca-00b6-4710-9ee3-beed4d5018e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63005c5628c5451e83490fb0eefa253a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:55:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:55:39Z,use_quota=True,user_id='7d2849723d644fd492c510b0f6965e32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:55:39 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-99a59dcd-4837-4907-b142-0bb5bbe39b99 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c459be65-92ae-494a-8b14-5f35b3030283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:55:39 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-99a59dcd-4837-4907-b142-0bb5bbe39b99 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c459be65-92ae-494a-8b14-5f35b3030283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:55:39 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-99a59dcd-4837-4907-b142-0bb5bbe39b99 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bf17433-9b6c-4480-be15-e63602042889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:55:39 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-99a59dcd-4837-4907-b142-0bb5bbe39b99 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bf17433-9b6c-4480-be15-e63602042889) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90e4ebca-00b6-4710-9ee3-beed4d5018e6', 'volume_name': 'volume-90e4ebca-00b6-4710-9ee3-beed4d5018e6', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:55:39 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-99a59dcd-4837-4907-b142-0bb5bbe39b99 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ed8c7ed-df74-48e1-afb5-fd2a344a1299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:55:39 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-99a59dcd-4837-4907-b142-0bb5bbe39b99 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ed8c7ed-df74-48e1-afb5-fd2a344a1299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:55:39 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-99a59dcd-4837-4907-b142-0bb5bbe39b99 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2365db63-88ab-4ed3-99cd-91a182e50df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:55:39 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-99a59dcd-4837-4907-b142-0bb5bbe39b99 tempest-VolumesGetTest-1720378588 None] Volume 90e4ebca-00b6-4710-9ee3-beed4d5018e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90e4ebca-00b6-4710-9ee3-beed4d5018e6', 'volume_size': 1} Sep 04 22:55:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-99a59dcd-4837-4907-b142-0bb5bbe39b99 tempest-VolumesGetTest-1720378588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:55:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-99a59dcd-4837-4907-b142-0bb5bbe39b99 tempest-VolumesGetTest-1720378588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:55:39 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-99a59dcd-4837-4907-b142-0bb5bbe39b99 tempest-VolumesGetTest-1720378588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:55:39Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1531609134',display_name='tempest-VolumesGetTest-Volume-295878175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90e4ebca-00b6-4710-9ee3-beed4d5018e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63005c5628c5451e83490fb0eefa253a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:55:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:55:39Z,use_quota=True,user_id='7d2849723d644fd492c510b0f6965e32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:55:39 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-99a59dcd-4837-4907-b142-0bb5bbe39b99 tempest-VolumesGetTest-1720378588 None] Creating volume 90e4ebca-00b6-4710-9ee3-beed4d5018e6 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:55:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-99a59dcd-4837-4907-b142-0bb5bbe39b99 tempest-VolumesGetTest-1720378588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:55:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-99a59dcd-4837-4907-b142-0bb5bbe39b99 tempest-VolumesGetTest-1720378588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:55:39 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-99a59dcd-4837-4907-b142-0bb5bbe39b99 tempest-VolumesGetTest-1720378588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:55:39 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-99a59dcd-4837-4907-b142-0bb5bbe39b99 tempest-VolumesGetTest-1720378588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:55:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-99a59dcd-4837-4907-b142-0bb5bbe39b99 tempest-VolumesGetTest-1720378588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:55:39 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-99a59dcd-4837-4907-b142-0bb5bbe39b99 tempest-VolumesGetTest-1720378588 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:55:39 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-99a59dcd-4837-4907-b142-0bb5bbe39b99 tempest-VolumesGetTest-1720378588 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:55:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-99a59dcd-4837-4907-b142-0bb5bbe39b99 tempest-VolumesGetTest-1720378588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-90e4ebca-00b6-4710-9ee3-beed4d5018e6 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:55:39 devstack sudo[105338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-90e4ebca-00b6-4710-9ee3-beed4d5018e6 1073741824 Sep 04 22:55:39 devstack sudo[105338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:55:39 devstack sudo[105338]: pam_unix(sudo:session): session closed for user root Sep 04 22:55:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-99a59dcd-4837-4907-b142-0bb5bbe39b99 tempest-VolumesGetTest-1720378588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-90e4ebca-00b6-4710-9ee3-beed4d5018e6 1073741824" returned: 0 in 0.415s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:55:39 devstack cinder-volume[87576]: DEBUG dbcounter [-] [87576] Writing DB stats cinder:UPDATE=112,cinder:SELECT=83,cinder:INSERT=24,cinder:DELETE=9 {{(pid=87576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 22:55:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-99a59dcd-4837-4907-b142-0bb5bbe39b99 tempest-VolumesGetTest-1720378588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-90e4ebca-00b6-4710-9ee3-beed4d5018e6 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:55:40 devstack sudo[105344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-90e4ebca-00b6-4710-9ee3-beed4d5018e6 Sep 04 22:55:40 devstack sudo[105344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:55:40 devstack sudo[105344]: pam_unix(sudo:session): session closed for user root Sep 04 22:55:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-99a59dcd-4837-4907-b142-0bb5bbe39b99 tempest-VolumesGetTest-1720378588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-90e4ebca-00b6-4710-9ee3-beed4d5018e6" returned: 0 in 0.258s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:55:40 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-99a59dcd-4837-4907-b142-0bb5bbe39b99 tempest-VolumesGetTest-1720378588 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:55:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-99a59dcd-4837-4907-b142-0bb5bbe39b99 tempest-VolumesGetTest-1720378588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:55:40 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-99a59dcd-4837-4907-b142-0bb5bbe39b99 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2365db63-88ab-4ed3-99cd-91a182e50df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90e4ebca-00b6-4710-9ee3-beed4d5018e6', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:55:40 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-99a59dcd-4837-4907-b142-0bb5bbe39b99 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f945423a-8767-42dc-90a6-69f11e34dc8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:55:40 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-99a59dcd-4837-4907-b142-0bb5bbe39b99 tempest-VolumesGetTest-1720378588 None] Volume volume-90e4ebca-00b6-4710-9ee3-beed4d5018e6 (90e4ebca-00b6-4710-9ee3-beed4d5018e6): created successfully Sep 04 22:55:40 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-99a59dcd-4837-4907-b142-0bb5bbe39b99 tempest-VolumesGetTest-1720378588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f945423a-8767-42dc-90a6-69f11e34dc8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:55:40 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-99a59dcd-4837-4907-b142-0bb5bbe39b99 tempest-VolumesGetTest-1720378588 None] Flow 'volume_create_manager' (9519dab7-bbbd-4a52-9d46-92007c40204f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:55:40 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-99a59dcd-4837-4907-b142-0bb5bbe39b99 tempest-VolumesGetTest-1720378588 None] Created volume successfully. Sep 04 22:55:40 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-10e3e14e-2768-4a28-9ff0-48ccf24d93ef tempest-VolumesGetTest-1720378588 None] Acquiring lock "cinder-90e4ebca-00b6-4710-9ee3-beed4d5018e6-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:55:40 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-10e3e14e-2768-4a28-9ff0-48ccf24d93ef tempest-VolumesGetTest-1720378588 None] Lock "cinder-90e4ebca-00b6-4710-9ee3-beed4d5018e6-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:55:40 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-10e3e14e-2768-4a28-9ff0-48ccf24d93ef tempest-VolumesGetTest-1720378588 None] Acquiring lock "cinder-quobyte-90e4ebca-00b6-4710-9ee3-beed4d5018e6" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:55:40 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-10e3e14e-2768-4a28-9ff0-48ccf24d93ef tempest-VolumesGetTest-1720378588 None] Lock "cinder-quobyte-90e4ebca-00b6-4710-9ee3-beed4d5018e6" acquired by "delete_volume" :: waited 0.019s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:55:40 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de63075-08ad-4b81-b289-2ad19f2d63d3]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:55:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-10e3e14e-2768-4a28-9ff0-48ccf24d93ef tempest-VolumesGetTest-1720378588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-90e4ebca-00b6-4710-9ee3-beed4d5018e6 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:55:40 devstack sudo[105347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-90e4ebca-00b6-4710-9ee3-beed4d5018e6 Sep 04 22:55:40 devstack sudo[105347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:55:41 devstack sudo[105347]: pam_unix(sudo:session): session closed for user root Sep 04 22:55:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-10e3e14e-2768-4a28-9ff0-48ccf24d93ef tempest-VolumesGetTest-1720378588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-90e4ebca-00b6-4710-9ee3-beed4d5018e6" returned: 0 in 0.355s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:55:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-10e3e14e-2768-4a28-9ff0-48ccf24d93ef tempest-VolumesGetTest-1720378588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-90e4ebca-00b6-4710-9ee3-beed4d5018e6 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:55:41 devstack sudo[105352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-90e4ebca-00b6-4710-9ee3-beed4d5018e6 Sep 04 22:55:41 devstack sudo[105352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:55:41 devstack sudo[105352]: pam_unix(sudo:session): session closed for user root Sep 04 22:55:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-10e3e14e-2768-4a28-9ff0-48ccf24d93ef tempest-VolumesGetTest-1720378588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-90e4ebca-00b6-4710-9ee3-beed4d5018e6" returned: 0 in 0.245s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:55:41 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-10e3e14e-2768-4a28-9ff0-48ccf24d93ef tempest-VolumesGetTest-1720378588 None] Lock "cinder-quobyte-90e4ebca-00b6-4710-9ee3-beed4d5018e6" released by "delete_volume" :: held 0.637s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:55:41 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-10e3e14e-2768-4a28-9ff0-48ccf24d93ef tempest-VolumesGetTest-1720378588 None] Created reservations ['82a5e927-8c31-402b-8e13-06b076491ffb', 'f5fefbc0-7c14-4bee-81eb-59b02708bb94', '4c66d61d-9d4a-4135-9c04-59a38991b1fb', 'd79a2235-e01d-4421-9df6-385eed16ef5d'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:55:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-10e3e14e-2768-4a28-9ff0-48ccf24d93ef tempest-VolumesGetTest-1720378588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:55:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-10e3e14e-2768-4a28-9ff0-48ccf24d93ef tempest-VolumesGetTest-1720378588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:55:41 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-10e3e14e-2768-4a28-9ff0-48ccf24d93ef tempest-VolumesGetTest-1720378588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:55:41 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-10e3e14e-2768-4a28-9ff0-48ccf24d93ef tempest-VolumesGetTest-1720378588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:55:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-10e3e14e-2768-4a28-9ff0-48ccf24d93ef tempest-VolumesGetTest-1720378588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:55:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-10e3e14e-2768-4a28-9ff0-48ccf24d93ef tempest-VolumesGetTest-1720378588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:55:41 devstack sudo[105355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:55:41 devstack sudo[105355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:55:41 devstack sudo[105355]: pam_unix(sudo:session): session closed for user root Sep 04 22:55:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-10e3e14e-2768-4a28-9ff0-48ccf24d93ef tempest-VolumesGetTest-1720378588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.250s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:55:41 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-10e3e14e-2768-4a28-9ff0-48ccf24d93ef tempest-VolumesGetTest-1720378588 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:55:41 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-10e3e14e-2768-4a28-9ff0-48ccf24d93ef tempest-VolumesGetTest-1720378588 None] Deleted volume successfully. Sep 04 22:55:41 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-10e3e14e-2768-4a28-9ff0-48ccf24d93ef tempest-VolumesGetTest-1720378588 None] Lock "cinder-90e4ebca-00b6-4710-9ee3-beed4d5018e6-delete_volume" released by "delete_volume" :: held 1.083s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:55:41 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-8ead4b95-c07c-485d-b21a-42da2caab029 tempest-VolumesGetTest-1720378588 None] Acquiring lock "cinder-75bf16b1-59e8-4182-9805-2f28ead33e89-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:55:41 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-8ead4b95-c07c-485d-b21a-42da2caab029 tempest-VolumesGetTest-1720378588 None] Lock "cinder-75bf16b1-59e8-4182-9805-2f28ead33e89-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:55:41 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-8ead4b95-c07c-485d-b21a-42da2caab029 tempest-VolumesGetTest-1720378588 None] Acquiring lock "cinder-quobyte-75bf16b1-59e8-4182-9805-2f28ead33e89" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:55:41 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-8ead4b95-c07c-485d-b21a-42da2caab029 tempest-VolumesGetTest-1720378588 None] Lock "cinder-quobyte-75bf16b1-59e8-4182-9805-2f28ead33e89" acquired by "delete_volume" :: waited 0.015s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:55:41 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0308c54-1b84-406f-8fe5-157629da3dd0]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:55:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-8ead4b95-c07c-485d-b21a-42da2caab029 tempest-VolumesGetTest-1720378588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-75bf16b1-59e8-4182-9805-2f28ead33e89 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:55:42 devstack sudo[105358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-75bf16b1-59e8-4182-9805-2f28ead33e89 Sep 04 22:55:42 devstack sudo[105358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:55:42 devstack sudo[105358]: pam_unix(sudo:session): session closed for user root Sep 04 22:55:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-8ead4b95-c07c-485d-b21a-42da2caab029 tempest-VolumesGetTest-1720378588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-75bf16b1-59e8-4182-9805-2f28ead33e89" returned: 0 in 0.370s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:55:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-8ead4b95-c07c-485d-b21a-42da2caab029 tempest-VolumesGetTest-1720378588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-75bf16b1-59e8-4182-9805-2f28ead33e89 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:55:42 devstack sudo[105363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-75bf16b1-59e8-4182-9805-2f28ead33e89 Sep 04 22:55:42 devstack sudo[105363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:55:42 devstack sudo[105363]: pam_unix(sudo:session): session closed for user root Sep 04 22:55:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-8ead4b95-c07c-485d-b21a-42da2caab029 tempest-VolumesGetTest-1720378588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-75bf16b1-59e8-4182-9805-2f28ead33e89" returned: 0 in 0.251s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:55:42 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-8ead4b95-c07c-485d-b21a-42da2caab029 tempest-VolumesGetTest-1720378588 None] Lock "cinder-quobyte-75bf16b1-59e8-4182-9805-2f28ead33e89" released by "delete_volume" :: held 0.658s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:55:42 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-8ead4b95-c07c-485d-b21a-42da2caab029 tempest-VolumesGetTest-1720378588 None] Created reservations ['96a306f0-4e02-4241-b8f4-658d8f0845f8', 'f988ffa3-51b1-4f99-bc7f-e9631484fb37', '55efbae5-640d-4781-910e-a00bda4cabd1', 'b1a9a152-3ab4-4afa-9f6b-a5d291fcec34'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:55:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-8ead4b95-c07c-485d-b21a-42da2caab029 tempest-VolumesGetTest-1720378588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:55:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-8ead4b95-c07c-485d-b21a-42da2caab029 tempest-VolumesGetTest-1720378588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:55:42 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-8ead4b95-c07c-485d-b21a-42da2caab029 tempest-VolumesGetTest-1720378588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:55:42 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-8ead4b95-c07c-485d-b21a-42da2caab029 tempest-VolumesGetTest-1720378588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:55:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-8ead4b95-c07c-485d-b21a-42da2caab029 tempest-VolumesGetTest-1720378588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:55:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-8ead4b95-c07c-485d-b21a-42da2caab029 tempest-VolumesGetTest-1720378588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:55:42 devstack sudo[105366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:55:42 devstack sudo[105366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:55:42 devstack sudo[105366]: pam_unix(sudo:session): session closed for user root Sep 04 22:55:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-8ead4b95-c07c-485d-b21a-42da2caab029 tempest-VolumesGetTest-1720378588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.250s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:55:42 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-8ead4b95-c07c-485d-b21a-42da2caab029 tempest-VolumesGetTest-1720378588 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:55:42 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-8ead4b95-c07c-485d-b21a-42da2caab029 tempest-VolumesGetTest-1720378588 None] Deleted volume successfully. Sep 04 22:55:42 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-8ead4b95-c07c-485d-b21a-42da2caab029 tempest-VolumesGetTest-1720378588 None] Lock "cinder-75bf16b1-59e8-4182-9805-2f28ead33e89-delete_volume" released by "delete_volume" :: held 1.108s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:55:52 devstack cinder-volume[87576]: DEBUG dbcounter [-] [87576] Writing DB stats cinder:UPDATE=17,cinder:SELECT=13,cinder:INSERT=5 {{(pid=87576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 22:56:02 devstack cinder-volume[87576]: DEBUG dbcounter [-] [87576] Writing DB stats cinder:SELECT=1 {{(pid=87576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 22:56:02 devstack cinder-volume[87576]: DEBUG dbcounter [-] [87576] Writing DB stats cinder:SELECT=8,cinder:UPDATE=21,cinder:INSERT=4,cinder:DELETE=3 {{(pid=87576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 22:56:07 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-80d748ba-ea06-4650-af71-6ed908ba76a0 tempest-TestInstancesWithCinderVolumes-739781099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:56:07 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-80d748ba-ea06-4650-af71-6ed908ba76a0 tempest-TestInstancesWithCinderVolumes-739781099 None] Flow 'volume_create_manager' (4014a3ef-b61b-4a69-a947-904e41824f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:56:07 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-80d748ba-ea06-4650-af71-6ed908ba76a0 tempest-TestInstancesWithCinderVolumes-739781099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90d9038e-4e90-4e20-aa47-1715e8557625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:56:07 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-80d748ba-ea06-4650-af71-6ed908ba76a0 tempest-TestInstancesWithCinderVolumes-739781099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90d9038e-4e90-4e20-aa47-1715e8557625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:56:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-296129725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=468f01c3-02b5-4456-889d-3e0ad32087ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f8b821db6f9493c98830849d3d16ba5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:56:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:56:08Z,use_quota=True,user_id='ed4143d329e9457e9cf0a5b51ca6b4c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3faf19d4-909e-4316-b0af-03ce2604de8d),volume_type_id=3faf19d4-909e-4316-b0af-03ce2604de8d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:56:07 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-80d748ba-ea06-4650-af71-6ed908ba76a0 tempest-TestInstancesWithCinderVolumes-739781099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67b08750-2b82-4403-8141-138956f2ab68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:56:07 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-80d748ba-ea06-4650-af71-6ed908ba76a0 tempest-TestInstancesWithCinderVolumes-739781099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67b08750-2b82-4403-8141-138956f2ab68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:56:07 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-80d748ba-ea06-4650-af71-6ed908ba76a0 tempest-TestInstancesWithCinderVolumes-739781099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ee6f485-8418-4e7c-8339-4010226e8c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:56:07 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-80d748ba-ea06-4650-af71-6ed908ba76a0 tempest-TestInstancesWithCinderVolumes-739781099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ee6f485-8418-4e7c-8339-4010226e8c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '468f01c3-02b5-4456-889d-3e0ad32087ca', 'volume_name': 'volume-468f01c3-02b5-4456-889d-3e0ad32087ca', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:56:07 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-80d748ba-ea06-4650-af71-6ed908ba76a0 tempest-TestInstancesWithCinderVolumes-739781099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d978dc9-9d31-4cc5-be28-ec5fbe15e536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:56:07 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-80d748ba-ea06-4650-af71-6ed908ba76a0 tempest-TestInstancesWithCinderVolumes-739781099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d978dc9-9d31-4cc5-be28-ec5fbe15e536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:56:07 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-80d748ba-ea06-4650-af71-6ed908ba76a0 tempest-TestInstancesWithCinderVolumes-739781099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8784d6d-5955-4907-ba7e-9eb7c606707a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:56:07 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-80d748ba-ea06-4650-af71-6ed908ba76a0 tempest-TestInstancesWithCinderVolumes-739781099 None] Volume 468f01c3-02b5-4456-889d-3e0ad32087ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-468f01c3-02b5-4456-889d-3e0ad32087ca', 'volume_size': 1} Sep 04 22:56:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-80d748ba-ea06-4650-af71-6ed908ba76a0 tempest-TestInstancesWithCinderVolumes-739781099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:56:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-80d748ba-ea06-4650-af71-6ed908ba76a0 tempest-TestInstancesWithCinderVolumes-739781099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:56:07 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-80d748ba-ea06-4650-af71-6ed908ba76a0 tempest-TestInstancesWithCinderVolumes-739781099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:56:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-296129725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=468f01c3-02b5-4456-889d-3e0ad32087ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f8b821db6f9493c98830849d3d16ba5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:56:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:56:08Z,use_quota=True,user_id='ed4143d329e9457e9cf0a5b51ca6b4c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3faf19d4-909e-4316-b0af-03ce2604de8d),volume_type_id=3faf19d4-909e-4316-b0af-03ce2604de8d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:56:07 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-80d748ba-ea06-4650-af71-6ed908ba76a0 tempest-TestInstancesWithCinderVolumes-739781099 None] Creating volume 468f01c3-02b5-4456-889d-3e0ad32087ca {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:56:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-80d748ba-ea06-4650-af71-6ed908ba76a0 tempest-TestInstancesWithCinderVolumes-739781099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:56:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-80d748ba-ea06-4650-af71-6ed908ba76a0 tempest-TestInstancesWithCinderVolumes-739781099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:56:07 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-80d748ba-ea06-4650-af71-6ed908ba76a0 tempest-TestInstancesWithCinderVolumes-739781099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:56:07 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-80d748ba-ea06-4650-af71-6ed908ba76a0 tempest-TestInstancesWithCinderVolumes-739781099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:56:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-80d748ba-ea06-4650-af71-6ed908ba76a0 tempest-TestInstancesWithCinderVolumes-739781099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:56:07 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-80d748ba-ea06-4650-af71-6ed908ba76a0 tempest-TestInstancesWithCinderVolumes-739781099 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:56:07 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-80d748ba-ea06-4650-af71-6ed908ba76a0 tempest-TestInstancesWithCinderVolumes-739781099 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:56:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-80d748ba-ea06-4650-af71-6ed908ba76a0 tempest-TestInstancesWithCinderVolumes-739781099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-468f01c3-02b5-4456-889d-3e0ad32087ca 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:56:07 devstack sudo[105383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-468f01c3-02b5-4456-889d-3e0ad32087ca 1073741824 Sep 04 22:56:07 devstack sudo[105383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:56:08 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f2c7340-89a8-4bc0-a47f-2e3be5bf3836 tempest-TestInstancesWithCinderVolumes-739781099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:56:08 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9f2c7340-89a8-4bc0-a47f-2e3be5bf3836 tempest-TestInstancesWithCinderVolumes-739781099 None] Flow 'volume_create_manager' (baca2727-69ef-4a44-bc10-d299a2c8cc70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:56:08 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9f2c7340-89a8-4bc0-a47f-2e3be5bf3836 tempest-TestInstancesWithCinderVolumes-739781099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8be09ed2-e094-49c7-bd8c-ea9ad95f0567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:56:08 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9f2c7340-89a8-4bc0-a47f-2e3be5bf3836 tempest-TestInstancesWithCinderVolumes-739781099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8be09ed2-e094-49c7-bd8c-ea9ad95f0567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:56:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1836770609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e53b1bc8-3d71-4824-bb70-36f87c21d5b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f8b821db6f9493c98830849d3d16ba5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:56:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:56:08Z,use_quota=True,user_id='ed4143d329e9457e9cf0a5b51ca6b4c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b03a8c20-5cea-414f-ac0a-e54d4bb79c15),volume_type_id=b03a8c20-5cea-414f-ac0a-e54d4bb79c15)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:56:08 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9f2c7340-89a8-4bc0-a47f-2e3be5bf3836 tempest-TestInstancesWithCinderVolumes-739781099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (519cca33-c3d7-45c9-bb5d-a630a9d86bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:56:08 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9f2c7340-89a8-4bc0-a47f-2e3be5bf3836 tempest-TestInstancesWithCinderVolumes-739781099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (519cca33-c3d7-45c9-bb5d-a630a9d86bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:56:08 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9f2c7340-89a8-4bc0-a47f-2e3be5bf3836 tempest-TestInstancesWithCinderVolumes-739781099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca508dc3-e5f0-4553-a829-e874e8b75a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:56:08 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9f2c7340-89a8-4bc0-a47f-2e3be5bf3836 tempest-TestInstancesWithCinderVolumes-739781099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca508dc3-e5f0-4553-a829-e874e8b75a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e53b1bc8-3d71-4824-bb70-36f87c21d5b9', 'volume_name': 'volume-e53b1bc8-3d71-4824-bb70-36f87c21d5b9', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:56:08 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9f2c7340-89a8-4bc0-a47f-2e3be5bf3836 tempest-TestInstancesWithCinderVolumes-739781099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88bd97bd-f0e3-4aa8-ba62-1f9ff3368316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:56:08 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9f2c7340-89a8-4bc0-a47f-2e3be5bf3836 tempest-TestInstancesWithCinderVolumes-739781099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88bd97bd-f0e3-4aa8-ba62-1f9ff3368316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:56:08 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9f2c7340-89a8-4bc0-a47f-2e3be5bf3836 tempest-TestInstancesWithCinderVolumes-739781099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adf17e3e-3d37-4b09-900e-955a3249698c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:56:08 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-9f2c7340-89a8-4bc0-a47f-2e3be5bf3836 tempest-TestInstancesWithCinderVolumes-739781099 None] Volume e53b1bc8-3d71-4824-bb70-36f87c21d5b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e53b1bc8-3d71-4824-bb70-36f87c21d5b9', 'volume_size': 1} Sep 04 22:56:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-9f2c7340-89a8-4bc0-a47f-2e3be5bf3836 tempest-TestInstancesWithCinderVolumes-739781099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:56:08 devstack sudo[105383]: pam_unix(sudo:session): session closed for user root Sep 04 22:56:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-80d748ba-ea06-4650-af71-6ed908ba76a0 tempest-TestInstancesWithCinderVolumes-739781099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-468f01c3-02b5-4456-889d-3e0ad32087ca 1073741824" returned: 0 in 0.492s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:56:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-80d748ba-ea06-4650-af71-6ed908ba76a0 tempest-TestInstancesWithCinderVolumes-739781099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-468f01c3-02b5-4456-889d-3e0ad32087ca {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:56:08 devstack sudo[105388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-468f01c3-02b5-4456-889d-3e0ad32087ca Sep 04 22:56:08 devstack sudo[105388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:56:08 devstack sudo[105388]: pam_unix(sudo:session): session closed for user root Sep 04 22:56:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-80d748ba-ea06-4650-af71-6ed908ba76a0 tempest-TestInstancesWithCinderVolumes-739781099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-468f01c3-02b5-4456-889d-3e0ad32087ca" returned: 0 in 0.268s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:56:08 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-80d748ba-ea06-4650-af71-6ed908ba76a0 tempest-TestInstancesWithCinderVolumes-739781099 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:56:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-80d748ba-ea06-4650-af71-6ed908ba76a0 tempest-TestInstancesWithCinderVolumes-739781099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:56:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-9f2c7340-89a8-4bc0-a47f-2e3be5bf3836 tempest-TestInstancesWithCinderVolumes-739781099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.406s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:56:08 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-9f2c7340-89a8-4bc0-a47f-2e3be5bf3836 tempest-TestInstancesWithCinderVolumes-739781099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:56:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1836770609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e53b1bc8-3d71-4824-bb70-36f87c21d5b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f8b821db6f9493c98830849d3d16ba5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:56:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:56:08Z,use_quota=True,user_id='ed4143d329e9457e9cf0a5b51ca6b4c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b03a8c20-5cea-414f-ac0a-e54d4bb79c15),volume_type_id=b03a8c20-5cea-414f-ac0a-e54d4bb79c15)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:56:08 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-9f2c7340-89a8-4bc0-a47f-2e3be5bf3836 tempest-TestInstancesWithCinderVolumes-739781099 None] Creating volume e53b1bc8-3d71-4824-bb70-36f87c21d5b9 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:56:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-9f2c7340-89a8-4bc0-a47f-2e3be5bf3836 tempest-TestInstancesWithCinderVolumes-739781099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:56:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-9f2c7340-89a8-4bc0-a47f-2e3be5bf3836 tempest-TestInstancesWithCinderVolumes-739781099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:56:08 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-9f2c7340-89a8-4bc0-a47f-2e3be5bf3836 tempest-TestInstancesWithCinderVolumes-739781099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:56:08 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-9f2c7340-89a8-4bc0-a47f-2e3be5bf3836 tempest-TestInstancesWithCinderVolumes-739781099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:56:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-9f2c7340-89a8-4bc0-a47f-2e3be5bf3836 tempest-TestInstancesWithCinderVolumes-739781099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:56:08 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-9f2c7340-89a8-4bc0-a47f-2e3be5bf3836 tempest-TestInstancesWithCinderVolumes-739781099 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:56:08 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-9f2c7340-89a8-4bc0-a47f-2e3be5bf3836 tempest-TestInstancesWithCinderVolumes-739781099 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:56:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-9f2c7340-89a8-4bc0-a47f-2e3be5bf3836 tempest-TestInstancesWithCinderVolumes-739781099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e53b1bc8-3d71-4824-bb70-36f87c21d5b9 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:56:08 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-80d748ba-ea06-4650-af71-6ed908ba76a0 tempest-TestInstancesWithCinderVolumes-739781099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8784d6d-5955-4907-ba7e-9eb7c606707a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-468f01c3-02b5-4456-889d-3e0ad32087ca', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:56:08 devstack sudo[105391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e53b1bc8-3d71-4824-bb70-36f87c21d5b9 1073741824 Sep 04 22:56:08 devstack sudo[105391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:56:08 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-80d748ba-ea06-4650-af71-6ed908ba76a0 tempest-TestInstancesWithCinderVolumes-739781099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98c5bb57-eed3-4411-acc8-99709c3d41b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:56:08 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-80d748ba-ea06-4650-af71-6ed908ba76a0 tempest-TestInstancesWithCinderVolumes-739781099 None] Volume volume-468f01c3-02b5-4456-889d-3e0ad32087ca (468f01c3-02b5-4456-889d-3e0ad32087ca): created successfully Sep 04 22:56:08 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-80d748ba-ea06-4650-af71-6ed908ba76a0 tempest-TestInstancesWithCinderVolumes-739781099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98c5bb57-eed3-4411-acc8-99709c3d41b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:56:08 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-80d748ba-ea06-4650-af71-6ed908ba76a0 tempest-TestInstancesWithCinderVolumes-739781099 None] Flow 'volume_create_manager' (4014a3ef-b61b-4a69-a947-904e41824f8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:56:08 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-80d748ba-ea06-4650-af71-6ed908ba76a0 tempest-TestInstancesWithCinderVolumes-739781099 None] Created volume successfully. Sep 04 22:56:08 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-75331eb9-174c-4557-b77d-a0f2fa4921d3 tempest-TestInstancesWithCinderVolumes-739781099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:56:08 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-75331eb9-174c-4557-b77d-a0f2fa4921d3 tempest-TestInstancesWithCinderVolumes-739781099 None] Flow 'volume_create_manager' (113ae412-7ac0-41a2-a624-b524b9705e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:56:08 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-75331eb9-174c-4557-b77d-a0f2fa4921d3 tempest-TestInstancesWithCinderVolumes-739781099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b31d2baf-5f01-4528-b6be-4ca54d6c2703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:56:08 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-75331eb9-174c-4557-b77d-a0f2fa4921d3 tempest-TestInstancesWithCinderVolumes-739781099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b31d2baf-5f01-4528-b6be-4ca54d6c2703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:56:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1791495393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc9459a4-91e1-441b-b847-6b6c26b49f54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f8b821db6f9493c98830849d3d16ba5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:56:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:56:09Z,use_quota=True,user_id='ed4143d329e9457e9cf0a5b51ca6b4c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c99dfc4a-1b38-4ac6-8f2c-a96b980603dc),volume_type_id=c99dfc4a-1b38-4ac6-8f2c-a96b980603dc)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:56:08 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-75331eb9-174c-4557-b77d-a0f2fa4921d3 tempest-TestInstancesWithCinderVolumes-739781099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fdbbd20-db13-433e-933c-570a697f3e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:56:08 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-75331eb9-174c-4557-b77d-a0f2fa4921d3 tempest-TestInstancesWithCinderVolumes-739781099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fdbbd20-db13-433e-933c-570a697f3e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:56:08 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-75331eb9-174c-4557-b77d-a0f2fa4921d3 tempest-TestInstancesWithCinderVolumes-739781099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f89d940-2b37-484e-82f4-a008958cb0e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:56:08 devstack cinder-volume[87576]: DEBUG cinder.image.glance [None req-75331eb9-174c-4557-b77d-a0f2fa4921d3 tempest-TestInstancesWithCinderVolumes-739781099 None] Creating Keystone auth plugin from conf {{(pid=87576) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 04 22:56:09 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-75331eb9-174c-4557-b77d-a0f2fa4921d3 tempest-TestInstancesWithCinderVolumes-739781099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f89d940-2b37-484e-82f4-a008958cb0e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fc9459a4-91e1-441b-b847-6b6c26b49f54', 'volume_name': 'volume-fc9459a4-91e1-441b-b847-6b6c26b49f54', 'volume_size': 1, 'image_id': '99960856-60ce-4010-bb81-b2471d0203e0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/99960856-60ce-4010-bb81-b2471d0203e0', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--989924214', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1f8b821db6f9493c98830849d3d16ba5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '99960856-60ce-4010-bb81-b2471d0203e0', 'created_at': datetime.datetime(2026, 9, 4, 20, 56, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 20, 56, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/99960856-60ce-4010-bb81-b2471d0203e0/file', 'properties': {}}, 'image_service': }' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:56:09 devstack sudo[105391]: pam_unix(sudo:session): session closed for user root Sep 04 22:56:09 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-75331eb9-174c-4557-b77d-a0f2fa4921d3 tempest-TestInstancesWithCinderVolumes-739781099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2df47c1-008c-465e-a3a0-dac70c1d24fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:56:09 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-75331eb9-174c-4557-b77d-a0f2fa4921d3 tempest-TestInstancesWithCinderVolumes-739781099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2df47c1-008c-465e-a3a0-dac70c1d24fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:56:09 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-75331eb9-174c-4557-b77d-a0f2fa4921d3 tempest-TestInstancesWithCinderVolumes-739781099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67195f6a-c15a-4e38-93d9-7e5520f00ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:56:09 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-75331eb9-174c-4557-b77d-a0f2fa4921d3 tempest-TestInstancesWithCinderVolumes-739781099 None] Volume fc9459a4-91e1-441b-b847-6b6c26b49f54: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fc9459a4-91e1-441b-b847-6b6c26b49f54', 'volume_size': 1, 'image_id': '99960856-60ce-4010-bb81-b2471d0203e0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/99960856-60ce-4010-bb81-b2471d0203e0', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--989924214', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1f8b821db6f9493c98830849d3d16ba5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '99960856-60ce-4010-bb81-b2471d0203e0', 'created_at': datetime.datetime(2026, 9, 4, 20, 56, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 20, 56, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/99960856-60ce-4010-bb81-b2471d0203e0/file', 'properties': {}}, 'image_service': } Sep 04 22:56:09 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-75331eb9-174c-4557-b77d-a0f2fa4921d3 tempest-TestInstancesWithCinderVolumes-739781099 None] Trying to clone fc9459a4-91e1-441b-b847-6b6c26b49f54 from image 99960856-60ce-4010-bb81-b2471d0203e0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/99960856-60ce-4010-bb81-b2471d0203e0', 'metadata': {}}]). {{(pid=87576) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 04 22:56:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-9f2c7340-89a8-4bc0-a47f-2e3be5bf3836 tempest-TestInstancesWithCinderVolumes-739781099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e53b1bc8-3d71-4824-bb70-36f87c21d5b9 1073741824" returned: 0 in 0.497s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:56:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-9f2c7340-89a8-4bc0-a47f-2e3be5bf3836 tempest-TestInstancesWithCinderVolumes-739781099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e53b1bc8-3d71-4824-bb70-36f87c21d5b9 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:56:09 devstack sudo[105396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e53b1bc8-3d71-4824-bb70-36f87c21d5b9 Sep 04 22:56:09 devstack sudo[105396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:56:09 devstack sudo[105396]: pam_unix(sudo:session): session closed for user root Sep 04 22:56:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-9f2c7340-89a8-4bc0-a47f-2e3be5bf3836 tempest-TestInstancesWithCinderVolumes-739781099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e53b1bc8-3d71-4824-bb70-36f87c21d5b9" returned: 0 in 0.285s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:56:09 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-9f2c7340-89a8-4bc0-a47f-2e3be5bf3836 tempest-TestInstancesWithCinderVolumes-739781099 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:56:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-9f2c7340-89a8-4bc0-a47f-2e3be5bf3836 tempest-TestInstancesWithCinderVolumes-739781099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:56:09 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9f2c7340-89a8-4bc0-a47f-2e3be5bf3836 tempest-TestInstancesWithCinderVolumes-739781099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adf17e3e-3d37-4b09-900e-955a3249698c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e53b1bc8-3d71-4824-bb70-36f87c21d5b9', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:56:09 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9f2c7340-89a8-4bc0-a47f-2e3be5bf3836 tempest-TestInstancesWithCinderVolumes-739781099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5f03d31-c115-4907-b21c-075369bf08f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:56:09 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-9f2c7340-89a8-4bc0-a47f-2e3be5bf3836 tempest-TestInstancesWithCinderVolumes-739781099 None] Volume volume-e53b1bc8-3d71-4824-bb70-36f87c21d5b9 (e53b1bc8-3d71-4824-bb70-36f87c21d5b9): created successfully Sep 04 22:56:09 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9f2c7340-89a8-4bc0-a47f-2e3be5bf3836 tempest-TestInstancesWithCinderVolumes-739781099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5f03d31-c115-4907-b21c-075369bf08f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:56:09 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9f2c7340-89a8-4bc0-a47f-2e3be5bf3836 tempest-TestInstancesWithCinderVolumes-739781099 None] Flow 'volume_create_manager' (baca2727-69ef-4a44-bc10-d299a2c8cc70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:56:09 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-9f2c7340-89a8-4bc0-a47f-2e3be5bf3836 tempest-TestInstancesWithCinderVolumes-739781099 None] Created volume successfully. Sep 04 22:56:11 devstack cinder-volume[87576]: DEBUG oslo_service.periodic_task [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87576) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 22:56:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:56:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:56:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:56:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:56:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:56:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:56:11 devstack sudo[105399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:56:11 devstack sudo[105399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:56:12 devstack cinder-volume[87576]: DEBUG cinder.image.image_utils [None req-75331eb9-174c-4557-b77d-a0f2fa4921d3 tempest-TestInstancesWithCinderVolumes-739781099 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_99960856-60ce-4010-bb81-b2471d0203e0_5yptj137devstack@QuobyteHD, size 20.69 MB, duration 2.83 sec {{(pid=87576) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 04 22:56:12 devstack cinder-volume[87576]: INFO cinder.image.image_utils [None req-75331eb9-174c-4557-b77d-a0f2fa4921d3 tempest-TestInstancesWithCinderVolumes-739781099 None] Image download 20.69 MB at 7.32 MB/s Sep 04 22:56:12 devstack sudo[105399]: pam_unix(sudo:session): session closed for user root Sep 04 22:56:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.254s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:56:12 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:56:12 devstack cinder-volume[87576]: DEBUG oslo_service.periodic_task [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Running periodic task VolumeManager._thread_info {{(pid=87576) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 22:56:12 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] thread count: 28 {{(pid=87576) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 22:56:12 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] thread info: [<_MainThread(MainThread, started 125730416963712)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87576) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 22:56:12 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[b079b7f2-8016-4373-91d7-520a8f8be865]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:56:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-75331eb9-174c-4557-b77d-a0f2fa4921d3 tempest-TestInstancesWithCinderVolumes-739781099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_99960856-60ce-4010-bb81-b2471d0203e0_5yptj137devstack@QuobyteHD {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:56:12 devstack sudo[105402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_99960856-60ce-4010-bb81-b2471d0203e0_5yptj137devstack@QuobyteHD Sep 04 22:56:12 devstack sudo[105402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:56:12 devstack sudo[105402]: pam_unix(sudo:session): session closed for user root Sep 04 22:56:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-75331eb9-174c-4557-b77d-a0f2fa4921d3 tempest-TestInstancesWithCinderVolumes-739781099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_99960856-60ce-4010-bb81-b2471d0203e0_5yptj137devstack@QuobyteHD" returned: 0 in 0.322s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:56:12 devstack cinder-volume[87576]: DEBUG cinder.image.image_utils [None req-75331eb9-174c-4557-b77d-a0f2fa4921d3 tempest-TestInstancesWithCinderVolumes-739781099 None] Temporary image 99960856-60ce-4010-bb81-b2471d0203e0 is fetched for user ed4143d329e9457e9cf0a5b51ca6b4c1. {{(pid=87576) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 04 22:56:12 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36f1f39-fa60-4345-9b17-d89815838c79]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:56:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-75331eb9-174c-4557-b77d-a0f2fa4921d3 tempest-TestInstancesWithCinderVolumes-739781099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_99960856-60ce-4010-bb81-b2471d0203e0_5yptj137devstack@QuobyteHD {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:56:12 devstack sudo[105407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_99960856-60ce-4010-bb81-b2471d0203e0_5yptj137devstack@QuobyteHD Sep 04 22:56:12 devstack sudo[105407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:56:12 devstack sudo[105407]: pam_unix(sudo:session): session closed for user root Sep 04 22:56:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-75331eb9-174c-4557-b77d-a0f2fa4921d3 tempest-TestInstancesWithCinderVolumes-739781099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_99960856-60ce-4010-bb81-b2471d0203e0_5yptj137devstack@QuobyteHD" returned: 0 in 0.321s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:56:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-75331eb9-174c-4557-b77d-a0f2fa4921d3 tempest-TestInstancesWithCinderVolumes-739781099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:56:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-75331eb9-174c-4557-b77d-a0f2fa4921d3 tempest-TestInstancesWithCinderVolumes-739781099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:56:12 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-75331eb9-174c-4557-b77d-a0f2fa4921d3 tempest-TestInstancesWithCinderVolumes-739781099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:56:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1791495393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc9459a4-91e1-441b-b847-6b6c26b49f54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f8b821db6f9493c98830849d3d16ba5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:56:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:56:09Z,use_quota=True,user_id='ed4143d329e9457e9cf0a5b51ca6b4c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c99dfc4a-1b38-4ac6-8f2c-a96b980603dc),volume_type_id=c99dfc4a-1b38-4ac6-8f2c-a96b980603dc)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:56:12 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-75331eb9-174c-4557-b77d-a0f2fa4921d3 tempest-TestInstancesWithCinderVolumes-739781099 None] Creating volume fc9459a4-91e1-441b-b847-6b6c26b49f54 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:56:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-75331eb9-174c-4557-b77d-a0f2fa4921d3 tempest-TestInstancesWithCinderVolumes-739781099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:56:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-75331eb9-174c-4557-b77d-a0f2fa4921d3 tempest-TestInstancesWithCinderVolumes-739781099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:56:12 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-75331eb9-174c-4557-b77d-a0f2fa4921d3 tempest-TestInstancesWithCinderVolumes-739781099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:56:12 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-75331eb9-174c-4557-b77d-a0f2fa4921d3 tempest-TestInstancesWithCinderVolumes-739781099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:56:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-75331eb9-174c-4557-b77d-a0f2fa4921d3 tempest-TestInstancesWithCinderVolumes-739781099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:56:12 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-75331eb9-174c-4557-b77d-a0f2fa4921d3 tempest-TestInstancesWithCinderVolumes-739781099 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:56:12 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-75331eb9-174c-4557-b77d-a0f2fa4921d3 tempest-TestInstancesWithCinderVolumes-739781099 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:56:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-75331eb9-174c-4557-b77d-a0f2fa4921d3 tempest-TestInstancesWithCinderVolumes-739781099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fc9459a4-91e1-441b-b847-6b6c26b49f54 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:56:12 devstack sudo[105412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fc9459a4-91e1-441b-b847-6b6c26b49f54 1073741824 Sep 04 22:56:12 devstack sudo[105412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:56:13 devstack sudo[105412]: pam_unix(sudo:session): session closed for user root Sep 04 22:56:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-75331eb9-174c-4557-b77d-a0f2fa4921d3 tempest-TestInstancesWithCinderVolumes-739781099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fc9459a4-91e1-441b-b847-6b6c26b49f54 1073741824" returned: 0 in 0.423s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:56:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-75331eb9-174c-4557-b77d-a0f2fa4921d3 tempest-TestInstancesWithCinderVolumes-739781099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fc9459a4-91e1-441b-b847-6b6c26b49f54 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:56:13 devstack sudo[105420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fc9459a4-91e1-441b-b847-6b6c26b49f54 Sep 04 22:56:13 devstack sudo[105420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:56:13 devstack sudo[105420]: pam_unix(sudo:session): session closed for user root Sep 04 22:56:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-75331eb9-174c-4557-b77d-a0f2fa4921d3 tempest-TestInstancesWithCinderVolumes-739781099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fc9459a4-91e1-441b-b847-6b6c26b49f54" returned: 0 in 0.242s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:56:13 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-75331eb9-174c-4557-b77d-a0f2fa4921d3 tempest-TestInstancesWithCinderVolumes-739781099 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:56:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-75331eb9-174c-4557-b77d-a0f2fa4921d3 tempest-TestInstancesWithCinderVolumes-739781099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:56:13 devstack cinder-volume[87576]: DEBUG cinder.volume.volume_utils [None req-75331eb9-174c-4557-b77d-a0f2fa4921d3 tempest-TestInstancesWithCinderVolumes-739781099 None] Attempting download of 99960856-60ce-4010-bb81-b2471d0203e0 ((None, [{'url': 'file:///opt/stack/data/glance/images/99960856-60ce-4010-bb81-b2471d0203e0', 'metadata': {}}])) to volume fc9459a4-91e1-441b-b847-6b6c26b49f54. {{(pid=87576) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 04 22:56:13 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef8be2b-0daa-4e45-8f10-ead5cd65f4fb]: (4, 'raw') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:56:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-75331eb9-174c-4557-b77d-a0f2fa4921d3 tempest-TestInstancesWithCinderVolumes-739781099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_99960856-60ce-4010-bb81-b2471d0203e0_zsz668ar {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:56:13 devstack sudo[105423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_99960856-60ce-4010-bb81-b2471d0203e0_zsz668ar Sep 04 22:56:13 devstack sudo[105423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:56:13 devstack sudo[105423]: pam_unix(sudo:session): session closed for user root Sep 04 22:56:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-75331eb9-174c-4557-b77d-a0f2fa4921d3 tempest-TestInstancesWithCinderVolumes-739781099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_99960856-60ce-4010-bb81-b2471d0203e0_zsz668ar" returned: 0 in 0.329s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:56:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-75331eb9-174c-4557-b77d-a0f2fa4921d3 tempest-TestInstancesWithCinderVolumes-739781099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_99960856-60ce-4010-bb81-b2471d0203e0_zsz668ar {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:56:14 devstack sudo[105427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_99960856-60ce-4010-bb81-b2471d0203e0_zsz668ar Sep 04 22:56:14 devstack sudo[105427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:56:14 devstack sudo[105427]: pam_unix(sudo:session): session closed for user root Sep 04 22:56:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-75331eb9-174c-4557-b77d-a0f2fa4921d3 tempest-TestInstancesWithCinderVolumes-739781099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_99960856-60ce-4010-bb81-b2471d0203e0_zsz668ar" returned: 1 in 0.341s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:56:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-75331eb9-174c-4557-b77d-a0f2fa4921d3 tempest-TestInstancesWithCinderVolumes-739781099 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_99960856-60ce-4010-bb81-b2471d0203e0_zsz668ar' failed. Not Retrying. {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 22:56:14 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2db740e-5190-431c-a489-1ebbb824ee2e]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:56:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-75331eb9-174c-4557-b77d-a0f2fa4921d3 tempest-TestInstancesWithCinderVolumes-739781099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_99960856-60ce-4010-bb81-b2471d0203e0_5yptj137devstack@QuobyteHD {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:56:14 devstack sudo[105431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_99960856-60ce-4010-bb81-b2471d0203e0_5yptj137devstack@QuobyteHD Sep 04 22:56:14 devstack sudo[105431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:56:14 devstack sudo[105431]: pam_unix(sudo:session): session closed for user root Sep 04 22:56:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-75331eb9-174c-4557-b77d-a0f2fa4921d3 tempest-TestInstancesWithCinderVolumes-739781099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_99960856-60ce-4010-bb81-b2471d0203e0_5yptj137devstack@QuobyteHD" returned: 0 in 0.346s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:56:14 devstack cinder-volume[87576]: DEBUG cinder.image.image_utils [None req-75331eb9-174c-4557-b77d-a0f2fa4921d3 tempest-TestInstancesWithCinderVolumes-739781099 None] 99960856-60ce-4010-bb81-b2471d0203e0 was qcow2, converting to qcow2 {{(pid=87576) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 04 22:56:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-75331eb9-174c-4557-b77d-a0f2fa4921d3 tempest-TestInstancesWithCinderVolumes-739781099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_99960856-60ce-4010-bb81-b2471d0203e0_5yptj137devstack@QuobyteHD /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fc9459a4-91e1-441b-b847-6b6c26b49f54 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:56:14 devstack sudo[105436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_99960856-60ce-4010-bb81-b2471d0203e0_5yptj137devstack@QuobyteHD /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fc9459a4-91e1-441b-b847-6b6c26b49f54 Sep 04 22:56:14 devstack sudo[105436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:56:16 devstack sudo[105436]: pam_unix(sudo:session): session closed for user root Sep 04 22:56:16 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-75331eb9-174c-4557-b77d-a0f2fa4921d3 tempest-TestInstancesWithCinderVolumes-739781099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_99960856-60ce-4010-bb81-b2471d0203e0_5yptj137devstack@QuobyteHD /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fc9459a4-91e1-441b-b847-6b6c26b49f54" returned: 0 in 1.550s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:56:16 devstack cinder-volume[87576]: DEBUG cinder.image.image_utils [None req-75331eb9-174c-4557-b77d-a0f2fa4921d3 tempest-TestInstancesWithCinderVolumes-739781099 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_99960856-60ce-4010-bb81-b2471d0203e0_5yptj137devstack@QuobyteHD, size 112.00 MB, duration 1.55 sec, destination /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fc9459a4-91e1-441b-b847-6b6c26b49f54 {{(pid=87576) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 22:56:16 devstack cinder-volume[87576]: INFO cinder.image.image_utils [None req-75331eb9-174c-4557-b77d-a0f2fa4921d3 tempest-TestInstancesWithCinderVolumes-739781099 None] Converted 112.00 MB image at 72.19 MB/s Sep 04 22:56:16 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-75331eb9-174c-4557-b77d-a0f2fa4921d3 tempest-TestInstancesWithCinderVolumes-739781099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fc9459a4-91e1-441b-b847-6b6c26b49f54 1G {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:56:16 devstack sudo[105445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fc9459a4-91e1-441b-b847-6b6c26b49f54 1G Sep 04 22:56:16 devstack sudo[105445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:56:16 devstack sudo[105445]: pam_unix(sudo:session): session closed for user root Sep 04 22:56:16 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-75331eb9-174c-4557-b77d-a0f2fa4921d3 tempest-TestInstancesWithCinderVolumes-739781099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fc9459a4-91e1-441b-b847-6b6c26b49f54 1G" returned: 0 in 0.312s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:56:16 devstack cinder-volume[87576]: DEBUG cinder.volume.volume_utils [None req-75331eb9-174c-4557-b77d-a0f2fa4921d3 tempest-TestInstancesWithCinderVolumes-739781099 None] Downloaded image 99960856-60ce-4010-bb81-b2471d0203e0 ((None, [{'url': 'file:///opt/stack/data/glance/images/99960856-60ce-4010-bb81-b2471d0203e0', 'metadata': {}}])) to volume fc9459a4-91e1-441b-b847-6b6c26b49f54 successfully. {{(pid=87576) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 04 22:56:16 devstack cinder-volume[87576]: DEBUG cinder.image.image_utils [None req-75331eb9-174c-4557-b77d-a0f2fa4921d3 tempest-TestInstancesWithCinderVolumes-739781099 None] Temporary image 99960856-60ce-4010-bb81-b2471d0203e0 for user ed4143d329e9457e9cf0a5b51ca6b4c1 is deleted. {{(pid=87576) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 04 22:56:16 devstack cinder-volume[87576]: DEBUG cinder.volume.volume_utils [None req-75331eb9-174c-4557-b77d-a0f2fa4921d3 tempest-TestInstancesWithCinderVolumes-739781099 None] Marking volume fc9459a4-91e1-441b-b847-6b6c26b49f54 as bootable. {{(pid=87576) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 04 22:56:16 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-75331eb9-174c-4557-b77d-a0f2fa4921d3 tempest-TestInstancesWithCinderVolumes-739781099 None] Copying metadata from image 99960856-60ce-4010-bb81-b2471d0203e0 to fc9459a4-91e1-441b-b847-6b6c26b49f54. {{(pid=87576) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 04 22:56:16 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-75331eb9-174c-4557-b77d-a0f2fa4921d3 tempest-TestInstancesWithCinderVolumes-739781099 None] Creating volume glance metadata for volume fc9459a4-91e1-441b-b847-6b6c26b49f54 backed by image 99960856-60ce-4010-bb81-b2471d0203e0 with: {'image_id': '99960856-60ce-4010-bb81-b2471d0203e0', 'image_name': 'tempest-scenario-img--989924214', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87576) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 04 22:56:16 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-75331eb9-174c-4557-b77d-a0f2fa4921d3 tempest-TestInstancesWithCinderVolumes-739781099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67195f6a-c15a-4e38-93d9-7e5520f00ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc9459a4-91e1-441b-b847-6b6c26b49f54', 'volume_size': 1, 'image_id': '99960856-60ce-4010-bb81-b2471d0203e0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/99960856-60ce-4010-bb81-b2471d0203e0', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--989924214', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1f8b821db6f9493c98830849d3d16ba5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '99960856-60ce-4010-bb81-b2471d0203e0', 'created_at': datetime.datetime(2026, 9, 4, 20, 56, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 20, 56, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/99960856-60ce-4010-bb81-b2471d0203e0/file', 'properties': {}}, 'image_service': }' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:56:16 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-75331eb9-174c-4557-b77d-a0f2fa4921d3 tempest-TestInstancesWithCinderVolumes-739781099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a43f4255-73a9-4578-b00a-9df0fc557349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:56:16 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-75331eb9-174c-4557-b77d-a0f2fa4921d3 tempest-TestInstancesWithCinderVolumes-739781099 None] Volume volume-fc9459a4-91e1-441b-b847-6b6c26b49f54 (fc9459a4-91e1-441b-b847-6b6c26b49f54): created successfully Sep 04 22:56:16 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-75331eb9-174c-4557-b77d-a0f2fa4921d3 tempest-TestInstancesWithCinderVolumes-739781099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a43f4255-73a9-4578-b00a-9df0fc557349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:56:16 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-75331eb9-174c-4557-b77d-a0f2fa4921d3 tempest-TestInstancesWithCinderVolumes-739781099 None] Flow 'volume_create_manager' (113ae412-7ac0-41a2-a624-b524b9705e0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:56:16 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-75331eb9-174c-4557-b77d-a0f2fa4921d3 tempest-TestInstancesWithCinderVolumes-739781099 None] Created volume successfully. Sep 04 22:56:19 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-78e63d95-2fa2-4629-8419-82e34962bfa4 req-e6bfd9dd-8e72-4349-a8fa-99c0bb8a709b tempest-TestInstancesWithCinderVolumes-739781099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:56:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-78e63d95-2fa2-4629-8419-82e34962bfa4 req-e6bfd9dd-8e72-4349-a8fa-99c0bb8a709b tempest-TestInstancesWithCinderVolumes-739781099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:56:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-78e63d95-2fa2-4629-8419-82e34962bfa4 req-e6bfd9dd-8e72-4349-a8fa-99c0bb8a709b tempest-TestInstancesWithCinderVolumes-739781099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:56:20 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-78e63d95-2fa2-4629-8419-82e34962bfa4 req-e6bfd9dd-8e72-4349-a8fa-99c0bb8a709b tempest-TestInstancesWithCinderVolumes-739781099 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4', 'name': 'volume-fc9459a4-91e1-441b-b847-6b6c26b49f54', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8aef4aff-fd9e-4ffb-b43f-f01c63ee712c', 'enforce_multipath': True} {{(pid=87576) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 22:56:20 devstack cinder-volume[87576]: INFO cinder.volume.manager [req-78e63d95-2fa2-4629-8419-82e34962bfa4 req-e6bfd9dd-8e72-4349-a8fa-99c0bb8a709b tempest-TestInstancesWithCinderVolumes-739781099 None] attachment_update completed successfully. Sep 04 22:56:30 devstack cinder-volume[87576]: DEBUG dbcounter [-] [87576] Writing DB stats cinder:UPDATE=16,cinder:SELECT=17,cinder:DELETE=2,cinder:INSERT=2 {{(pid=87576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 22:56:30 devstack cinder-volume[87576]: DEBUG dbcounter [-] [87576] Writing DB stats cinder:SELECT=19,cinder:UPDATE=8,cinder:INSERT=10,cinder:DELETE=1 {{(pid=87576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 22:56:50 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-07aa3de6-4720-41d5-a6ee-8354082ad61a req-91e03b55-cf4c-4180-b933-98936a5b3c14 tempest-TestInstancesWithCinderVolumes-739781099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:56:50 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-07aa3de6-4720-41d5-a6ee-8354082ad61a req-91e03b55-cf4c-4180-b933-98936a5b3c14 tempest-TestInstancesWithCinderVolumes-739781099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:56:50 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-07aa3de6-4720-41d5-a6ee-8354082ad61a req-91e03b55-cf4c-4180-b933-98936a5b3c14 tempest-TestInstancesWithCinderVolumes-739781099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:56:50 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-07aa3de6-4720-41d5-a6ee-8354082ad61a req-91e03b55-cf4c-4180-b933-98936a5b3c14 tempest-TestInstancesWithCinderVolumes-739781099 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4', 'name': 'volume-468f01c3-02b5-4456-889d-3e0ad32087ca', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5284a1c3-2462-4193-987d-2cf143063af4', 'enforce_multipath': True} {{(pid=87576) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 22:56:50 devstack cinder-volume[87576]: INFO cinder.volume.manager [req-07aa3de6-4720-41d5-a6ee-8354082ad61a req-91e03b55-cf4c-4180-b933-98936a5b3c14 tempest-TestInstancesWithCinderVolumes-739781099 None] attachment_update completed successfully. Sep 04 22:56:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-e39a5c17-d888-438c-949a-181e05f6215a req-2fa81992-aafe-4fa6-8b64-3929f74bb91b tempest-TestInstancesWithCinderVolumes-739781099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:56:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-e39a5c17-d888-438c-949a-181e05f6215a req-2fa81992-aafe-4fa6-8b64-3929f74bb91b tempest-TestInstancesWithCinderVolumes-739781099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:56:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [req-e39a5c17-d888-438c-949a-181e05f6215a req-2fa81992-aafe-4fa6-8b64-3929f74bb91b tempest-TestInstancesWithCinderVolumes-739781099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:56:52 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-e39a5c17-d888-438c-949a-181e05f6215a req-2fa81992-aafe-4fa6-8b64-3929f74bb91b tempest-TestInstancesWithCinderVolumes-739781099 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4', 'name': 'volume-e53b1bc8-3d71-4824-bb70-36f87c21d5b9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '58e2fb0a-f2c0-4a42-ac35-d79387632cb9', 'enforce_multipath': True} {{(pid=87576) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 22:56:52 devstack cinder-volume[87576]: INFO cinder.volume.manager [req-e39a5c17-d888-438c-949a-181e05f6215a req-2fa81992-aafe-4fa6-8b64-3929f74bb91b tempest-TestInstancesWithCinderVolumes-739781099 None] attachment_update completed successfully. Sep 04 22:56:56 devstack cinder-volume[87576]: INFO cinder.volume.manager [req-4e0e8002-8877-40fe-81bf-02de942f189e req-db8b7470-a36f-4e27-8e0d-7cfb1c1523a4 tempest-TestInstancesWithCinderVolumes-739781099 None] Terminate volume connection completed successfully. Sep 04 22:56:56 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-4e0e8002-8877-40fe-81bf-02de942f189e req-db8b7470-a36f-4e27-8e0d-7cfb1c1523a4 tempest-TestInstancesWithCinderVolumes-739781099 None] Deleting attachment 5284a1c3-2462-4193-987d-2cf143063af4. {{(pid=87576) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 22:56:57 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-0d52e115-d3b9-4d3d-b65f-ff5b73ad07f4 tempest-TestInstancesWithCinderVolumes-739781099 None] Acquiring lock "cinder-468f01c3-02b5-4456-889d-3e0ad32087ca-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:56:57 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-0d52e115-d3b9-4d3d-b65f-ff5b73ad07f4 tempest-TestInstancesWithCinderVolumes-739781099 None] Lock "cinder-468f01c3-02b5-4456-889d-3e0ad32087ca-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:56:57 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-0d52e115-d3b9-4d3d-b65f-ff5b73ad07f4 tempest-TestInstancesWithCinderVolumes-739781099 None] Acquiring lock "cinder-quobyte-468f01c3-02b5-4456-889d-3e0ad32087ca" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:56:57 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-0d52e115-d3b9-4d3d-b65f-ff5b73ad07f4 tempest-TestInstancesWithCinderVolumes-739781099 None] Lock "cinder-quobyte-468f01c3-02b5-4456-889d-3e0ad32087ca" acquired by "delete_volume" :: waited 0.012s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:56:57 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[deaa280a-3a04-43f8-8de9-caa891db96ac]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:56:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0d52e115-d3b9-4d3d-b65f-ff5b73ad07f4 tempest-TestInstancesWithCinderVolumes-739781099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-468f01c3-02b5-4456-889d-3e0ad32087ca {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:56:57 devstack sudo[106073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-468f01c3-02b5-4456-889d-3e0ad32087ca Sep 04 22:56:57 devstack sudo[106073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:56:57 devstack sudo[106073]: pam_unix(sudo:session): session closed for user root Sep 04 22:56:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0d52e115-d3b9-4d3d-b65f-ff5b73ad07f4 tempest-TestInstancesWithCinderVolumes-739781099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-468f01c3-02b5-4456-889d-3e0ad32087ca" returned: 0 in 0.368s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:56:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0d52e115-d3b9-4d3d-b65f-ff5b73ad07f4 tempest-TestInstancesWithCinderVolumes-739781099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-468f01c3-02b5-4456-889d-3e0ad32087ca {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:56:57 devstack sudo[106080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-468f01c3-02b5-4456-889d-3e0ad32087ca Sep 04 22:56:57 devstack sudo[106080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:56:58 devstack sudo[106080]: pam_unix(sudo:session): session closed for user root Sep 04 22:56:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0d52e115-d3b9-4d3d-b65f-ff5b73ad07f4 tempest-TestInstancesWithCinderVolumes-739781099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-468f01c3-02b5-4456-889d-3e0ad32087ca" returned: 0 in 0.269s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:56:58 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-0d52e115-d3b9-4d3d-b65f-ff5b73ad07f4 tempest-TestInstancesWithCinderVolumes-739781099 None] Lock "cinder-quobyte-468f01c3-02b5-4456-889d-3e0ad32087ca" released by "delete_volume" :: held 0.677s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:56:58 devstack cinder-volume[87576]: WARNING cinder.quota [None req-0d52e115-d3b9-4d3d-b65f-ff5b73ad07f4 tempest-TestInstancesWithCinderVolumes-739781099 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1832030653-85690009 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1832030653-85690009, it is now deprecated. Please use the default quota class for default quota. Sep 04 22:56:58 devstack cinder-volume[87576]: WARNING cinder.quota [None req-0d52e115-d3b9-4d3d-b65f-ff5b73ad07f4 tempest-TestInstancesWithCinderVolumes-739781099 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1832030653-85690009 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1832030653-85690009, it is now deprecated. Please use the default quota class for default quota. Sep 04 22:56:58 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-0d52e115-d3b9-4d3d-b65f-ff5b73ad07f4 tempest-TestInstancesWithCinderVolumes-739781099 None] Created reservations ['b774fd38-e46a-4d06-a6bb-d7bae56c8f6c', '10bad356-13a2-42ba-8c3c-7f825ee79255', 'c5907eb2-e662-4469-8ff1-c52f14ac6617', 'ba0eadbe-2702-4111-863c-dacc54420f61'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:56:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-0d52e115-d3b9-4d3d-b65f-ff5b73ad07f4 tempest-TestInstancesWithCinderVolumes-739781099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:56:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-0d52e115-d3b9-4d3d-b65f-ff5b73ad07f4 tempest-TestInstancesWithCinderVolumes-739781099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:56:58 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-0d52e115-d3b9-4d3d-b65f-ff5b73ad07f4 tempest-TestInstancesWithCinderVolumes-739781099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:56:58 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-0d52e115-d3b9-4d3d-b65f-ff5b73ad07f4 tempest-TestInstancesWithCinderVolumes-739781099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:56:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-0d52e115-d3b9-4d3d-b65f-ff5b73ad07f4 tempest-TestInstancesWithCinderVolumes-739781099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:56:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0d52e115-d3b9-4d3d-b65f-ff5b73ad07f4 tempest-TestInstancesWithCinderVolumes-739781099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:56:58 devstack sudo[106083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:56:58 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:56:58 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root Sep 04 22:56:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0d52e115-d3b9-4d3d-b65f-ff5b73ad07f4 tempest-TestInstancesWithCinderVolumes-739781099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.277s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:56:58 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-0d52e115-d3b9-4d3d-b65f-ff5b73ad07f4 tempest-TestInstancesWithCinderVolumes-739781099 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:56:58 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-0d52e115-d3b9-4d3d-b65f-ff5b73ad07f4 tempest-TestInstancesWithCinderVolumes-739781099 None] Deleted volume successfully. Sep 04 22:56:58 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-0d52e115-d3b9-4d3d-b65f-ff5b73ad07f4 tempest-TestInstancesWithCinderVolumes-739781099 None] Lock "cinder-468f01c3-02b5-4456-889d-3e0ad32087ca-delete_volume" released by "delete_volume" :: held 1.163s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:57:00 devstack cinder-volume[87576]: INFO cinder.volume.manager [req-c9c2e06d-de13-45aa-a6ee-ca4b96065caa req-6b06ffa6-46c0-4bba-8df6-523fc9942c0d tempest-TestInstancesWithCinderVolumes-739781099 None] Terminate volume connection completed successfully. Sep 04 22:57:00 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-c9c2e06d-de13-45aa-a6ee-ca4b96065caa req-6b06ffa6-46c0-4bba-8df6-523fc9942c0d tempest-TestInstancesWithCinderVolumes-739781099 None] Deleting attachment 58e2fb0a-f2c0-4a42-ac35-d79387632cb9. {{(pid=87576) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 22:57:01 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-67ab5451-ed5f-41a0-bb54-2e59251adf55 tempest-TestInstancesWithCinderVolumes-739781099 None] Acquiring lock "cinder-e53b1bc8-3d71-4824-bb70-36f87c21d5b9-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:57:01 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-67ab5451-ed5f-41a0-bb54-2e59251adf55 tempest-TestInstancesWithCinderVolumes-739781099 None] Lock "cinder-e53b1bc8-3d71-4824-bb70-36f87c21d5b9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:57:01 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-67ab5451-ed5f-41a0-bb54-2e59251adf55 tempest-TestInstancesWithCinderVolumes-739781099 None] Acquiring lock "cinder-quobyte-e53b1bc8-3d71-4824-bb70-36f87c21d5b9" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:57:01 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-67ab5451-ed5f-41a0-bb54-2e59251adf55 tempest-TestInstancesWithCinderVolumes-739781099 None] Lock "cinder-quobyte-e53b1bc8-3d71-4824-bb70-36f87c21d5b9" acquired by "delete_volume" :: waited 0.015s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:57:01 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a2eb34-87b7-4665-90a9-f1a28bf30b72]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:57:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-67ab5451-ed5f-41a0-bb54-2e59251adf55 tempest-TestInstancesWithCinderVolumes-739781099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e53b1bc8-3d71-4824-bb70-36f87c21d5b9 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:57:01 devstack sudo[106108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e53b1bc8-3d71-4824-bb70-36f87c21d5b9 Sep 04 22:57:01 devstack sudo[106108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:57:01 devstack sudo[106108]: pam_unix(sudo:session): session closed for user root Sep 04 22:57:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-67ab5451-ed5f-41a0-bb54-2e59251adf55 tempest-TestInstancesWithCinderVolumes-739781099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e53b1bc8-3d71-4824-bb70-36f87c21d5b9" returned: 0 in 0.383s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:57:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-67ab5451-ed5f-41a0-bb54-2e59251adf55 tempest-TestInstancesWithCinderVolumes-739781099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e53b1bc8-3d71-4824-bb70-36f87c21d5b9 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:57:01 devstack sudo[106113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e53b1bc8-3d71-4824-bb70-36f87c21d5b9 Sep 04 22:57:01 devstack sudo[106113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:57:02 devstack sudo[106113]: pam_unix(sudo:session): session closed for user root Sep 04 22:57:02 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-67ab5451-ed5f-41a0-bb54-2e59251adf55 tempest-TestInstancesWithCinderVolumes-739781099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e53b1bc8-3d71-4824-bb70-36f87c21d5b9" returned: 0 in 0.265s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:57:02 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-67ab5451-ed5f-41a0-bb54-2e59251adf55 tempest-TestInstancesWithCinderVolumes-739781099 None] Lock "cinder-quobyte-e53b1bc8-3d71-4824-bb70-36f87c21d5b9" released by "delete_volume" :: held 0.699s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:57:02 devstack cinder-volume[87576]: WARNING cinder.quota [None req-67ab5451-ed5f-41a0-bb54-2e59251adf55 tempest-TestInstancesWithCinderVolumes-739781099 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1046433818-1609344134 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1046433818-1609344134, it is now deprecated. Please use the default quota class for default quota. Sep 04 22:57:02 devstack cinder-volume[87576]: WARNING cinder.quota [None req-67ab5451-ed5f-41a0-bb54-2e59251adf55 tempest-TestInstancesWithCinderVolumes-739781099 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1046433818-1609344134 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1046433818-1609344134, it is now deprecated. Please use the default quota class for default quota. Sep 04 22:57:02 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-67ab5451-ed5f-41a0-bb54-2e59251adf55 tempest-TestInstancesWithCinderVolumes-739781099 None] Created reservations ['1f1c2983-764b-43c8-a105-9d3f4cb3843a', '15b7e0e9-1600-4764-8a7c-36fa934912c1', 'b7fa9017-1a6f-4b09-915c-5c6f18108cb2', 'd3f251b3-90a3-4306-a2a3-d15701f07217'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:57:02 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-67ab5451-ed5f-41a0-bb54-2e59251adf55 tempest-TestInstancesWithCinderVolumes-739781099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:57:02 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-67ab5451-ed5f-41a0-bb54-2e59251adf55 tempest-TestInstancesWithCinderVolumes-739781099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:57:02 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-67ab5451-ed5f-41a0-bb54-2e59251adf55 tempest-TestInstancesWithCinderVolumes-739781099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:57:02 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-67ab5451-ed5f-41a0-bb54-2e59251adf55 tempest-TestInstancesWithCinderVolumes-739781099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:57:02 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-67ab5451-ed5f-41a0-bb54-2e59251adf55 tempest-TestInstancesWithCinderVolumes-739781099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:57:02 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-67ab5451-ed5f-41a0-bb54-2e59251adf55 tempest-TestInstancesWithCinderVolumes-739781099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:57:02 devstack sudo[106117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:57:02 devstack sudo[106117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:57:02 devstack sudo[106117]: pam_unix(sudo:session): session closed for user root Sep 04 22:57:02 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-67ab5451-ed5f-41a0-bb54-2e59251adf55 tempest-TestInstancesWithCinderVolumes-739781099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.249s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:57:02 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-67ab5451-ed5f-41a0-bb54-2e59251adf55 tempest-TestInstancesWithCinderVolumes-739781099 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:57:02 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-67ab5451-ed5f-41a0-bb54-2e59251adf55 tempest-TestInstancesWithCinderVolumes-739781099 None] Deleted volume successfully. Sep 04 22:57:02 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-67ab5451-ed5f-41a0-bb54-2e59251adf55 tempest-TestInstancesWithCinderVolumes-739781099 None] Lock "cinder-e53b1bc8-3d71-4824-bb70-36f87c21d5b9-delete_volume" released by "delete_volume" :: held 1.198s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:57:05 devstack cinder-volume[87576]: INFO cinder.volume.manager [req-8bcf4d59-3cc7-43e5-b4af-e335d8a08e18 req-2d550a24-ee73-45f9-a6cc-50b21bf01b6e tempest-TestInstancesWithCinderVolumes-739781099 None] Terminate volume connection completed successfully. Sep 04 22:57:05 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [req-8bcf4d59-3cc7-43e5-b4af-e335d8a08e18 req-2d550a24-ee73-45f9-a6cc-50b21bf01b6e tempest-TestInstancesWithCinderVolumes-739781099 None] Deleting attachment 8aef4aff-fd9e-4ffb-b43f-f01c63ee712c. {{(pid=87576) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 22:57:06 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-b1055e44-8704-42cc-b402-6efd75fe3c28 tempest-TestInstancesWithCinderVolumes-739781099 None] Acquiring lock "cinder-fc9459a4-91e1-441b-b847-6b6c26b49f54-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:57:06 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-b1055e44-8704-42cc-b402-6efd75fe3c28 tempest-TestInstancesWithCinderVolumes-739781099 None] Lock "cinder-fc9459a4-91e1-441b-b847-6b6c26b49f54-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:57:06 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-b1055e44-8704-42cc-b402-6efd75fe3c28 tempest-TestInstancesWithCinderVolumes-739781099 None] Acquiring lock "cinder-quobyte-fc9459a4-91e1-441b-b847-6b6c26b49f54" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:57:06 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-b1055e44-8704-42cc-b402-6efd75fe3c28 tempest-TestInstancesWithCinderVolumes-739781099 None] Lock "cinder-quobyte-fc9459a4-91e1-441b-b847-6b6c26b49f54" acquired by "delete_volume" :: waited 0.015s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:57:06 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc905c8-6da9-40cb-9ef7-0865726f8df2]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:57:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b1055e44-8704-42cc-b402-6efd75fe3c28 tempest-TestInstancesWithCinderVolumes-739781099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fc9459a4-91e1-441b-b847-6b6c26b49f54 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:57:06 devstack sudo[106152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fc9459a4-91e1-441b-b847-6b6c26b49f54 Sep 04 22:57:06 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:57:06 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root Sep 04 22:57:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b1055e44-8704-42cc-b402-6efd75fe3c28 tempest-TestInstancesWithCinderVolumes-739781099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fc9459a4-91e1-441b-b847-6b6c26b49f54" returned: 0 in 0.349s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:57:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b1055e44-8704-42cc-b402-6efd75fe3c28 tempest-TestInstancesWithCinderVolumes-739781099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fc9459a4-91e1-441b-b847-6b6c26b49f54 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:57:06 devstack sudo[106157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fc9459a4-91e1-441b-b847-6b6c26b49f54 Sep 04 22:57:06 devstack sudo[106157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:57:07 devstack sudo[106157]: pam_unix(sudo:session): session closed for user root Sep 04 22:57:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b1055e44-8704-42cc-b402-6efd75fe3c28 tempest-TestInstancesWithCinderVolumes-739781099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-fc9459a4-91e1-441b-b847-6b6c26b49f54" returned: 0 in 0.243s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:57:07 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-b1055e44-8704-42cc-b402-6efd75fe3c28 tempest-TestInstancesWithCinderVolumes-739781099 None] Lock "cinder-quobyte-fc9459a4-91e1-441b-b847-6b6c26b49f54" released by "delete_volume" :: held 0.634s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:57:07 devstack cinder-volume[87576]: WARNING cinder.quota [None req-b1055e44-8704-42cc-b402-6efd75fe3c28 tempest-TestInstancesWithCinderVolumes-739781099 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-658082550-1792442908 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-658082550-1792442908, it is now deprecated. Please use the default quota class for default quota. Sep 04 22:57:07 devstack cinder-volume[87576]: WARNING cinder.quota [None req-b1055e44-8704-42cc-b402-6efd75fe3c28 tempest-TestInstancesWithCinderVolumes-739781099 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-658082550-1792442908 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-658082550-1792442908, it is now deprecated. Please use the default quota class for default quota. Sep 04 22:57:07 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-b1055e44-8704-42cc-b402-6efd75fe3c28 tempest-TestInstancesWithCinderVolumes-739781099 None] Created reservations ['ea816ff1-961b-4276-8d2c-16a5ec829dc0', '2bd947e9-b56e-4f4e-8656-205ed3f02920', '376e20b1-9c7f-41db-9141-a76a46962bca', '6dea1394-b80c-441a-a83e-4eb6ab83e20b'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:57:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-b1055e44-8704-42cc-b402-6efd75fe3c28 tempest-TestInstancesWithCinderVolumes-739781099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:57:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-b1055e44-8704-42cc-b402-6efd75fe3c28 tempest-TestInstancesWithCinderVolumes-739781099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:57:07 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-b1055e44-8704-42cc-b402-6efd75fe3c28 tempest-TestInstancesWithCinderVolumes-739781099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:57:07 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-b1055e44-8704-42cc-b402-6efd75fe3c28 tempest-TestInstancesWithCinderVolumes-739781099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:57:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-b1055e44-8704-42cc-b402-6efd75fe3c28 tempest-TestInstancesWithCinderVolumes-739781099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:57:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b1055e44-8704-42cc-b402-6efd75fe3c28 tempest-TestInstancesWithCinderVolumes-739781099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:57:07 devstack sudo[106160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:57:07 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:57:07 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root Sep 04 22:57:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b1055e44-8704-42cc-b402-6efd75fe3c28 tempest-TestInstancesWithCinderVolumes-739781099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.243s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:57:07 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-b1055e44-8704-42cc-b402-6efd75fe3c28 tempest-TestInstancesWithCinderVolumes-739781099 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:57:07 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-b1055e44-8704-42cc-b402-6efd75fe3c28 tempest-TestInstancesWithCinderVolumes-739781099 None] Deleted volume successfully. Sep 04 22:57:07 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-b1055e44-8704-42cc-b402-6efd75fe3c28 tempest-TestInstancesWithCinderVolumes-739781099 None] Lock "cinder-fc9459a4-91e1-441b-b847-6b6c26b49f54-delete_volume" released by "delete_volume" :: held 1.064s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:57:11 devstack cinder-volume[87576]: DEBUG oslo_service.periodic_task [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87576) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 22:57:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:57:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:57:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:57:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:57:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:57:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:57:11 devstack sudo[106165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:57:11 devstack sudo[106165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:57:12 devstack sudo[106165]: pam_unix(sudo:session): session closed for user root Sep 04 22:57:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.244s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:57:12 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:57:12 devstack cinder-volume[87576]: DEBUG oslo_service.periodic_task [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Running periodic task VolumeManager._thread_info {{(pid=87576) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 22:57:12 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] thread count: 28 {{(pid=87576) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 22:57:12 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] thread info: [<_MainThread(MainThread, started 125730416963712)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87576) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 22:57:17 devstack cinder-volume[87576]: DEBUG dbcounter [-] [87576] Writing DB stats cinder:SELECT=30,cinder:UPDATE=27,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 22:57:17 devstack cinder-volume[87576]: DEBUG dbcounter [-] [87576] Writing DB stats cinder:SELECT=32,cinder:UPDATE=27,cinder:INSERT=8,cinder:DELETE=2 {{(pid=87576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 22:57:21 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:57:21 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Flow 'volume_create_manager' (73e01628-f97d-4003-9155-7c1968bc839f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:57:21 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37627716-78bc-4d50-bc5d-dd8245865740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:57:21 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37627716-78bc-4d50-bc5d-dd8245865740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:57:21Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c930fe4-1c42-41f2-a66d-2f1e0c28b58e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3873fbdf86ac4d8fa47496805f5fd851',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:57:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:57:21Z,use_quota=True,user_id='5c52fdecff10443e9de820698a75325e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d78d71e7-3f71-45a7-9885-37172ca23d16),volume_type_id=d78d71e7-3f71-45a7-9885-37172ca23d16)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:57:21 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc140ef1-4f88-4e11-8f77-dfa6048b7b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:57:21 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc140ef1-4f88-4e11-8f77-dfa6048b7b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:57:21 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9959a4ff-360e-4541-8e46-4e2ea80a4bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:57:21 devstack cinder-volume[87576]: DEBUG cinder.image.glance [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Creating Keystone auth plugin from conf {{(pid=87576) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 04 22:57:21 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9959a4ff-360e-4541-8e46-4e2ea80a4bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7c930fe4-1c42-41f2-a66d-2f1e0c28b58e', 'volume_name': 'volume-7c930fe4-1c42-41f2-a66d-2f1e0c28b58e', 'volume_size': 1, 'image_id': '93c09877-96f2-49bd-a9be-98e163172c74', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/93c09877-96f2-49bd-a9be-98e163172c74', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a790cd024dd9afb7234ba1314a7bc055', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3873fbdf86ac4d8fa47496805f5fd851', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '54d956c386cf1eacaefcd7dd7685ef6a543d0f4984c9e1e54813b2af9ead7f77a7c3e7015424ea98318bc041477c44f3b63eea9ff3f955ed88d6ed9d24504b7e', 'id': '93c09877-96f2-49bd-a9be-98e163172c74', 'created_at': datetime.datetime(2026, 9, 4, 20, 57, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 20, 57, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/93c09877-96f2-49bd-a9be-98e163172c74/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:57:21 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff05f4d8-e597-49ef-b6a6-b4e5566fca2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:57:21 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff05f4d8-e597-49ef-b6a6-b4e5566fca2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:57:21 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d32e7e0-f0cd-4c60-bfb6-db74ff043625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:57:21 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Volume 7c930fe4-1c42-41f2-a66d-2f1e0c28b58e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7c930fe4-1c42-41f2-a66d-2f1e0c28b58e', 'volume_size': 1, 'image_id': '93c09877-96f2-49bd-a9be-98e163172c74', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/93c09877-96f2-49bd-a9be-98e163172c74', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a790cd024dd9afb7234ba1314a7bc055', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3873fbdf86ac4d8fa47496805f5fd851', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '54d956c386cf1eacaefcd7dd7685ef6a543d0f4984c9e1e54813b2af9ead7f77a7c3e7015424ea98318bc041477c44f3b63eea9ff3f955ed88d6ed9d24504b7e', 'id': '93c09877-96f2-49bd-a9be-98e163172c74', 'created_at': datetime.datetime(2026, 9, 4, 20, 57, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 20, 57, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/93c09877-96f2-49bd-a9be-98e163172c74/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 04 22:57:21 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Trying to clone 7c930fe4-1c42-41f2-a66d-2f1e0c28b58e from image 93c09877-96f2-49bd-a9be-98e163172c74 at location (None, [{'url': 'file:///opt/stack/data/glance/images/93c09877-96f2-49bd-a9be-98e163172c74', 'metadata': {}}]). {{(pid=87576) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 04 22:57:21 devstack cinder-volume[87576]: DEBUG cinder.image.image_utils [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_93c09877-96f2-49bd-a9be-98e163172c74_istjiknidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87576) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 04 22:57:21 devstack cinder-volume[87576]: INFO cinder.image.image_utils [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Image download 0.00 MB at 0.00 MB/s Sep 04 22:57:21 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b5e4f7-9c05-4306-9b1b-95e12828ab9b]: (4, 'raw') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:57:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_93c09877-96f2-49bd-a9be-98e163172c74_istjiknidevstack@QuobyteHD {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:57:21 devstack sudo[106172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_93c09877-96f2-49bd-a9be-98e163172c74_istjiknidevstack@QuobyteHD Sep 04 22:57:21 devstack sudo[106172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:57:22 devstack sudo[106172]: pam_unix(sudo:session): session closed for user root Sep 04 22:57:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_93c09877-96f2-49bd-a9be-98e163172c74_istjiknidevstack@QuobyteHD" returned: 0 in 0.323s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:57:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_93c09877-96f2-49bd-a9be-98e163172c74_istjiknidevstack@QuobyteHD {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:57:22 devstack sudo[106176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_93c09877-96f2-49bd-a9be-98e163172c74_istjiknidevstack@QuobyteHD Sep 04 22:57:22 devstack sudo[106176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:57:22 devstack sudo[106176]: pam_unix(sudo:session): session closed for user root Sep 04 22:57:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_93c09877-96f2-49bd-a9be-98e163172c74_istjiknidevstack@QuobyteHD" returned: 1 in 0.322s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:57:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_93c09877-96f2-49bd-a9be-98e163172c74_istjiknidevstack@QuobyteHD' failed. Not Retrying. {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 22:57:22 devstack cinder-volume[87576]: DEBUG cinder.image.image_utils [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Temporary image 93c09877-96f2-49bd-a9be-98e163172c74 is fetched for user 5c52fdecff10443e9de820698a75325e. {{(pid=87576) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 04 22:57:22 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc61d489-a01f-40fb-839c-b284bde9e072]: (4, 'raw') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:57:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_93c09877-96f2-49bd-a9be-98e163172c74_istjiknidevstack@QuobyteHD {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:57:22 devstack sudo[106181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_93c09877-96f2-49bd-a9be-98e163172c74_istjiknidevstack@QuobyteHD Sep 04 22:57:22 devstack sudo[106181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:57:22 devstack sudo[106181]: pam_unix(sudo:session): session closed for user root Sep 04 22:57:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_93c09877-96f2-49bd-a9be-98e163172c74_istjiknidevstack@QuobyteHD" returned: 0 in 0.308s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:57:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_93c09877-96f2-49bd-a9be-98e163172c74_istjiknidevstack@QuobyteHD {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:57:23 devstack sudo[106185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_93c09877-96f2-49bd-a9be-98e163172c74_istjiknidevstack@QuobyteHD Sep 04 22:57:23 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:57:23 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root Sep 04 22:57:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_93c09877-96f2-49bd-a9be-98e163172c74_istjiknidevstack@QuobyteHD" returned: 1 in 0.315s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:57:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_93c09877-96f2-49bd-a9be-98e163172c74_istjiknidevstack@QuobyteHD' failed. Not Retrying. {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 22:57:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:57:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:57:23 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:57:21Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c930fe4-1c42-41f2-a66d-2f1e0c28b58e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3873fbdf86ac4d8fa47496805f5fd851',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:57:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:57:21Z,use_quota=True,user_id='5c52fdecff10443e9de820698a75325e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d78d71e7-3f71-45a7-9885-37172ca23d16),volume_type_id=d78d71e7-3f71-45a7-9885-37172ca23d16)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:57:23 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Creating volume 7c930fe4-1c42-41f2-a66d-2f1e0c28b58e {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:57:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:57:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:57:23 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:57:23 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:57:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:57:23 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:57:23 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:57:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7c930fe4-1c42-41f2-a66d-2f1e0c28b58e 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:57:23 devstack sudo[106191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7c930fe4-1c42-41f2-a66d-2f1e0c28b58e 1073741824 Sep 04 22:57:23 devstack sudo[106191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:57:23 devstack sudo[106191]: pam_unix(sudo:session): session closed for user root Sep 04 22:57:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7c930fe4-1c42-41f2-a66d-2f1e0c28b58e 1073741824" returned: 0 in 0.399s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:57:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7c930fe4-1c42-41f2-a66d-2f1e0c28b58e {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:57:23 devstack sudo[106196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7c930fe4-1c42-41f2-a66d-2f1e0c28b58e Sep 04 22:57:23 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:57:23 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root Sep 04 22:57:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7c930fe4-1c42-41f2-a66d-2f1e0c28b58e" returned: 0 in 0.231s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:57:23 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] <== create_volume: return (670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:57:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.673s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:57:23 devstack cinder-volume[87576]: DEBUG cinder.volume.volume_utils [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Attempting download of 93c09877-96f2-49bd-a9be-98e163172c74 ((None, [{'url': 'file:///opt/stack/data/glance/images/93c09877-96f2-49bd-a9be-98e163172c74', 'metadata': {}}])) to volume 7c930fe4-1c42-41f2-a66d-2f1e0c28b58e. {{(pid=87576) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 04 22:57:23 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[2247dbcd-57b0-4122-9ce7-98870de1b801]: (4, 'raw') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:57:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_93c09877-96f2-49bd-a9be-98e163172c74__rbqi_sp {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:57:24 devstack sudo[106199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_93c09877-96f2-49bd-a9be-98e163172c74__rbqi_sp Sep 04 22:57:24 devstack sudo[106199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:57:24 devstack sudo[106199]: pam_unix(sudo:session): session closed for user root Sep 04 22:57:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_93c09877-96f2-49bd-a9be-98e163172c74__rbqi_sp" returned: 0 in 0.319s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:57:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_93c09877-96f2-49bd-a9be-98e163172c74__rbqi_sp {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:57:24 devstack sudo[106203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_93c09877-96f2-49bd-a9be-98e163172c74__rbqi_sp Sep 04 22:57:24 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:57:24 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root Sep 04 22:57:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_93c09877-96f2-49bd-a9be-98e163172c74__rbqi_sp" returned: 1 in 0.309s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:57:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_93c09877-96f2-49bd-a9be-98e163172c74__rbqi_sp' failed. Not Retrying. {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 22:57:24 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[962232b5-b363-416f-9d94-0b38b366169f]: (4, 'raw') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:57:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_93c09877-96f2-49bd-a9be-98e163172c74_istjiknidevstack@QuobyteHD {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:57:24 devstack sudo[106207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_93c09877-96f2-49bd-a9be-98e163172c74_istjiknidevstack@QuobyteHD Sep 04 22:57:24 devstack sudo[106207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:57:24 devstack sudo[106207]: pam_unix(sudo:session): session closed for user root Sep 04 22:57:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_93c09877-96f2-49bd-a9be-98e163172c74_istjiknidevstack@QuobyteHD" returned: 0 in 0.305s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:57:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_93c09877-96f2-49bd-a9be-98e163172c74_istjiknidevstack@QuobyteHD {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:57:25 devstack sudo[106211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_93c09877-96f2-49bd-a9be-98e163172c74_istjiknidevstack@QuobyteHD Sep 04 22:57:25 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:57:25 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root Sep 04 22:57:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_93c09877-96f2-49bd-a9be-98e163172c74_istjiknidevstack@QuobyteHD" returned: 1 in 0.321s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:57:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_93c09877-96f2-49bd-a9be-98e163172c74_istjiknidevstack@QuobyteHD' failed. Not Retrying. {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 22:57:25 devstack cinder-volume[87576]: DEBUG cinder.image.image_utils [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] 93c09877-96f2-49bd-a9be-98e163172c74 was raw, converting to qcow2 {{(pid=87576) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 04 22:57:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_93c09877-96f2-49bd-a9be-98e163172c74_istjiknidevstack@QuobyteHD /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7c930fe4-1c42-41f2-a66d-2f1e0c28b58e {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:57:25 devstack sudo[106216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_93c09877-96f2-49bd-a9be-98e163172c74_istjiknidevstack@QuobyteHD /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7c930fe4-1c42-41f2-a66d-2f1e0c28b58e Sep 04 22:57:25 devstack sudo[106216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:57:25 devstack sudo[106216]: pam_unix(sudo:session): session closed for user root Sep 04 22:57:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_93c09877-96f2-49bd-a9be-98e163172c74_istjiknidevstack@QuobyteHD /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7c930fe4-1c42-41f2-a66d-2f1e0c28b58e" returned: 0 in 0.439s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:57:25 devstack cinder-volume[87576]: DEBUG cinder.image.image_utils [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_93c09877-96f2-49bd-a9be-98e163172c74_istjiknidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7c930fe4-1c42-41f2-a66d-2f1e0c28b58e {{(pid=87576) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 22:57:25 devstack cinder-volume[87576]: INFO cinder.image.image_utils [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Converted 0.00 MB image at 0.00 MB/s Sep 04 22:57:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7c930fe4-1c42-41f2-a66d-2f1e0c28b58e 1G {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:57:25 devstack sudo[106222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7c930fe4-1c42-41f2-a66d-2f1e0c28b58e 1G Sep 04 22:57:25 devstack sudo[106222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:57:25 devstack sudo[106222]: pam_unix(sudo:session): session closed for user root Sep 04 22:57:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7c930fe4-1c42-41f2-a66d-2f1e0c28b58e 1G" returned: 0 in 0.297s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:57:25 devstack cinder-volume[87576]: DEBUG cinder.volume.volume_utils [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Downloaded image 93c09877-96f2-49bd-a9be-98e163172c74 ((None, [{'url': 'file:///opt/stack/data/glance/images/93c09877-96f2-49bd-a9be-98e163172c74', 'metadata': {}}])) to volume 7c930fe4-1c42-41f2-a66d-2f1e0c28b58e successfully. {{(pid=87576) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 04 22:57:25 devstack cinder-volume[87576]: DEBUG cinder.image.image_utils [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Temporary image 93c09877-96f2-49bd-a9be-98e163172c74 for user 5c52fdecff10443e9de820698a75325e is deleted. {{(pid=87576) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 04 22:57:25 devstack cinder-volume[87576]: DEBUG cinder.volume.volume_utils [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Marking volume 7c930fe4-1c42-41f2-a66d-2f1e0c28b58e as bootable. {{(pid=87576) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 04 22:57:25 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Copying metadata from image 93c09877-96f2-49bd-a9be-98e163172c74 to 7c930fe4-1c42-41f2-a66d-2f1e0c28b58e. {{(pid=87576) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 04 22:57:26 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Creating volume glance metadata for volume 7c930fe4-1c42-41f2-a66d-2f1e0c28b58e backed by image 93c09877-96f2-49bd-a9be-98e163172c74 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '93c09877-96f2-49bd-a9be-98e163172c74', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'a790cd024dd9afb7234ba1314a7bc055', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87576) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 04 22:57:26 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d32e7e0-f0cd-4c60-bfb6-db74ff043625) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c930fe4-1c42-41f2-a66d-2f1e0c28b58e', 'volume_size': 1, 'image_id': '93c09877-96f2-49bd-a9be-98e163172c74', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/93c09877-96f2-49bd-a9be-98e163172c74', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a790cd024dd9afb7234ba1314a7bc055', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3873fbdf86ac4d8fa47496805f5fd851', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '54d956c386cf1eacaefcd7dd7685ef6a543d0f4984c9e1e54813b2af9ead7f77a7c3e7015424ea98318bc041477c44f3b63eea9ff3f955ed88d6ed9d24504b7e', 'id': '93c09877-96f2-49bd-a9be-98e163172c74', 'created_at': datetime.datetime(2026, 9, 4, 20, 57, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 20, 57, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/93c09877-96f2-49bd-a9be-98e163172c74/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:57:26 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec8ae809-63b3-4b39-92c4-b8c87dc4c813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:57:26 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Volume volume-7c930fe4-1c42-41f2-a66d-2f1e0c28b58e (7c930fe4-1c42-41f2-a66d-2f1e0c28b58e): created successfully Sep 04 22:57:26 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec8ae809-63b3-4b39-92c4-b8c87dc4c813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:57:26 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Flow 'volume_create_manager' (73e01628-f97d-4003-9155-7c1968bc839f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:57:26 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-d7bf0dbe-0b84-46ba-8f6e-7b15dc99dd25 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Created volume successfully. Sep 04 22:57:26 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f0fcf30e-c6a7-457e-a6d2-5642ae8aefe8 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Acquiring lock "cinder-7c930fe4-1c42-41f2-a66d-2f1e0c28b58e-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:57:26 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f0fcf30e-c6a7-457e-a6d2-5642ae8aefe8 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Lock "cinder-7c930fe4-1c42-41f2-a66d-2f1e0c28b58e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:57:26 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f0fcf30e-c6a7-457e-a6d2-5642ae8aefe8 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Acquiring lock "cinder-quobyte-7c930fe4-1c42-41f2-a66d-2f1e0c28b58e" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:57:26 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f0fcf30e-c6a7-457e-a6d2-5642ae8aefe8 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Lock "cinder-quobyte-7c930fe4-1c42-41f2-a66d-2f1e0c28b58e" acquired by "delete_volume" :: waited 0.013s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:57:26 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[94810f6b-82a5-4c10-a1bf-ed93d0f3a38c]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:57:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f0fcf30e-c6a7-457e-a6d2-5642ae8aefe8 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7c930fe4-1c42-41f2-a66d-2f1e0c28b58e {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:57:26 devstack sudo[106228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7c930fe4-1c42-41f2-a66d-2f1e0c28b58e Sep 04 22:57:26 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:57:27 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root Sep 04 22:57:27 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f0fcf30e-c6a7-457e-a6d2-5642ae8aefe8 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7c930fe4-1c42-41f2-a66d-2f1e0c28b58e" returned: 0 in 0.354s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:57:27 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f0fcf30e-c6a7-457e-a6d2-5642ae8aefe8 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7c930fe4-1c42-41f2-a66d-2f1e0c28b58e {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:57:27 devstack sudo[106233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7c930fe4-1c42-41f2-a66d-2f1e0c28b58e Sep 04 22:57:27 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:57:27 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root Sep 04 22:57:27 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f0fcf30e-c6a7-457e-a6d2-5642ae8aefe8 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7c930fe4-1c42-41f2-a66d-2f1e0c28b58e" returned: 0 in 0.242s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:57:27 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f0fcf30e-c6a7-457e-a6d2-5642ae8aefe8 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Lock "cinder-quobyte-7c930fe4-1c42-41f2-a66d-2f1e0c28b58e" released by "delete_volume" :: held 0.634s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:57:27 devstack cinder-volume[87576]: WARNING cinder.quota [None req-f0fcf30e-c6a7-457e-a6d2-5642ae8aefe8 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 04 22:57:27 devstack cinder-volume[87576]: WARNING cinder.quota [None req-f0fcf30e-c6a7-457e-a6d2-5642ae8aefe8 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 04 22:57:27 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-f0fcf30e-c6a7-457e-a6d2-5642ae8aefe8 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Created reservations ['0ea20f95-1e73-43da-b729-aa75f9e5865f', '1fd775ff-7dfe-4431-bba1-051c2fcebb2c', '865d4ae7-a0c8-42e8-9d54-c33eb2303373', '4e0bd131-52b3-45c2-b3ae-e343446fb9ef'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:57:27 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f0fcf30e-c6a7-457e-a6d2-5642ae8aefe8 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:57:27 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f0fcf30e-c6a7-457e-a6d2-5642ae8aefe8 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:57:27 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-f0fcf30e-c6a7-457e-a6d2-5642ae8aefe8 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:57:27 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-f0fcf30e-c6a7-457e-a6d2-5642ae8aefe8 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:57:27 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f0fcf30e-c6a7-457e-a6d2-5642ae8aefe8 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:57:27 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f0fcf30e-c6a7-457e-a6d2-5642ae8aefe8 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:57:27 devstack sudo[106236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:57:27 devstack sudo[106236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:57:27 devstack sudo[106236]: pam_unix(sudo:session): session closed for user root Sep 04 22:57:27 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f0fcf30e-c6a7-457e-a6d2-5642ae8aefe8 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.232s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:57:27 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-f0fcf30e-c6a7-457e-a6d2-5642ae8aefe8 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:57:27 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-f0fcf30e-c6a7-457e-a6d2-5642ae8aefe8 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Deleted volume successfully. Sep 04 22:57:27 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f0fcf30e-c6a7-457e-a6d2-5642ae8aefe8 tempest-VolumeAndVolumeTypeFromImageTest-2135565251 None] Lock "cinder-7c930fe4-1c42-41f2-a66d-2f1e0c28b58e-delete_volume" released by "delete_volume" :: held 1.068s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:57:37 devstack cinder-volume[87576]: DEBUG dbcounter [-] [87576] Writing DB stats cinder:SELECT=17,cinder:UPDATE=9,cinder:INSERT=8 {{(pid=87576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 22:57:37 devstack cinder-volume[87576]: DEBUG dbcounter [-] [87576] Writing DB stats cinder:UPDATE=16,cinder:INSERT=7,cinder:SELECT=9,cinder:DELETE=2 {{(pid=87576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 22:57:52 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-18c366f6-5423-4e53-8f30-757bda8b6c8f tempest-SnapshotDependencyTests-1963836203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:57:52 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-18c366f6-5423-4e53-8f30-757bda8b6c8f tempest-SnapshotDependencyTests-1963836203 None] Flow 'volume_create_manager' (7a867df1-b6b1-4d44-ac43-40744407dc01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:57:52 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-18c366f6-5423-4e53-8f30-757bda8b6c8f tempest-SnapshotDependencyTests-1963836203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b182a801-7a20-434d-b8d9-cabb23566885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:57:52 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-18c366f6-5423-4e53-8f30-757bda8b6c8f tempest-SnapshotDependencyTests-1963836203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b182a801-7a20-434d-b8d9-cabb23566885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-584373369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9003471a-c58c-492c-91f9-cfacafd46cbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ff510d3e18f49749021b75f191ce048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:57:52Z,use_quota=True,user_id='e48c4431c2c84d49a0bcf50032e8220c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:57:52 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-18c366f6-5423-4e53-8f30-757bda8b6c8f tempest-SnapshotDependencyTests-1963836203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89540d0a-02a2-4ba7-995a-fffdb4eb9154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:57:52 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-18c366f6-5423-4e53-8f30-757bda8b6c8f tempest-SnapshotDependencyTests-1963836203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89540d0a-02a2-4ba7-995a-fffdb4eb9154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:57:52 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-18c366f6-5423-4e53-8f30-757bda8b6c8f tempest-SnapshotDependencyTests-1963836203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aa693ce-cbe2-4d51-95b5-e9fc9a83786c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:57:52 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-18c366f6-5423-4e53-8f30-757bda8b6c8f tempest-SnapshotDependencyTests-1963836203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aa693ce-cbe2-4d51-95b5-e9fc9a83786c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9003471a-c58c-492c-91f9-cfacafd46cbe', 'volume_name': 'volume-9003471a-c58c-492c-91f9-cfacafd46cbe', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:57:52 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-18c366f6-5423-4e53-8f30-757bda8b6c8f tempest-SnapshotDependencyTests-1963836203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eda13e39-aacf-46d7-b398-093e20583e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:57:52 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-18c366f6-5423-4e53-8f30-757bda8b6c8f tempest-SnapshotDependencyTests-1963836203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eda13e39-aacf-46d7-b398-093e20583e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:57:52 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-18c366f6-5423-4e53-8f30-757bda8b6c8f tempest-SnapshotDependencyTests-1963836203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adcea582-83e6-4bf8-a369-e5b73bc1794a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:57:52 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-18c366f6-5423-4e53-8f30-757bda8b6c8f tempest-SnapshotDependencyTests-1963836203 None] Volume 9003471a-c58c-492c-91f9-cfacafd46cbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9003471a-c58c-492c-91f9-cfacafd46cbe', 'volume_size': 1} Sep 04 22:57:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-18c366f6-5423-4e53-8f30-757bda8b6c8f tempest-SnapshotDependencyTests-1963836203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:57:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-18c366f6-5423-4e53-8f30-757bda8b6c8f tempest-SnapshotDependencyTests-1963836203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:57:52 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-18c366f6-5423-4e53-8f30-757bda8b6c8f tempest-SnapshotDependencyTests-1963836203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-584373369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9003471a-c58c-492c-91f9-cfacafd46cbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ff510d3e18f49749021b75f191ce048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:57:52Z,use_quota=True,user_id='e48c4431c2c84d49a0bcf50032e8220c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:57:52 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-18c366f6-5423-4e53-8f30-757bda8b6c8f tempest-SnapshotDependencyTests-1963836203 None] Creating volume 9003471a-c58c-492c-91f9-cfacafd46cbe {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:57:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-18c366f6-5423-4e53-8f30-757bda8b6c8f tempest-SnapshotDependencyTests-1963836203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:57:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-18c366f6-5423-4e53-8f30-757bda8b6c8f tempest-SnapshotDependencyTests-1963836203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:57:52 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-18c366f6-5423-4e53-8f30-757bda8b6c8f tempest-SnapshotDependencyTests-1963836203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:57:52 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-18c366f6-5423-4e53-8f30-757bda8b6c8f tempest-SnapshotDependencyTests-1963836203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:57:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-18c366f6-5423-4e53-8f30-757bda8b6c8f tempest-SnapshotDependencyTests-1963836203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:57:52 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-18c366f6-5423-4e53-8f30-757bda8b6c8f tempest-SnapshotDependencyTests-1963836203 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:57:52 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-18c366f6-5423-4e53-8f30-757bda8b6c8f tempest-SnapshotDependencyTests-1963836203 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:57:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-18c366f6-5423-4e53-8f30-757bda8b6c8f tempest-SnapshotDependencyTests-1963836203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9003471a-c58c-492c-91f9-cfacafd46cbe 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:57:52 devstack sudo[106288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9003471a-c58c-492c-91f9-cfacafd46cbe 1073741824 Sep 04 22:57:52 devstack sudo[106288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:57:53 devstack sudo[106288]: pam_unix(sudo:session): session closed for user root Sep 04 22:57:53 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-18c366f6-5423-4e53-8f30-757bda8b6c8f tempest-SnapshotDependencyTests-1963836203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9003471a-c58c-492c-91f9-cfacafd46cbe 1073741824" returned: 0 in 0.463s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:57:53 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-18c366f6-5423-4e53-8f30-757bda8b6c8f tempest-SnapshotDependencyTests-1963836203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9003471a-c58c-492c-91f9-cfacafd46cbe {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:57:53 devstack sudo[106293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9003471a-c58c-492c-91f9-cfacafd46cbe Sep 04 22:57:53 devstack sudo[106293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:57:53 devstack sudo[106293]: pam_unix(sudo:session): session closed for user root Sep 04 22:57:53 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-18c366f6-5423-4e53-8f30-757bda8b6c8f tempest-SnapshotDependencyTests-1963836203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9003471a-c58c-492c-91f9-cfacafd46cbe" returned: 0 in 0.244s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:57:53 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-18c366f6-5423-4e53-8f30-757bda8b6c8f tempest-SnapshotDependencyTests-1963836203 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:57:53 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-18c366f6-5423-4e53-8f30-757bda8b6c8f tempest-SnapshotDependencyTests-1963836203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:57:53 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-18c366f6-5423-4e53-8f30-757bda8b6c8f tempest-SnapshotDependencyTests-1963836203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adcea582-83e6-4bf8-a369-e5b73bc1794a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9003471a-c58c-492c-91f9-cfacafd46cbe', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:57:53 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-18c366f6-5423-4e53-8f30-757bda8b6c8f tempest-SnapshotDependencyTests-1963836203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbfbfa06-fde4-455c-8caf-2bcbfc468b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:57:53 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-18c366f6-5423-4e53-8f30-757bda8b6c8f tempest-SnapshotDependencyTests-1963836203 None] Volume volume-9003471a-c58c-492c-91f9-cfacafd46cbe (9003471a-c58c-492c-91f9-cfacafd46cbe): created successfully Sep 04 22:57:53 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-18c366f6-5423-4e53-8f30-757bda8b6c8f tempest-SnapshotDependencyTests-1963836203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbfbfa06-fde4-455c-8caf-2bcbfc468b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:57:53 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-18c366f6-5423-4e53-8f30-757bda8b6c8f tempest-SnapshotDependencyTests-1963836203 None] Flow 'volume_create_manager' (7a867df1-b6b1-4d44-ac43-40744407dc01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:57:53 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-18c366f6-5423-4e53-8f30-757bda8b6c8f tempest-SnapshotDependencyTests-1963836203 None] Created volume successfully. Sep 04 22:57:53 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-65bf0c1f-0c26-46c8-8b58-eb145b681118 tempest-SnapshotDependencyTests-1963836203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:57:53 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-65bf0c1f-0c26-46c8-8b58-eb145b681118 tempest-SnapshotDependencyTests-1963836203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:57:53 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-65bf0c1f-0c26-46c8-8b58-eb145b681118 tempest-SnapshotDependencyTests-1963836203 None] Creating offline snapshot b7764aeb-59ea-4a1a-8b32-8c05a71ba893 of volume 9003471a-c58c-492c-91f9-cfacafd46cbe {{(pid=87576) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 22:57:53 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d7efe5-f1b1-495f-bcbb-a3d184b89000]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:57:53 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-65bf0c1f-0c26-46c8-8b58-eb145b681118 tempest-SnapshotDependencyTests-1963836203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9003471a-c58c-492c-91f9-cfacafd46cbe {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:57:53 devstack sudo[106297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9003471a-c58c-492c-91f9-cfacafd46cbe Sep 04 22:57:53 devstack sudo[106297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:57:54 devstack sudo[106297]: pam_unix(sudo:session): session closed for user root Sep 04 22:57:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-65bf0c1f-0c26-46c8-8b58-eb145b681118 tempest-SnapshotDependencyTests-1963836203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9003471a-c58c-492c-91f9-cfacafd46cbe" returned: 0 in 0.353s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:57:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-65bf0c1f-0c26-46c8-8b58-eb145b681118 tempest-SnapshotDependencyTests-1963836203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9003471a-c58c-492c-91f9-cfacafd46cbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9003471a-c58c-492c-91f9-cfacafd46cbe.b7764aeb-59ea-4a1a-8b32-8c05a71ba893 1G {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:57:54 devstack sudo[106302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9003471a-c58c-492c-91f9-cfacafd46cbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9003471a-c58c-492c-91f9-cfacafd46cbe.b7764aeb-59ea-4a1a-8b32-8c05a71ba893 1G Sep 04 22:57:54 devstack sudo[106302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:57:54 devstack sudo[106302]: pam_unix(sudo:session): session closed for user root Sep 04 22:57:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-65bf0c1f-0c26-46c8-8b58-eb145b681118 tempest-SnapshotDependencyTests-1963836203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9003471a-c58c-492c-91f9-cfacafd46cbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9003471a-c58c-492c-91f9-cfacafd46cbe.b7764aeb-59ea-4a1a-8b32-8c05a71ba893 1G" returned: 0 in 0.365s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:57:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-65bf0c1f-0c26-46c8-8b58-eb145b681118 tempest-SnapshotDependencyTests-1963836203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9003471a-c58c-492c-91f9-cfacafd46cbe -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9003471a-c58c-492c-91f9-cfacafd46cbe.b7764aeb-59ea-4a1a-8b32-8c05a71ba893 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:57:54 devstack sudo[106308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9003471a-c58c-492c-91f9-cfacafd46cbe -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9003471a-c58c-492c-91f9-cfacafd46cbe.b7764aeb-59ea-4a1a-8b32-8c05a71ba893 Sep 04 22:57:54 devstack sudo[106308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:57:54 devstack sudo[106308]: pam_unix(sudo:session): session closed for user root Sep 04 22:57:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-65bf0c1f-0c26-46c8-8b58-eb145b681118 tempest-SnapshotDependencyTests-1963836203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9003471a-c58c-492c-91f9-cfacafd46cbe -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9003471a-c58c-492c-91f9-cfacafd46cbe.b7764aeb-59ea-4a1a-8b32-8c05a71ba893" returned: 0 in 0.292s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:57:54 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-65bf0c1f-0c26-46c8-8b58-eb145b681118 tempest-SnapshotDependencyTests-1963836203 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9003471a-c58c-492c-91f9-cfacafd46cbe.b7764aeb-59ea-4a1a-8b32-8c05a71ba893 is being set with open permissions: ugo+rw Sep 04 22:57:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-65bf0c1f-0c26-46c8-8b58-eb145b681118 tempest-SnapshotDependencyTests-1963836203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9003471a-c58c-492c-91f9-cfacafd46cbe.b7764aeb-59ea-4a1a-8b32-8c05a71ba893 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:57:54 devstack sudo[106313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9003471a-c58c-492c-91f9-cfacafd46cbe.b7764aeb-59ea-4a1a-8b32-8c05a71ba893 Sep 04 22:57:54 devstack sudo[106313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:57:54 devstack sudo[106313]: pam_unix(sudo:session): session closed for user root Sep 04 22:57:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-65bf0c1f-0c26-46c8-8b58-eb145b681118 tempest-SnapshotDependencyTests-1963836203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9003471a-c58c-492c-91f9-cfacafd46cbe.b7764aeb-59ea-4a1a-8b32-8c05a71ba893" returned: 0 in 0.242s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:57:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-65bf0c1f-0c26-46c8-8b58-eb145b681118 tempest-SnapshotDependencyTests-1963836203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9003471a-c58c-492c-91f9-cfacafd46cbe.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:57:55 devstack sudo[106316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9003471a-c58c-492c-91f9-cfacafd46cbe.info Sep 04 22:57:55 devstack sudo[106316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:57:55 devstack sudo[106316]: pam_unix(sudo:session): session closed for user root Sep 04 22:57:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-65bf0c1f-0c26-46c8-8b58-eb145b681118 tempest-SnapshotDependencyTests-1963836203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9003471a-c58c-492c-91f9-cfacafd46cbe.info" returned: 0 in 0.253s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:57:55 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-65bf0c1f-0c26-46c8-8b58-eb145b681118 tempest-SnapshotDependencyTests-1963836203 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9003471a-c58c-492c-91f9-cfacafd46cbe.info is being set with open permissions: ugo+rw Sep 04 22:57:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-65bf0c1f-0c26-46c8-8b58-eb145b681118 tempest-SnapshotDependencyTests-1963836203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9003471a-c58c-492c-91f9-cfacafd46cbe.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:57:55 devstack sudo[106319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9003471a-c58c-492c-91f9-cfacafd46cbe.info Sep 04 22:57:55 devstack sudo[106319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:57:55 devstack sudo[106319]: pam_unix(sudo:session): session closed for user root Sep 04 22:57:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-65bf0c1f-0c26-46c8-8b58-eb145b681118 tempest-SnapshotDependencyTests-1963836203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9003471a-c58c-492c-91f9-cfacafd46cbe.info" returned: 0 in 0.242s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:57:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-65bf0c1f-0c26-46c8-8b58-eb145b681118 tempest-SnapshotDependencyTests-1963836203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.828s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:57:55 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-65bf0c1f-0c26-46c8-8b58-eb145b681118 tempest-SnapshotDependencyTests-1963836203 None] Create snapshot completed successfully Sep 04 22:57:56 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-981cf054-7d2c-4fa9-9d2b-4d63216ce56c tempest-SnapshotDependencyTests-1963836203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:57:56 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-981cf054-7d2c-4fa9-9d2b-4d63216ce56c tempest-SnapshotDependencyTests-1963836203 None] Flow 'volume_create_manager' (2e734a48-b4e3-4d24-a9fd-6fe201d53cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:57:56 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-981cf054-7d2c-4fa9-9d2b-4d63216ce56c tempest-SnapshotDependencyTests-1963836203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2dd3477-e3b0-4f01-9090-de78a688095f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:57:56 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-981cf054-7d2c-4fa9-9d2b-4d63216ce56c tempest-SnapshotDependencyTests-1963836203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2dd3477-e3b0-4f01-9090-de78a688095f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:57:56Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5331c1da-5b7f-445b-8832-4f095ad9af27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ff510d3e18f49749021b75f191ce048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:57:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b7764aeb-59ea-4a1a-8b32-8c05a71ba893,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:57:56Z,use_quota=True,user_id='e48c4431c2c84d49a0bcf50032e8220c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:57:56 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-981cf054-7d2c-4fa9-9d2b-4d63216ce56c tempest-SnapshotDependencyTests-1963836203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15db82d4-4b4b-49bb-9640-599c91c569d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:57:56 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-981cf054-7d2c-4fa9-9d2b-4d63216ce56c tempest-SnapshotDependencyTests-1963836203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15db82d4-4b4b-49bb-9640-599c91c569d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:57:56 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-981cf054-7d2c-4fa9-9d2b-4d63216ce56c tempest-SnapshotDependencyTests-1963836203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd065a2e-967b-4986-85bf-6087b3bf55da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:57:56 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-981cf054-7d2c-4fa9-9d2b-4d63216ce56c tempest-SnapshotDependencyTests-1963836203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd065a2e-967b-4986-85bf-6087b3bf55da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5331c1da-5b7f-445b-8832-4f095ad9af27', 'volume_name': 'volume-5331c1da-5b7f-445b-8832-4f095ad9af27', 'volume_size': 1, 'snapshot_id': 'b7764aeb-59ea-4a1a-8b32-8c05a71ba893'}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:57:56 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-981cf054-7d2c-4fa9-9d2b-4d63216ce56c tempest-SnapshotDependencyTests-1963836203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc2c293b-cb40-48fb-861f-89be3e8d833a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:57:56 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-981cf054-7d2c-4fa9-9d2b-4d63216ce56c tempest-SnapshotDependencyTests-1963836203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc2c293b-cb40-48fb-861f-89be3e8d833a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:57:56 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-981cf054-7d2c-4fa9-9d2b-4d63216ce56c tempest-SnapshotDependencyTests-1963836203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fab84b4-4268-41ca-bc3b-4ebb1bc1c8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:57:56 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-981cf054-7d2c-4fa9-9d2b-4d63216ce56c tempest-SnapshotDependencyTests-1963836203 None] Volume 5331c1da-5b7f-445b-8832-4f095ad9af27: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5331c1da-5b7f-445b-8832-4f095ad9af27', 'volume_size': 1, 'snapshot_id': 'b7764aeb-59ea-4a1a-8b32-8c05a71ba893'} Sep 04 22:57:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-981cf054-7d2c-4fa9-9d2b-4d63216ce56c tempest-SnapshotDependencyTests-1963836203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:57:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-981cf054-7d2c-4fa9-9d2b-4d63216ce56c tempest-SnapshotDependencyTests-1963836203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:57:56 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-981cf054-7d2c-4fa9-9d2b-4d63216ce56c tempest-SnapshotDependencyTests-1963836203 None] Acquiring lock "cinder-quobyte-b7764aeb-59ea-4a1a-8b32-8c05a71ba893-5331c1da-5b7f-445b-8832-4f095ad9af27" by "_create_volume_from_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:57:56 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-981cf054-7d2c-4fa9-9d2b-4d63216ce56c tempest-SnapshotDependencyTests-1963836203 None] Lock "cinder-quobyte-b7764aeb-59ea-4a1a-8b32-8c05a71ba893-5331c1da-5b7f-445b-8832-4f095ad9af27" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:57:56 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-981cf054-7d2c-4fa9-9d2b-4d63216ce56c tempest-SnapshotDependencyTests-1963836203 None] Creating volume 5331c1da-5b7f-445b-8832-4f095ad9af27 from snapshot b7764aeb-59ea-4a1a-8b32-8c05a71ba893 {{(pid=87576) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 04 22:57:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-981cf054-7d2c-4fa9-9d2b-4d63216ce56c tempest-SnapshotDependencyTests-1963836203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:57:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-981cf054-7d2c-4fa9-9d2b-4d63216ce56c tempest-SnapshotDependencyTests-1963836203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:57:56 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-981cf054-7d2c-4fa9-9d2b-4d63216ce56c tempest-SnapshotDependencyTests-1963836203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:57:56 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-981cf054-7d2c-4fa9-9d2b-4d63216ce56c tempest-SnapshotDependencyTests-1963836203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:57:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-981cf054-7d2c-4fa9-9d2b-4d63216ce56c tempest-SnapshotDependencyTests-1963836203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:57:56 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-981cf054-7d2c-4fa9-9d2b-4d63216ce56c tempest-SnapshotDependencyTests-1963836203 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:57:56 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-981cf054-7d2c-4fa9-9d2b-4d63216ce56c tempest-SnapshotDependencyTests-1963836203 None] Acquiring lock "cinder-quobyte-5331c1da-5b7f-445b-8832-4f095ad9af27" by "_copy_volume_from_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:57:56 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-981cf054-7d2c-4fa9-9d2b-4d63216ce56c tempest-SnapshotDependencyTests-1963836203 None] Lock "cinder-quobyte-5331c1da-5b7f-445b-8832-4f095ad9af27" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:57:56 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-981cf054-7d2c-4fa9-9d2b-4d63216ce56c tempest-SnapshotDependencyTests-1963836203 None] snapshot: b7764aeb-59ea-4a1a-8b32-8c05a71ba893, volume: 5331c1da-5b7f-445b-8832-4f095ad9af27, {{(pid=87576) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 04 22:57:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-981cf054-7d2c-4fa9-9d2b-4d63216ce56c tempest-SnapshotDependencyTests-1963836203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:57:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-981cf054-7d2c-4fa9-9d2b-4d63216ce56c tempest-SnapshotDependencyTests-1963836203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:57:56 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-981cf054-7d2c-4fa9-9d2b-4d63216ce56c tempest-SnapshotDependencyTests-1963836203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:57:56 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-981cf054-7d2c-4fa9-9d2b-4d63216ce56c tempest-SnapshotDependencyTests-1963836203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:57:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-981cf054-7d2c-4fa9-9d2b-4d63216ce56c tempest-SnapshotDependencyTests-1963836203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:57:56 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ed3427-2d7e-49d7-b941-0258e0372140]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:57:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-981cf054-7d2c-4fa9-9d2b-4d63216ce56c tempest-SnapshotDependencyTests-1963836203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9003471a-c58c-492c-91f9-cfacafd46cbe.b7764aeb-59ea-4a1a-8b32-8c05a71ba893 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:57:56 devstack sudo[106322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9003471a-c58c-492c-91f9-cfacafd46cbe.b7764aeb-59ea-4a1a-8b32-8c05a71ba893 Sep 04 22:57:56 devstack sudo[106322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:57:56 devstack sudo[106322]: pam_unix(sudo:session): session closed for user root Sep 04 22:57:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-981cf054-7d2c-4fa9-9d2b-4d63216ce56c tempest-SnapshotDependencyTests-1963836203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9003471a-c58c-492c-91f9-cfacafd46cbe.b7764aeb-59ea-4a1a-8b32-8c05a71ba893" returned: 0 in 0.364s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:57:56 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-981cf054-7d2c-4fa9-9d2b-4d63216ce56c tempest-SnapshotDependencyTests-1963836203 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9003471a-c58c-492c-91f9-cfacafd46cbe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 22:57:56 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[128550e5-2e3c-4f8c-9359-b9ac06722ea0]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:57:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-981cf054-7d2c-4fa9-9d2b-4d63216ce56c tempest-SnapshotDependencyTests-1963836203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9003471a-c58c-492c-91f9-cfacafd46cbe {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:57:56 devstack sudo[106327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9003471a-c58c-492c-91f9-cfacafd46cbe Sep 04 22:57:56 devstack sudo[106327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:57:57 devstack sudo[106327]: pam_unix(sudo:session): session closed for user root Sep 04 22:57:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-981cf054-7d2c-4fa9-9d2b-4d63216ce56c tempest-SnapshotDependencyTests-1963836203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9003471a-c58c-492c-91f9-cfacafd46cbe" returned: 0 in 0.384s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:57:57 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-981cf054-7d2c-4fa9-9d2b-4d63216ce56c tempest-SnapshotDependencyTests-1963836203 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9003471a-c58c-492c-91f9-cfacafd46cbe {{(pid=87576) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 04 22:57:57 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-981cf054-7d2c-4fa9-9d2b-4d63216ce56c tempest-SnapshotDependencyTests-1963836203 None] Creating direct copy from snapshot {{(pid=87576) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 04 22:57:57 devstack cinder-volume[87576]: DEBUG cinder.utils [None req-981cf054-7d2c-4fa9-9d2b-4d63216ce56c tempest-SnapshotDependencyTests-1963836203 None] Path /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5331c1da-5b7f-445b-8832-4f095ad9af27 not found in is_blk_device check {{(pid=87576) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 04 22:57:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-981cf054-7d2c-4fa9-9d2b-4d63216ce56c tempest-SnapshotDependencyTests-1963836203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9003471a-c58c-492c-91f9-cfacafd46cbe /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5331c1da-5b7f-445b-8832-4f095ad9af27 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:57:57 devstack sudo[106332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9003471a-c58c-492c-91f9-cfacafd46cbe /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5331c1da-5b7f-445b-8832-4f095ad9af27 Sep 04 22:57:57 devstack sudo[106332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:01 devstack sudo[106332]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-981cf054-7d2c-4fa9-9d2b-4d63216ce56c tempest-SnapshotDependencyTests-1963836203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9003471a-c58c-492c-91f9-cfacafd46cbe /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5331c1da-5b7f-445b-8832-4f095ad9af27" returned: 0 in 4.077s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:01 devstack cinder-volume[87576]: DEBUG cinder.image.image_utils [None req-981cf054-7d2c-4fa9-9d2b-4d63216ce56c tempest-SnapshotDependencyTests-1963836203 None] Image conversion details: src /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9003471a-c58c-492c-91f9-cfacafd46cbe, size 1024.00 MB, duration 4.08 sec, destination /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5331c1da-5b7f-445b-8832-4f095ad9af27 {{(pid=87576) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 22:58:01 devstack cinder-volume[87576]: INFO cinder.image.image_utils [None req-981cf054-7d2c-4fa9-9d2b-4d63216ce56c tempest-SnapshotDependencyTests-1963836203 None] Converted 1024.00 MB image at 251.09 MB/s Sep 04 22:58:01 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-981cf054-7d2c-4fa9-9d2b-4d63216ce56c tempest-SnapshotDependencyTests-1963836203 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5331c1da-5b7f-445b-8832-4f095ad9af27 is being set with open permissions: ugo+rw Sep 04 22:58:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-981cf054-7d2c-4fa9-9d2b-4d63216ce56c tempest-SnapshotDependencyTests-1963836203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5331c1da-5b7f-445b-8832-4f095ad9af27 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:01 devstack sudo[106345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5331c1da-5b7f-445b-8832-4f095ad9af27 Sep 04 22:58:01 devstack sudo[106345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:01 devstack sudo[106345]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-981cf054-7d2c-4fa9-9d2b-4d63216ce56c tempest-SnapshotDependencyTests-1963836203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5331c1da-5b7f-445b-8832-4f095ad9af27" returned: 0 in 0.256s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:01 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-981cf054-7d2c-4fa9-9d2b-4d63216ce56c tempest-SnapshotDependencyTests-1963836203 None] Lock "cinder-quobyte-5331c1da-5b7f-445b-8832-4f095ad9af27" released by "_copy_volume_from_snapshot" :: held 5.155s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:58:01 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-981cf054-7d2c-4fa9-9d2b-4d63216ce56c tempest-SnapshotDependencyTests-1963836203 None] Lock "cinder-quobyte-b7764aeb-59ea-4a1a-8b32-8c05a71ba893-5331c1da-5b7f-445b-8832-4f095ad9af27" released by "_create_volume_from_snapshot" :: held 5.216s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:58:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-981cf054-7d2c-4fa9-9d2b-4d63216ce56c tempest-SnapshotDependencyTests-1963836203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.232s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:58:01 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-981cf054-7d2c-4fa9-9d2b-4d63216ce56c tempest-SnapshotDependencyTests-1963836203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fab84b4-4268-41ca-bc3b-4ebb1bc1c8be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5331c1da-5b7f-445b-8832-4f095ad9af27', 'volume_size': 1, 'snapshot_id': 'b7764aeb-59ea-4a1a-8b32-8c05a71ba893'}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:01 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-981cf054-7d2c-4fa9-9d2b-4d63216ce56c tempest-SnapshotDependencyTests-1963836203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2e52927-a8c6-4661-b105-354b456de443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:01 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-981cf054-7d2c-4fa9-9d2b-4d63216ce56c tempest-SnapshotDependencyTests-1963836203 None] Volume volume-5331c1da-5b7f-445b-8832-4f095ad9af27 (5331c1da-5b7f-445b-8832-4f095ad9af27): created successfully Sep 04 22:58:01 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-981cf054-7d2c-4fa9-9d2b-4d63216ce56c tempest-SnapshotDependencyTests-1963836203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2e52927-a8c6-4661-b105-354b456de443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:01 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-981cf054-7d2c-4fa9-9d2b-4d63216ce56c tempest-SnapshotDependencyTests-1963836203 None] Flow 'volume_create_manager' (2e734a48-b4e3-4d24-a9fd-6fe201d53cd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:58:01 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-981cf054-7d2c-4fa9-9d2b-4d63216ce56c tempest-SnapshotDependencyTests-1963836203 None] Created volume successfully. Sep 04 22:58:02 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f03617cd-26bf-43f3-bf75-52da5dc7bf5f tempest-SnapshotDependencyTests-1963836203 None] Acquiring lock "cinder-b7764aeb-59ea-4a1a-8b32-8c05a71ba893-delete_snapshot" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:58:02 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f03617cd-26bf-43f3-bf75-52da5dc7bf5f tempest-SnapshotDependencyTests-1963836203 None] Lock "cinder-b7764aeb-59ea-4a1a-8b32-8c05a71ba893-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:58:02 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f03617cd-26bf-43f3-bf75-52da5dc7bf5f tempest-SnapshotDependencyTests-1963836203 None] Acquiring lock "cinder-quobyte-9003471a-c58c-492c-91f9-cfacafd46cbe" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:58:02 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f03617cd-26bf-43f3-bf75-52da5dc7bf5f tempest-SnapshotDependencyTests-1963836203 None] Lock "cinder-quobyte-9003471a-c58c-492c-91f9-cfacafd46cbe" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:58:02 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f03617cd-26bf-43f3-bf75-52da5dc7bf5f tempest-SnapshotDependencyTests-1963836203 None] Acquiring lock "cinder-quobyte-b7764aeb-59ea-4a1a-8b32-8c05a71ba893" by "_delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:58:02 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f03617cd-26bf-43f3-bf75-52da5dc7bf5f tempest-SnapshotDependencyTests-1963836203 None] Lock "cinder-quobyte-b7764aeb-59ea-4a1a-8b32-8c05a71ba893" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:58:02 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-f03617cd-26bf-43f3-bf75-52da5dc7bf5f tempest-SnapshotDependencyTests-1963836203 None] Deleting offline snapshot b7764aeb-59ea-4a1a-8b32-8c05a71ba893 of volume 9003471a-c58c-492c-91f9-cfacafd46cbe {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 22:58:02 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-f03617cd-26bf-43f3-bf75-52da5dc7bf5f tempest-SnapshotDependencyTests-1963836203 None] snapshot_file for this snap is: volume-9003471a-c58c-492c-91f9-cfacafd46cbe.b7764aeb-59ea-4a1a-8b32-8c05a71ba893 {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 22:58:02 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30fa61c-9c34-49ed-b527-743d70cb4d67]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:58:02 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f03617cd-26bf-43f3-bf75-52da5dc7bf5f tempest-SnapshotDependencyTests-1963836203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9003471a-c58c-492c-91f9-cfacafd46cbe.b7764aeb-59ea-4a1a-8b32-8c05a71ba893 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:03 devstack sudo[106348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9003471a-c58c-492c-91f9-cfacafd46cbe.b7764aeb-59ea-4a1a-8b32-8c05a71ba893 Sep 04 22:58:03 devstack sudo[106348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:03 devstack sudo[106348]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f03617cd-26bf-43f3-bf75-52da5dc7bf5f tempest-SnapshotDependencyTests-1963836203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9003471a-c58c-492c-91f9-cfacafd46cbe.b7764aeb-59ea-4a1a-8b32-8c05a71ba893" returned: 0 in 0.353s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:03 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-f03617cd-26bf-43f3-bf75-52da5dc7bf5f tempest-SnapshotDependencyTests-1963836203 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9003471a-c58c-492c-91f9-cfacafd46cbe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 22:58:03 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[846c0a67-a27b-497a-bb20-c8fa5f58a4f3]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:58:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f03617cd-26bf-43f3-bf75-52da5dc7bf5f tempest-SnapshotDependencyTests-1963836203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9003471a-c58c-492c-91f9-cfacafd46cbe {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:03 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9003471a-c58c-492c-91f9-cfacafd46cbe Sep 04 22:58:03 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:03 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f03617cd-26bf-43f3-bf75-52da5dc7bf5f tempest-SnapshotDependencyTests-1963836203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9003471a-c58c-492c-91f9-cfacafd46cbe" returned: 0 in 0.520s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f03617cd-26bf-43f3-bf75-52da5dc7bf5f tempest-SnapshotDependencyTests-1963836203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9003471a-c58c-492c-91f9-cfacafd46cbe.b7764aeb-59ea-4a1a-8b32-8c05a71ba893 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:03 devstack sudo[106359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9003471a-c58c-492c-91f9-cfacafd46cbe.b7764aeb-59ea-4a1a-8b32-8c05a71ba893 Sep 04 22:58:03 devstack sudo[106359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:04 devstack sudo[106359]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f03617cd-26bf-43f3-bf75-52da5dc7bf5f tempest-SnapshotDependencyTests-1963836203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9003471a-c58c-492c-91f9-cfacafd46cbe.b7764aeb-59ea-4a1a-8b32-8c05a71ba893" returned: 0 in 0.321s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f03617cd-26bf-43f3-bf75-52da5dc7bf5f tempest-SnapshotDependencyTests-1963836203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9003471a-c58c-492c-91f9-cfacafd46cbe.b7764aeb-59ea-4a1a-8b32-8c05a71ba893 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:04 devstack sudo[106364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9003471a-c58c-492c-91f9-cfacafd46cbe.b7764aeb-59ea-4a1a-8b32-8c05a71ba893 Sep 04 22:58:04 devstack sudo[106364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:04 devstack sudo[106364]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f03617cd-26bf-43f3-bf75-52da5dc7bf5f tempest-SnapshotDependencyTests-1963836203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9003471a-c58c-492c-91f9-cfacafd46cbe.b7764aeb-59ea-4a1a-8b32-8c05a71ba893" returned: 0 in 0.237s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:04 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f03617cd-26bf-43f3-bf75-52da5dc7bf5f tempest-SnapshotDependencyTests-1963836203 None] Lock "cinder-quobyte-b7764aeb-59ea-4a1a-8b32-8c05a71ba893" released by "_delete_snapshot" :: held 1.522s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:58:04 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f03617cd-26bf-43f3-bf75-52da5dc7bf5f tempest-SnapshotDependencyTests-1963836203 None] Lock "cinder-quobyte-9003471a-c58c-492c-91f9-cfacafd46cbe" released by "delete_snapshot" :: held 1.550s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:58:04 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-f03617cd-26bf-43f3-bf75-52da5dc7bf5f tempest-SnapshotDependencyTests-1963836203 None] Created reservations ['9e753c08-45d5-4336-95f9-c64eae558434', '6d53e826-6f51-4337-b1cb-dad55f71704c', '35c6ffee-4b4d-4e61-8dca-f6a19ad02957', '0a348ab8-02bd-4b80-958d-a434b309bc82'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:58:04 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-f03617cd-26bf-43f3-bf75-52da5dc7bf5f tempest-SnapshotDependencyTests-1963836203 None] Delete snapshot completed successfully. Sep 04 22:58:04 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f03617cd-26bf-43f3-bf75-52da5dc7bf5f tempest-SnapshotDependencyTests-1963836203 None] Lock "cinder-b7764aeb-59ea-4a1a-8b32-8c05a71ba893-delete_snapshot" released by "delete_snapshot" :: held 1.674s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:58:05 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d2ffe56b-d3cd-4494-ab9b-21a581c7ed59 tempest-SnapshotDependencyTests-1963836203 None] Acquiring lock "cinder-9003471a-c58c-492c-91f9-cfacafd46cbe-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:58:05 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d2ffe56b-d3cd-4494-ab9b-21a581c7ed59 tempest-SnapshotDependencyTests-1963836203 None] Lock "cinder-9003471a-c58c-492c-91f9-cfacafd46cbe-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:58:05 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d2ffe56b-d3cd-4494-ab9b-21a581c7ed59 tempest-SnapshotDependencyTests-1963836203 None] Acquiring lock "cinder-quobyte-9003471a-c58c-492c-91f9-cfacafd46cbe" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:58:05 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d2ffe56b-d3cd-4494-ab9b-21a581c7ed59 tempest-SnapshotDependencyTests-1963836203 None] Lock "cinder-quobyte-9003471a-c58c-492c-91f9-cfacafd46cbe" acquired by "delete_volume" :: waited 0.018s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:58:05 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[3002cb17-ff65-4ad2-a884-6c1d91bf25ed]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:58:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d2ffe56b-d3cd-4494-ab9b-21a581c7ed59 tempest-SnapshotDependencyTests-1963836203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9003471a-c58c-492c-91f9-cfacafd46cbe {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:05 devstack sudo[106368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9003471a-c58c-492c-91f9-cfacafd46cbe Sep 04 22:58:05 devstack sudo[106368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:05 devstack sudo[106368]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d2ffe56b-d3cd-4494-ab9b-21a581c7ed59 tempest-SnapshotDependencyTests-1963836203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9003471a-c58c-492c-91f9-cfacafd46cbe" returned: 0 in 0.364s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d2ffe56b-d3cd-4494-ab9b-21a581c7ed59 tempest-SnapshotDependencyTests-1963836203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9003471a-c58c-492c-91f9-cfacafd46cbe {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:05 devstack sudo[106373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9003471a-c58c-492c-91f9-cfacafd46cbe Sep 04 22:58:05 devstack sudo[106373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:05 devstack sudo[106373]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d2ffe56b-d3cd-4494-ab9b-21a581c7ed59 tempest-SnapshotDependencyTests-1963836203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9003471a-c58c-492c-91f9-cfacafd46cbe" returned: 0 in 0.255s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:05 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d2ffe56b-d3cd-4494-ab9b-21a581c7ed59 tempest-SnapshotDependencyTests-1963836203 None] Lock "cinder-quobyte-9003471a-c58c-492c-91f9-cfacafd46cbe" released by "delete_volume" :: held 0.685s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:58:05 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-d2ffe56b-d3cd-4494-ab9b-21a581c7ed59 tempest-SnapshotDependencyTests-1963836203 None] Created reservations ['9c7098f7-7839-43f4-96d5-820f1ba0ce3a', '8e51d6b0-44b5-4600-b8bf-6f50ece53d7d', 'a93debcc-1ebc-4522-9400-37f842dba3ca', '5d6bf045-51be-41d4-86f1-b14b58e7d686'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:58:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-d2ffe56b-d3cd-4494-ab9b-21a581c7ed59 tempest-SnapshotDependencyTests-1963836203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:58:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-d2ffe56b-d3cd-4494-ab9b-21a581c7ed59 tempest-SnapshotDependencyTests-1963836203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:58:05 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-d2ffe56b-d3cd-4494-ab9b-21a581c7ed59 tempest-SnapshotDependencyTests-1963836203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:58:05 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-d2ffe56b-d3cd-4494-ab9b-21a581c7ed59 tempest-SnapshotDependencyTests-1963836203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:58:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-d2ffe56b-d3cd-4494-ab9b-21a581c7ed59 tempest-SnapshotDependencyTests-1963836203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:58:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d2ffe56b-d3cd-4494-ab9b-21a581c7ed59 tempest-SnapshotDependencyTests-1963836203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:05 devstack sudo[106376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:58:05 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:06 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d2ffe56b-d3cd-4494-ab9b-21a581c7ed59 tempest-SnapshotDependencyTests-1963836203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.251s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:06 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-d2ffe56b-d3cd-4494-ab9b-21a581c7ed59 tempest-SnapshotDependencyTests-1963836203 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:58:06 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-d2ffe56b-d3cd-4494-ab9b-21a581c7ed59 tempest-SnapshotDependencyTests-1963836203 None] Deleted volume successfully. Sep 04 22:58:06 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d2ffe56b-d3cd-4494-ab9b-21a581c7ed59 tempest-SnapshotDependencyTests-1963836203 None] Lock "cinder-9003471a-c58c-492c-91f9-cfacafd46cbe-delete_volume" released by "delete_volume" :: held 1.130s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:58:06 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f1552fcb-b4da-4c6d-9441-8893bdb65886 tempest-SnapshotDependencyTests-1963836203 None] Acquiring lock "cinder-5331c1da-5b7f-445b-8832-4f095ad9af27-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:58:06 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f1552fcb-b4da-4c6d-9441-8893bdb65886 tempest-SnapshotDependencyTests-1963836203 None] Lock "cinder-5331c1da-5b7f-445b-8832-4f095ad9af27-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:58:06 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f1552fcb-b4da-4c6d-9441-8893bdb65886 tempest-SnapshotDependencyTests-1963836203 None] Acquiring lock "cinder-quobyte-5331c1da-5b7f-445b-8832-4f095ad9af27" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:58:06 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f1552fcb-b4da-4c6d-9441-8893bdb65886 tempest-SnapshotDependencyTests-1963836203 None] Lock "cinder-quobyte-5331c1da-5b7f-445b-8832-4f095ad9af27" acquired by "delete_volume" :: waited 0.021s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:58:06 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[639873c2-b925-4de3-af7f-08fa978d6734]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:58:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f1552fcb-b4da-4c6d-9441-8893bdb65886 tempest-SnapshotDependencyTests-1963836203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5331c1da-5b7f-445b-8832-4f095ad9af27 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:06 devstack sudo[106379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5331c1da-5b7f-445b-8832-4f095ad9af27 Sep 04 22:58:06 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:06 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f1552fcb-b4da-4c6d-9441-8893bdb65886 tempest-SnapshotDependencyTests-1963836203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5331c1da-5b7f-445b-8832-4f095ad9af27" returned: 0 in 0.343s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f1552fcb-b4da-4c6d-9441-8893bdb65886 tempest-SnapshotDependencyTests-1963836203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5331c1da-5b7f-445b-8832-4f095ad9af27 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:06 devstack sudo[106384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5331c1da-5b7f-445b-8832-4f095ad9af27 Sep 04 22:58:06 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:06 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f1552fcb-b4da-4c6d-9441-8893bdb65886 tempest-SnapshotDependencyTests-1963836203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5331c1da-5b7f-445b-8832-4f095ad9af27" returned: 0 in 0.249s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:06 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f1552fcb-b4da-4c6d-9441-8893bdb65886 tempest-SnapshotDependencyTests-1963836203 None] Lock "cinder-quobyte-5331c1da-5b7f-445b-8832-4f095ad9af27" released by "delete_volume" :: held 0.631s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:58:06 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-f1552fcb-b4da-4c6d-9441-8893bdb65886 tempest-SnapshotDependencyTests-1963836203 None] Created reservations ['867936a4-2c5f-471d-9e70-28e1c8a4a9ff', 'ca6e59fd-f80f-4f9b-b365-37be8b5a60b1', '8448996b-4ae5-42a2-beb9-455ae699324a', '48167483-056f-4f39-ad58-a83e775bc0f6'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:58:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f1552fcb-b4da-4c6d-9441-8893bdb65886 tempest-SnapshotDependencyTests-1963836203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:58:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f1552fcb-b4da-4c6d-9441-8893bdb65886 tempest-SnapshotDependencyTests-1963836203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:58:07 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-f1552fcb-b4da-4c6d-9441-8893bdb65886 tempest-SnapshotDependencyTests-1963836203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:58:07 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-f1552fcb-b4da-4c6d-9441-8893bdb65886 tempest-SnapshotDependencyTests-1963836203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:58:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f1552fcb-b4da-4c6d-9441-8893bdb65886 tempest-SnapshotDependencyTests-1963836203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:58:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f1552fcb-b4da-4c6d-9441-8893bdb65886 tempest-SnapshotDependencyTests-1963836203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:07 devstack sudo[106387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:58:07 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:07 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f1552fcb-b4da-4c6d-9441-8893bdb65886 tempest-SnapshotDependencyTests-1963836203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.250s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:07 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-f1552fcb-b4da-4c6d-9441-8893bdb65886 tempest-SnapshotDependencyTests-1963836203 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:58:07 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-f1552fcb-b4da-4c6d-9441-8893bdb65886 tempest-SnapshotDependencyTests-1963836203 None] Deleted volume successfully. Sep 04 22:58:07 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f1552fcb-b4da-4c6d-9441-8893bdb65886 tempest-SnapshotDependencyTests-1963836203 None] Lock "cinder-5331c1da-5b7f-445b-8832-4f095ad9af27-delete_volume" released by "delete_volume" :: held 1.078s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:58:11 devstack cinder-volume[87576]: DEBUG oslo_service.periodic_task [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87576) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 22:58:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:58:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:58:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:58:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:58:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:58:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:11 devstack sudo[106393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:58:11 devstack sudo[106393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:12 devstack sudo[106393]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.250s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:12 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:58:12 devstack cinder-volume[87576]: DEBUG oslo_service.periodic_task [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Running periodic task VolumeManager._thread_info {{(pid=87576) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 22:58:12 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] thread count: 28 {{(pid=87576) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 22:58:12 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] thread info: [<_MainThread(MainThread, started 125730416963712)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87576) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 22:58:17 devstack cinder-volume[87576]: DEBUG dbcounter [-] [87576] Writing DB stats cinder:UPDATE=28,cinder:SELECT=28,cinder:DELETE=4,cinder:INSERT=7 {{(pid=87576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 22:58:17 devstack cinder-volume[87576]: DEBUG dbcounter [-] [87576] Writing DB stats cinder:SELECT=22,cinder:UPDATE=31,cinder:INSERT=8,cinder:DELETE=1 {{(pid=87576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 22:58:27 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-a46a716a-04e3-48ff-9dd4-b27672dca460 tempest-CreateVolumesFromImageTest-1083081755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:58:27 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-a46a716a-04e3-48ff-9dd4-b27672dca460 tempest-CreateVolumesFromImageTest-1083081755 None] Flow 'volume_create_manager' (b53b84e8-8ec6-4342-aa90-037d691766dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:58:27 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-a46a716a-04e3-48ff-9dd4-b27672dca460 tempest-CreateVolumesFromImageTest-1083081755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28bef3b1-6bcc-4f72-874c-5d72f65c5352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:27 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-a46a716a-04e3-48ff-9dd4-b27672dca460 tempest-CreateVolumesFromImageTest-1083081755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28bef3b1-6bcc-4f72-874c-5d72f65c5352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:58:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-825145259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22d207d2-9653-4307-9d4b-705916e6db9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c9100f3ab4c4383833f608fafc7703e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:58:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:58:27Z,use_quota=True,user_id='66ac3d0fc74440ad9b5f49945c2e1d02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:27 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-a46a716a-04e3-48ff-9dd4-b27672dca460 tempest-CreateVolumesFromImageTest-1083081755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc9ace15-e613-450b-8a22-021da879015a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:27 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-a46a716a-04e3-48ff-9dd4-b27672dca460 tempest-CreateVolumesFromImageTest-1083081755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc9ace15-e613-450b-8a22-021da879015a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:27 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-a46a716a-04e3-48ff-9dd4-b27672dca460 tempest-CreateVolumesFromImageTest-1083081755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fb66f86-80db-46a4-bc5a-57dc60049c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:27 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-a46a716a-04e3-48ff-9dd4-b27672dca460 tempest-CreateVolumesFromImageTest-1083081755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fb66f86-80db-46a4-bc5a-57dc60049c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22d207d2-9653-4307-9d4b-705916e6db9a', 'volume_name': 'volume-22d207d2-9653-4307-9d4b-705916e6db9a', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:27 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-a46a716a-04e3-48ff-9dd4-b27672dca460 tempest-CreateVolumesFromImageTest-1083081755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5383ff4-0102-4090-baec-065c649c8227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:27 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-a46a716a-04e3-48ff-9dd4-b27672dca460 tempest-CreateVolumesFromImageTest-1083081755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5383ff4-0102-4090-baec-065c649c8227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:27 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-a46a716a-04e3-48ff-9dd4-b27672dca460 tempest-CreateVolumesFromImageTest-1083081755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c85bb2d6-d438-41f8-9400-483880d3eccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:27 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-a46a716a-04e3-48ff-9dd4-b27672dca460 tempest-CreateVolumesFromImageTest-1083081755 None] Volume 22d207d2-9653-4307-9d4b-705916e6db9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22d207d2-9653-4307-9d4b-705916e6db9a', 'volume_size': 1} Sep 04 22:58:27 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-a46a716a-04e3-48ff-9dd4-b27672dca460 tempest-CreateVolumesFromImageTest-1083081755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:58:27 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-a46a716a-04e3-48ff-9dd4-b27672dca460 tempest-CreateVolumesFromImageTest-1083081755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:58:27 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-a46a716a-04e3-48ff-9dd4-b27672dca460 tempest-CreateVolumesFromImageTest-1083081755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:58:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-825145259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22d207d2-9653-4307-9d4b-705916e6db9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c9100f3ab4c4383833f608fafc7703e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:58:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:58:27Z,use_quota=True,user_id='66ac3d0fc74440ad9b5f49945c2e1d02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:58:27 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-a46a716a-04e3-48ff-9dd4-b27672dca460 tempest-CreateVolumesFromImageTest-1083081755 None] Creating volume 22d207d2-9653-4307-9d4b-705916e6db9a {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:58:27 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-a46a716a-04e3-48ff-9dd4-b27672dca460 tempest-CreateVolumesFromImageTest-1083081755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:58:27 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-a46a716a-04e3-48ff-9dd4-b27672dca460 tempest-CreateVolumesFromImageTest-1083081755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:58:27 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-a46a716a-04e3-48ff-9dd4-b27672dca460 tempest-CreateVolumesFromImageTest-1083081755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:58:27 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-a46a716a-04e3-48ff-9dd4-b27672dca460 tempest-CreateVolumesFromImageTest-1083081755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:58:27 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-a46a716a-04e3-48ff-9dd4-b27672dca460 tempest-CreateVolumesFromImageTest-1083081755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:58:27 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-a46a716a-04e3-48ff-9dd4-b27672dca460 tempest-CreateVolumesFromImageTest-1083081755 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:58:27 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-a46a716a-04e3-48ff-9dd4-b27672dca460 tempest-CreateVolumesFromImageTest-1083081755 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:58:27 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a46a716a-04e3-48ff-9dd4-b27672dca460 tempest-CreateVolumesFromImageTest-1083081755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-22d207d2-9653-4307-9d4b-705916e6db9a 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:27 devstack sudo[106437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-22d207d2-9653-4307-9d4b-705916e6db9a 1073741824 Sep 04 22:58:27 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:27 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2215ef6-e45b-49d1-956a-94a552301044 tempest-CinderUnicodeTest-9741368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:58:27 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-c2215ef6-e45b-49d1-956a-94a552301044 tempest-CinderUnicodeTest-9741368 None] Flow 'volume_create_manager' (026bdad3-3e7a-436b-b39e-379027ae67be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:58:27 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-c2215ef6-e45b-49d1-956a-94a552301044 tempest-CinderUnicodeTest-9741368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1404b41b-69dd-4d6d-945c-03f8d00ed9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:27 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-c2215ef6-e45b-49d1-956a-94a552301044 tempest-CinderUnicodeTest-9741368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1404b41b-69dd-4d6d-945c-03f8d00ed9c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:58:27Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd157d7d-8ca3-4358-aa87-1392822b14f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='136891daa8634c5786333ad612e49e15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:58:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:58:28Z,use_quota=True,user_id='54690204c78f4a9dbf67015921ba2973',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:27 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-c2215ef6-e45b-49d1-956a-94a552301044 tempest-CinderUnicodeTest-9741368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5ac9f13-473b-4ea3-b6f0-00339ef62e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:27 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-c2215ef6-e45b-49d1-956a-94a552301044 tempest-CinderUnicodeTest-9741368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5ac9f13-473b-4ea3-b6f0-00339ef62e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:27 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-c2215ef6-e45b-49d1-956a-94a552301044 tempest-CinderUnicodeTest-9741368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21e78dff-060f-4361-8bb8-617469ba2abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:27 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-c2215ef6-e45b-49d1-956a-94a552301044 tempest-CinderUnicodeTest-9741368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21e78dff-060f-4361-8bb8-617469ba2abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd157d7d-8ca3-4358-aa87-1392822b14f7', 'volume_name': 'volume-dd157d7d-8ca3-4358-aa87-1392822b14f7', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:27 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-c2215ef6-e45b-49d1-956a-94a552301044 tempest-CinderUnicodeTest-9741368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4c5cc5e-9149-4a01-b41e-92e620772300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:27 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-c2215ef6-e45b-49d1-956a-94a552301044 tempest-CinderUnicodeTest-9741368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4c5cc5e-9149-4a01-b41e-92e620772300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:27 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-c2215ef6-e45b-49d1-956a-94a552301044 tempest-CinderUnicodeTest-9741368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca15a435-d14d-4024-822e-e765c1508f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:27 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-c2215ef6-e45b-49d1-956a-94a552301044 tempest-CinderUnicodeTest-9741368 None] Volume dd157d7d-8ca3-4358-aa87-1392822b14f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd157d7d-8ca3-4358-aa87-1392822b14f7', 'volume_size': 1} Sep 04 22:58:27 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-c2215ef6-e45b-49d1-956a-94a552301044 tempest-CinderUnicodeTest-9741368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:58:27 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:27 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a46a716a-04e3-48ff-9dd4-b27672dca460 tempest-CreateVolumesFromImageTest-1083081755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-22d207d2-9653-4307-9d4b-705916e6db9a 1073741824" returned: 0 in 0.595s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:27 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a46a716a-04e3-48ff-9dd4-b27672dca460 tempest-CreateVolumesFromImageTest-1083081755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-22d207d2-9653-4307-9d4b-705916e6db9a {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:27 devstack sudo[106443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-22d207d2-9653-4307-9d4b-705916e6db9a Sep 04 22:58:27 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:28 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-51aea96b-747d-43f3-a4de-b56891dfc349 tempest-CreateVolumesFromImageTest-1083081755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:58:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-51aea96b-747d-43f3-a4de-b56891dfc349 tempest-CreateVolumesFromImageTest-1083081755 None] Flow 'volume_create_manager' (db09d560-9215-428f-86fd-981aa7935bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:58:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-51aea96b-747d-43f3-a4de-b56891dfc349 tempest-CreateVolumesFromImageTest-1083081755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fa69ee6-2025-4faf-a210-86e536326aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-51aea96b-747d-43f3-a4de-b56891dfc349 tempest-CreateVolumesFromImageTest-1083081755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fa69ee6-2025-4faf-a210-86e536326aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:58:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1114810606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c88ff913-df84-4ccd-96c0-83db388e35bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c9100f3ab4c4383833f608fafc7703e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:58:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:58:28Z,use_quota=True,user_id='66ac3d0fc74440ad9b5f49945c2e1d02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-51aea96b-747d-43f3-a4de-b56891dfc349 tempest-CreateVolumesFromImageTest-1083081755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b240d42-af74-402f-b087-13e0f48edc76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-51aea96b-747d-43f3-a4de-b56891dfc349 tempest-CreateVolumesFromImageTest-1083081755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b240d42-af74-402f-b087-13e0f48edc76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-51aea96b-747d-43f3-a4de-b56891dfc349 tempest-CreateVolumesFromImageTest-1083081755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e79d9ff2-32ab-4983-bf63-2fbb3f6d8691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-51aea96b-747d-43f3-a4de-b56891dfc349 tempest-CreateVolumesFromImageTest-1083081755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e79d9ff2-32ab-4983-bf63-2fbb3f6d8691) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c88ff913-df84-4ccd-96c0-83db388e35bd', 'volume_name': 'volume-c88ff913-df84-4ccd-96c0-83db388e35bd', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-51aea96b-747d-43f3-a4de-b56891dfc349 tempest-CreateVolumesFromImageTest-1083081755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0138234a-1512-407e-996a-49da543f15b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-51aea96b-747d-43f3-a4de-b56891dfc349 tempest-CreateVolumesFromImageTest-1083081755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0138234a-1512-407e-996a-49da543f15b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-51aea96b-747d-43f3-a4de-b56891dfc349 tempest-CreateVolumesFromImageTest-1083081755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9ff37e8-68e7-4690-a1e3-f95cbd38295f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:28 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-51aea96b-747d-43f3-a4de-b56891dfc349 tempest-CreateVolumesFromImageTest-1083081755 None] Volume c88ff913-df84-4ccd-96c0-83db388e35bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c88ff913-df84-4ccd-96c0-83db388e35bd', 'volume_size': 1} Sep 04 22:58:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-51aea96b-747d-43f3-a4de-b56891dfc349 tempest-CreateVolumesFromImageTest-1083081755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:58:28 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a46a716a-04e3-48ff-9dd4-b27672dca460 tempest-CreateVolumesFromImageTest-1083081755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-22d207d2-9653-4307-9d4b-705916e6db9a" returned: 0 in 0.345s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:28 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-a46a716a-04e3-48ff-9dd4-b27672dca460 tempest-CreateVolumesFromImageTest-1083081755 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:58:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-a46a716a-04e3-48ff-9dd4-b27672dca460 tempest-CreateVolumesFromImageTest-1083081755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:58:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-c2215ef6-e45b-49d1-956a-94a552301044 tempest-CinderUnicodeTest-9741368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.471s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:58:28 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-c2215ef6-e45b-49d1-956a-94a552301044 tempest-CinderUnicodeTest-9741368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:58:27Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd157d7d-8ca3-4358-aa87-1392822b14f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='136891daa8634c5786333ad612e49e15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:58:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:58:28Z,use_quota=True,user_id='54690204c78f4a9dbf67015921ba2973',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:58:28 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-c2215ef6-e45b-49d1-956a-94a552301044 tempest-CinderUnicodeTest-9741368 None] Creating volume dd157d7d-8ca3-4358-aa87-1392822b14f7 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:58:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-c2215ef6-e45b-49d1-956a-94a552301044 tempest-CinderUnicodeTest-9741368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:58:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-c2215ef6-e45b-49d1-956a-94a552301044 tempest-CinderUnicodeTest-9741368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:58:28 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-c2215ef6-e45b-49d1-956a-94a552301044 tempest-CinderUnicodeTest-9741368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:58:28 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-c2215ef6-e45b-49d1-956a-94a552301044 tempest-CinderUnicodeTest-9741368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:58:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-c2215ef6-e45b-49d1-956a-94a552301044 tempest-CinderUnicodeTest-9741368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:58:28 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-c2215ef6-e45b-49d1-956a-94a552301044 tempest-CinderUnicodeTest-9741368 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:58:28 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-c2215ef6-e45b-49d1-956a-94a552301044 tempest-CinderUnicodeTest-9741368 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:58:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c2215ef6-e45b-49d1-956a-94a552301044 tempest-CinderUnicodeTest-9741368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-dd157d7d-8ca3-4358-aa87-1392822b14f7 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-a46a716a-04e3-48ff-9dd4-b27672dca460 tempest-CreateVolumesFromImageTest-1083081755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c85bb2d6-d438-41f8-9400-483880d3eccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22d207d2-9653-4307-9d4b-705916e6db9a', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:28 devstack sudo[106447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-dd157d7d-8ca3-4358-aa87-1392822b14f7 1073741824 Sep 04 22:58:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-a46a716a-04e3-48ff-9dd4-b27672dca460 tempest-CreateVolumesFromImageTest-1083081755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (117b05c1-0ad8-45fc-aeb4-42cb04fe0afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:28 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:28 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-a46a716a-04e3-48ff-9dd4-b27672dca460 tempest-CreateVolumesFromImageTest-1083081755 None] Volume volume-22d207d2-9653-4307-9d4b-705916e6db9a (22d207d2-9653-4307-9d4b-705916e6db9a): created successfully Sep 04 22:58:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-a46a716a-04e3-48ff-9dd4-b27672dca460 tempest-CreateVolumesFromImageTest-1083081755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (117b05c1-0ad8-45fc-aeb4-42cb04fe0afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-a46a716a-04e3-48ff-9dd4-b27672dca460 tempest-CreateVolumesFromImageTest-1083081755 None] Flow 'volume_create_manager' (b53b84e8-8ec6-4342-aa90-037d691766dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:58:28 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7993830-10e6-41fc-8d52-83df79c53fbb tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:58:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-b7993830-10e6-41fc-8d52-83df79c53fbb tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Flow 'volume_create_manager' (a3fb890b-6020-4bce-93fd-f18358d5f213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:58:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-b7993830-10e6-41fc-8d52-83df79c53fbb tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92f77d97-9e80-44e7-9258-b663fe910adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:28 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-a46a716a-04e3-48ff-9dd4-b27672dca460 tempest-CreateVolumesFromImageTest-1083081755 None] Created volume successfully. Sep 04 22:58:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-b7993830-10e6-41fc-8d52-83df79c53fbb tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92f77d97-9e80-44e7-9258-b663fe910adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:58:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1338083695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=443949d2-5678-4a29-ba5a-25d561f016aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3913b24435564094b06cf966a7519108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:58:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:58:28Z,use_quota=True,user_id='037be85aa8164820bb32e122937a8866',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-b7993830-10e6-41fc-8d52-83df79c53fbb tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09561155-103a-420b-9b63-3b00f5119130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-b7993830-10e6-41fc-8d52-83df79c53fbb tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09561155-103a-420b-9b63-3b00f5119130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-b7993830-10e6-41fc-8d52-83df79c53fbb tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0baac1b-0e52-4ebb-a937-1a85f53a3ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-b7993830-10e6-41fc-8d52-83df79c53fbb tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0baac1b-0e52-4ebb-a937-1a85f53a3ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '443949d2-5678-4a29-ba5a-25d561f016aa', 'volume_name': 'volume-443949d2-5678-4a29-ba5a-25d561f016aa', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-b7993830-10e6-41fc-8d52-83df79c53fbb tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32a6dd6f-c6b4-4a2a-903a-44d8cdc27913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-b7993830-10e6-41fc-8d52-83df79c53fbb tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32a6dd6f-c6b4-4a2a-903a-44d8cdc27913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-b7993830-10e6-41fc-8d52-83df79c53fbb tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01fdbdfe-29e2-42ce-a5b2-3a39188845d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:28 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-b7993830-10e6-41fc-8d52-83df79c53fbb tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Volume 443949d2-5678-4a29-ba5a-25d561f016aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-443949d2-5678-4a29-ba5a-25d561f016aa', 'volume_size': 1} Sep 04 22:58:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-b7993830-10e6-41fc-8d52-83df79c53fbb tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:58:28 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-636414f0-7945-48d8-aa88-7176918ae99e tempest-CreateVolumesFromImageTest-1083081755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:58:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-636414f0-7945-48d8-aa88-7176918ae99e tempest-CreateVolumesFromImageTest-1083081755 None] Flow 'volume_create_manager' (1b28d02f-7fb0-4c6e-baec-023623e4e053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:58:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-636414f0-7945-48d8-aa88-7176918ae99e tempest-CreateVolumesFromImageTest-1083081755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8ef4731-68bc-4f68-b832-fff4e83424cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-636414f0-7945-48d8-aa88-7176918ae99e tempest-CreateVolumesFromImageTest-1083081755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8ef4731-68bc-4f68-b832-fff4e83424cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:58:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2063053958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62548790-9c16-4892-8d47-600dd5e66823,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c9100f3ab4c4383833f608fafc7703e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:58:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:58:29Z,use_quota=True,user_id='66ac3d0fc74440ad9b5f49945c2e1d02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-636414f0-7945-48d8-aa88-7176918ae99e tempest-CreateVolumesFromImageTest-1083081755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51f71c23-17ef-466e-a618-68378cb2be1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-636414f0-7945-48d8-aa88-7176918ae99e tempest-CreateVolumesFromImageTest-1083081755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51f71c23-17ef-466e-a618-68378cb2be1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-636414f0-7945-48d8-aa88-7176918ae99e tempest-CreateVolumesFromImageTest-1083081755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (112fb39e-a720-49fa-a584-041253be8d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-636414f0-7945-48d8-aa88-7176918ae99e tempest-CreateVolumesFromImageTest-1083081755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (112fb39e-a720-49fa-a584-041253be8d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62548790-9c16-4892-8d47-600dd5e66823', 'volume_name': 'volume-62548790-9c16-4892-8d47-600dd5e66823', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-636414f0-7945-48d8-aa88-7176918ae99e tempest-CreateVolumesFromImageTest-1083081755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7611459-e3b7-4534-b195-01635da2e8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-636414f0-7945-48d8-aa88-7176918ae99e tempest-CreateVolumesFromImageTest-1083081755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7611459-e3b7-4534-b195-01635da2e8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-636414f0-7945-48d8-aa88-7176918ae99e tempest-CreateVolumesFromImageTest-1083081755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b65fbb62-58d3-4614-b031-81b187457c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:28 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-636414f0-7945-48d8-aa88-7176918ae99e tempest-CreateVolumesFromImageTest-1083081755 None] Volume 62548790-9c16-4892-8d47-600dd5e66823: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62548790-9c16-4892-8d47-600dd5e66823', 'volume_size': 1} Sep 04 22:58:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-636414f0-7945-48d8-aa88-7176918ae99e tempest-CreateVolumesFromImageTest-1083081755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:58:28 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-10fdc54e-28dd-46d9-a33c-50d15cfd604e tempest-CreateVolumesFromImageTest-1083081755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:58:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-10fdc54e-28dd-46d9-a33c-50d15cfd604e tempest-CreateVolumesFromImageTest-1083081755 None] Flow 'volume_create_manager' (9d73cb6b-5351-424c-b22f-e9c4fb98db79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:58:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-10fdc54e-28dd-46d9-a33c-50d15cfd604e tempest-CreateVolumesFromImageTest-1083081755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a076779b-3747-40b7-bc73-e972b266dcb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-10fdc54e-28dd-46d9-a33c-50d15cfd604e tempest-CreateVolumesFromImageTest-1083081755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a076779b-3747-40b7-bc73-e972b266dcb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:58:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-721617330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d6ddb69-e803-4603-bae8-b354edec48bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c9100f3ab4c4383833f608fafc7703e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:58:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:58:29Z,use_quota=True,user_id='66ac3d0fc74440ad9b5f49945c2e1d02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-10fdc54e-28dd-46d9-a33c-50d15cfd604e tempest-CreateVolumesFromImageTest-1083081755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6be3a777-eb58-48bc-b575-3f5fd0962c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-10fdc54e-28dd-46d9-a33c-50d15cfd604e tempest-CreateVolumesFromImageTest-1083081755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6be3a777-eb58-48bc-b575-3f5fd0962c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-10fdc54e-28dd-46d9-a33c-50d15cfd604e tempest-CreateVolumesFromImageTest-1083081755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1376b886-e42d-4c70-8b29-42287827b175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-10fdc54e-28dd-46d9-a33c-50d15cfd604e tempest-CreateVolumesFromImageTest-1083081755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1376b886-e42d-4c70-8b29-42287827b175) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d6ddb69-e803-4603-bae8-b354edec48bb', 'volume_name': 'volume-9d6ddb69-e803-4603-bae8-b354edec48bb', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-10fdc54e-28dd-46d9-a33c-50d15cfd604e tempest-CreateVolumesFromImageTest-1083081755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78fbc8f6-2446-465e-b463-88e2059868dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-10fdc54e-28dd-46d9-a33c-50d15cfd604e tempest-CreateVolumesFromImageTest-1083081755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78fbc8f6-2446-465e-b463-88e2059868dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:29 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-10fdc54e-28dd-46d9-a33c-50d15cfd604e tempest-CreateVolumesFromImageTest-1083081755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f05cc73a-b9c7-46a6-8d2a-a573cb86178a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:29 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-10fdc54e-28dd-46d9-a33c-50d15cfd604e tempest-CreateVolumesFromImageTest-1083081755 None] Volume 9d6ddb69-e803-4603-bae8-b354edec48bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d6ddb69-e803-4603-bae8-b354edec48bb', 'volume_size': 1} Sep 04 22:58:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-10fdc54e-28dd-46d9-a33c-50d15cfd604e tempest-CreateVolumesFromImageTest-1083081755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:58:29 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c2215ef6-e45b-49d1-956a-94a552301044 tempest-CinderUnicodeTest-9741368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-dd157d7d-8ca3-4358-aa87-1392822b14f7 1073741824" returned: 0 in 0.784s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c2215ef6-e45b-49d1-956a-94a552301044 tempest-CinderUnicodeTest-9741368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-dd157d7d-8ca3-4358-aa87-1392822b14f7 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:29 devstack sudo[106454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-dd157d7d-8ca3-4358-aa87-1392822b14f7 Sep 04 22:58:29 devstack sudo[106454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:29 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca63ce91-d139-4687-a53a-a7c3dbb07f77 tempest-CreateVolumesFromImageTest-1083081755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:58:29 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-ca63ce91-d139-4687-a53a-a7c3dbb07f77 tempest-CreateVolumesFromImageTest-1083081755 None] Flow 'volume_create_manager' (c47f0b0e-b736-455f-9d85-5f908fd59171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:58:29 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-ca63ce91-d139-4687-a53a-a7c3dbb07f77 tempest-CreateVolumesFromImageTest-1083081755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d016e95-3904-4d3a-98ca-77d9b9fbfdf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:29 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-ca63ce91-d139-4687-a53a-a7c3dbb07f77 tempest-CreateVolumesFromImageTest-1083081755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d016e95-3904-4d3a-98ca-77d9b9fbfdf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:58:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1099521041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eca3d4e-f5d7-44b4-9688-5e20b0f199a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c9100f3ab4c4383833f608fafc7703e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:58:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:58:29Z,use_quota=True,user_id='66ac3d0fc74440ad9b5f49945c2e1d02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:29 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-ca63ce91-d139-4687-a53a-a7c3dbb07f77 tempest-CreateVolumesFromImageTest-1083081755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2495ddaf-b5cf-42f7-90b0-b5a77426878a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:29 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-ca63ce91-d139-4687-a53a-a7c3dbb07f77 tempest-CreateVolumesFromImageTest-1083081755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2495ddaf-b5cf-42f7-90b0-b5a77426878a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:29 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-ca63ce91-d139-4687-a53a-a7c3dbb07f77 tempest-CreateVolumesFromImageTest-1083081755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0447af35-9342-4e76-a411-34c7150bbadd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:29 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-ca63ce91-d139-4687-a53a-a7c3dbb07f77 tempest-CreateVolumesFromImageTest-1083081755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0447af35-9342-4e76-a411-34c7150bbadd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9eca3d4e-f5d7-44b4-9688-5e20b0f199a1', 'volume_name': 'volume-9eca3d4e-f5d7-44b4-9688-5e20b0f199a1', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:29 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-ca63ce91-d139-4687-a53a-a7c3dbb07f77 tempest-CreateVolumesFromImageTest-1083081755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (891a5210-84c3-4dd4-a2c9-79708908621d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:29 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-ca63ce91-d139-4687-a53a-a7c3dbb07f77 tempest-CreateVolumesFromImageTest-1083081755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (891a5210-84c3-4dd4-a2c9-79708908621d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:29 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-ca63ce91-d139-4687-a53a-a7c3dbb07f77 tempest-CreateVolumesFromImageTest-1083081755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38a4eaa7-172e-4849-8e2c-0b90cd1606c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:29 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-ca63ce91-d139-4687-a53a-a7c3dbb07f77 tempest-CreateVolumesFromImageTest-1083081755 None] Volume 9eca3d4e-f5d7-44b4-9688-5e20b0f199a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9eca3d4e-f5d7-44b4-9688-5e20b0f199a1', 'volume_size': 1} Sep 04 22:58:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-ca63ce91-d139-4687-a53a-a7c3dbb07f77 tempest-CreateVolumesFromImageTest-1083081755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:58:29 devstack sudo[106454]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c2215ef6-e45b-49d1-956a-94a552301044 tempest-CinderUnicodeTest-9741368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-dd157d7d-8ca3-4358-aa87-1392822b14f7" returned: 0 in 0.282s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:29 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-c2215ef6-e45b-49d1-956a-94a552301044 tempest-CinderUnicodeTest-9741368 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:58:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-c2215ef6-e45b-49d1-956a-94a552301044 tempest-CinderUnicodeTest-9741368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:58:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-51aea96b-747d-43f3-a4de-b56891dfc349 tempest-CreateVolumesFromImageTest-1083081755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.162s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:58:29 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-51aea96b-747d-43f3-a4de-b56891dfc349 tempest-CreateVolumesFromImageTest-1083081755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:58:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1114810606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c88ff913-df84-4ccd-96c0-83db388e35bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c9100f3ab4c4383833f608fafc7703e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:58:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:58:28Z,use_quota=True,user_id='66ac3d0fc74440ad9b5f49945c2e1d02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:58:29 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-51aea96b-747d-43f3-a4de-b56891dfc349 tempest-CreateVolumesFromImageTest-1083081755 None] Creating volume c88ff913-df84-4ccd-96c0-83db388e35bd {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:58:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-51aea96b-747d-43f3-a4de-b56891dfc349 tempest-CreateVolumesFromImageTest-1083081755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:58:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-51aea96b-747d-43f3-a4de-b56891dfc349 tempest-CreateVolumesFromImageTest-1083081755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:58:29 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-51aea96b-747d-43f3-a4de-b56891dfc349 tempest-CreateVolumesFromImageTest-1083081755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:58:29 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-51aea96b-747d-43f3-a4de-b56891dfc349 tempest-CreateVolumesFromImageTest-1083081755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:58:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-51aea96b-747d-43f3-a4de-b56891dfc349 tempest-CreateVolumesFromImageTest-1083081755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:58:29 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-51aea96b-747d-43f3-a4de-b56891dfc349 tempest-CreateVolumesFromImageTest-1083081755 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:58:29 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-51aea96b-747d-43f3-a4de-b56891dfc349 tempest-CreateVolumesFromImageTest-1083081755 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:58:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-51aea96b-747d-43f3-a4de-b56891dfc349 tempest-CreateVolumesFromImageTest-1083081755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c88ff913-df84-4ccd-96c0-83db388e35bd 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:29 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-c2215ef6-e45b-49d1-956a-94a552301044 tempest-CinderUnicodeTest-9741368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca15a435-d14d-4024-822e-e765c1508f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd157d7d-8ca3-4358-aa87-1392822b14f7', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:29 devstack sudo[106457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c88ff913-df84-4ccd-96c0-83db388e35bd 1073741824 Sep 04 22:58:29 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:29 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-c2215ef6-e45b-49d1-956a-94a552301044 tempest-CinderUnicodeTest-9741368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1928ee68-f7bc-400d-86c7-21235e8f6986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:29 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-c2215ef6-e45b-49d1-956a-94a552301044 tempest-CinderUnicodeTest-9741368 None] Volume volume-dd157d7d-8ca3-4358-aa87-1392822b14f7 (dd157d7d-8ca3-4358-aa87-1392822b14f7): created successfully Sep 04 22:58:29 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-c2215ef6-e45b-49d1-956a-94a552301044 tempest-CinderUnicodeTest-9741368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1928ee68-f7bc-400d-86c7-21235e8f6986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:29 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-c2215ef6-e45b-49d1-956a-94a552301044 tempest-CinderUnicodeTest-9741368 None] Flow 'volume_create_manager' (026bdad3-3e7a-436b-b39e-379027ae67be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:58:29 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-c2215ef6-e45b-49d1-956a-94a552301044 tempest-CinderUnicodeTest-9741368 None] Created volume successfully. Sep 04 22:58:29 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-51aea96b-747d-43f3-a4de-b56891dfc349 tempest-CreateVolumesFromImageTest-1083081755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c88ff913-df84-4ccd-96c0-83db388e35bd 1073741824" returned: 0 in 0.514s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-51aea96b-747d-43f3-a4de-b56891dfc349 tempest-CreateVolumesFromImageTest-1083081755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c88ff913-df84-4ccd-96c0-83db388e35bd {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:29 devstack sudo[106462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c88ff913-df84-4ccd-96c0-83db388e35bd Sep 04 22:58:29 devstack sudo[106462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:30 devstack sudo[106462]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:30 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-24022f49-004a-4bb7-8ef5-49e5ea7df20e tempest-CinderUnicodeTest-9741368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:58:30 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-24022f49-004a-4bb7-8ef5-49e5ea7df20e tempest-CinderUnicodeTest-9741368 None] Flow 'volume_create_manager' (8b8e4604-9f2f-49af-b359-acb80ec2964c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:58:30 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-24022f49-004a-4bb7-8ef5-49e5ea7df20e tempest-CinderUnicodeTest-9741368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (647f6d92-e685-462e-ae15-1fb47734106c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-51aea96b-747d-43f3-a4de-b56891dfc349 tempest-CreateVolumesFromImageTest-1083081755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c88ff913-df84-4ccd-96c0-83db388e35bd" returned: 0 in 0.328s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:30 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-51aea96b-747d-43f3-a4de-b56891dfc349 tempest-CreateVolumesFromImageTest-1083081755 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:58:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-51aea96b-747d-43f3-a4de-b56891dfc349 tempest-CreateVolumesFromImageTest-1083081755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:58:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-b7993830-10e6-41fc-8d52-83df79c53fbb tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.647s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:58:30 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-b7993830-10e6-41fc-8d52-83df79c53fbb tempest-CreateVolumesFromSourceVolumeTest-649217495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:58:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1338083695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=443949d2-5678-4a29-ba5a-25d561f016aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3913b24435564094b06cf966a7519108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:58:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:58:28Z,use_quota=True,user_id='037be85aa8164820bb32e122937a8866',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:58:30 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-b7993830-10e6-41fc-8d52-83df79c53fbb tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Creating volume 443949d2-5678-4a29-ba5a-25d561f016aa {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:58:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-b7993830-10e6-41fc-8d52-83df79c53fbb tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:58:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-b7993830-10e6-41fc-8d52-83df79c53fbb tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:58:30 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-b7993830-10e6-41fc-8d52-83df79c53fbb tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:58:30 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-b7993830-10e6-41fc-8d52-83df79c53fbb tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:58:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-b7993830-10e6-41fc-8d52-83df79c53fbb tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:58:30 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-b7993830-10e6-41fc-8d52-83df79c53fbb tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:58:30 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-b7993830-10e6-41fc-8d52-83df79c53fbb tempest-CreateVolumesFromSourceVolumeTest-649217495 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:58:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b7993830-10e6-41fc-8d52-83df79c53fbb tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-443949d2-5678-4a29-ba5a-25d561f016aa 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:30 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-24022f49-004a-4bb7-8ef5-49e5ea7df20e tempest-CinderUnicodeTest-9741368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (647f6d92-e685-462e-ae15-1fb47734106c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:58:30Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-313767958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42ec3740-81ed-44ad-9838-132407513835,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='136891daa8634c5786333ad612e49e15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:58:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:58:30Z,use_quota=True,user_id='54690204c78f4a9dbf67015921ba2973',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:30 devstack sudo[106465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-443949d2-5678-4a29-ba5a-25d561f016aa 1073741824 Sep 04 22:58:30 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:30 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-24022f49-004a-4bb7-8ef5-49e5ea7df20e tempest-CinderUnicodeTest-9741368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c25752e0-721a-47d1-85ba-84fd33d85fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:30 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-24022f49-004a-4bb7-8ef5-49e5ea7df20e tempest-CinderUnicodeTest-9741368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c25752e0-721a-47d1-85ba-84fd33d85fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:30 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-24022f49-004a-4bb7-8ef5-49e5ea7df20e tempest-CinderUnicodeTest-9741368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f138f2b-ef88-44e9-9536-a656885fabdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:30 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-24022f49-004a-4bb7-8ef5-49e5ea7df20e tempest-CinderUnicodeTest-9741368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f138f2b-ef88-44e9-9536-a656885fabdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42ec3740-81ed-44ad-9838-132407513835', 'volume_name': 'volume-42ec3740-81ed-44ad-9838-132407513835', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:30 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-24022f49-004a-4bb7-8ef5-49e5ea7df20e tempest-CinderUnicodeTest-9741368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68f8828c-e1cd-474d-993a-2c8e2a6a303f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:30 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-24022f49-004a-4bb7-8ef5-49e5ea7df20e tempest-CinderUnicodeTest-9741368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68f8828c-e1cd-474d-993a-2c8e2a6a303f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:30 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-24022f49-004a-4bb7-8ef5-49e5ea7df20e tempest-CinderUnicodeTest-9741368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64ac2245-b828-4cbf-b76f-b6dc52f3bc18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:30 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-24022f49-004a-4bb7-8ef5-49e5ea7df20e tempest-CinderUnicodeTest-9741368 None] Volume 42ec3740-81ed-44ad-9838-132407513835: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42ec3740-81ed-44ad-9838-132407513835', 'volume_size': 1} Sep 04 22:58:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-24022f49-004a-4bb7-8ef5-49e5ea7df20e tempest-CinderUnicodeTest-9741368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:58:30 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-51aea96b-747d-43f3-a4de-b56891dfc349 tempest-CreateVolumesFromImageTest-1083081755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9ff37e8-68e7-4690-a1e3-f95cbd38295f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c88ff913-df84-4ccd-96c0-83db388e35bd', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:30 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-51aea96b-747d-43f3-a4de-b56891dfc349 tempest-CreateVolumesFromImageTest-1083081755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37fd6193-ee72-4a09-a52d-84e14aff9f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:30 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-51aea96b-747d-43f3-a4de-b56891dfc349 tempest-CreateVolumesFromImageTest-1083081755 None] Volume volume-c88ff913-df84-4ccd-96c0-83db388e35bd (c88ff913-df84-4ccd-96c0-83db388e35bd): created successfully Sep 04 22:58:30 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-51aea96b-747d-43f3-a4de-b56891dfc349 tempest-CreateVolumesFromImageTest-1083081755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37fd6193-ee72-4a09-a52d-84e14aff9f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:30 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-51aea96b-747d-43f3-a4de-b56891dfc349 tempest-CreateVolumesFromImageTest-1083081755 None] Flow 'volume_create_manager' (db09d560-9215-428f-86fd-981aa7935bc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:58:30 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-51aea96b-747d-43f3-a4de-b56891dfc349 tempest-CreateVolumesFromImageTest-1083081755 None] Created volume successfully. Sep 04 22:58:30 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b7993830-10e6-41fc-8d52-83df79c53fbb tempest-CreateVolumesFromSourceVolumeTest-649217495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-443949d2-5678-4a29-ba5a-25d561f016aa 1073741824" returned: 0 in 0.440s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b7993830-10e6-41fc-8d52-83df79c53fbb tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-443949d2-5678-4a29-ba5a-25d561f016aa {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:30 devstack sudo[106471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-443949d2-5678-4a29-ba5a-25d561f016aa Sep 04 22:58:30 devstack sudo[106471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:30 devstack sudo[106471]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b7993830-10e6-41fc-8d52-83df79c53fbb tempest-CreateVolumesFromSourceVolumeTest-649217495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-443949d2-5678-4a29-ba5a-25d561f016aa" returned: 0 in 0.248s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:30 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-b7993830-10e6-41fc-8d52-83df79c53fbb tempest-CreateVolumesFromSourceVolumeTest-649217495 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:58:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-b7993830-10e6-41fc-8d52-83df79c53fbb tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:58:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-636414f0-7945-48d8-aa88-7176918ae99e tempest-CreateVolumesFromImageTest-1083081755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.117s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:58:30 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-636414f0-7945-48d8-aa88-7176918ae99e tempest-CreateVolumesFromImageTest-1083081755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:58:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2063053958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62548790-9c16-4892-8d47-600dd5e66823,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c9100f3ab4c4383833f608fafc7703e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:58:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:58:29Z,use_quota=True,user_id='66ac3d0fc74440ad9b5f49945c2e1d02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:58:30 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-636414f0-7945-48d8-aa88-7176918ae99e tempest-CreateVolumesFromImageTest-1083081755 None] Creating volume 62548790-9c16-4892-8d47-600dd5e66823 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:58:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-636414f0-7945-48d8-aa88-7176918ae99e tempest-CreateVolumesFromImageTest-1083081755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:58:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-636414f0-7945-48d8-aa88-7176918ae99e tempest-CreateVolumesFromImageTest-1083081755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:58:30 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-636414f0-7945-48d8-aa88-7176918ae99e tempest-CreateVolumesFromImageTest-1083081755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:58:31 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-636414f0-7945-48d8-aa88-7176918ae99e tempest-CreateVolumesFromImageTest-1083081755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:58:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-636414f0-7945-48d8-aa88-7176918ae99e tempest-CreateVolumesFromImageTest-1083081755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:58:31 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-636414f0-7945-48d8-aa88-7176918ae99e tempest-CreateVolumesFromImageTest-1083081755 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:58:31 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-636414f0-7945-48d8-aa88-7176918ae99e tempest-CreateVolumesFromImageTest-1083081755 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:58:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-636414f0-7945-48d8-aa88-7176918ae99e tempest-CreateVolumesFromImageTest-1083081755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-62548790-9c16-4892-8d47-600dd5e66823 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:31 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-b7993830-10e6-41fc-8d52-83df79c53fbb tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01fdbdfe-29e2-42ce-a5b2-3a39188845d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-443949d2-5678-4a29-ba5a-25d561f016aa', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:31 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-b7993830-10e6-41fc-8d52-83df79c53fbb tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d12dde3f-fb01-4ffb-a67d-29faf278ac72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:31 devstack sudo[106474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-62548790-9c16-4892-8d47-600dd5e66823 1073741824 Sep 04 22:58:31 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:31 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-b7993830-10e6-41fc-8d52-83df79c53fbb tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Volume volume-443949d2-5678-4a29-ba5a-25d561f016aa (443949d2-5678-4a29-ba5a-25d561f016aa): created successfully Sep 04 22:58:31 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-b7993830-10e6-41fc-8d52-83df79c53fbb tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d12dde3f-fb01-4ffb-a67d-29faf278ac72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:31 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-b7993830-10e6-41fc-8d52-83df79c53fbb tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Flow 'volume_create_manager' (a3fb890b-6020-4bce-93fd-f18358d5f213) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:58:31 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-b7993830-10e6-41fc-8d52-83df79c53fbb tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Created volume successfully. Sep 04 22:58:31 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:58:31 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] Flow 'volume_create_manager' (0de5a38f-3cfc-477c-8c24-2a06e50326ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:58:31 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea1f630c-ef45-40ac-ae6f-8b4c300eeb81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:31 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea1f630c-ef45-40ac-ae6f-8b4c300eeb81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:58:31Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7da10008-72e3-4b46-8ca9-f2c1909c1239,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d176668d70e4496ba3c03b309f70dc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:58:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:58:31Z,use_quota=True,user_id='d8efa80b9f9b4eae8afcc613a7359195',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f92aba62-3bd4-4ac5-a036-96952ed3743d),volume_type_id=f92aba62-3bd4-4ac5-a036-96952ed3743d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:31 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66a1d121-556e-4cdb-b897-d947883cd0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:31 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66a1d121-556e-4cdb-b897-d947883cd0b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:31 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d95a7768-ee39-4136-b992-48c99587ca9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:31 devstack cinder-volume[87576]: DEBUG cinder.image.glance [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] Creating Keystone auth plugin from conf {{(pid=87576) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 04 22:58:31 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-636414f0-7945-48d8-aa88-7176918ae99e tempest-CreateVolumesFromImageTest-1083081755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-62548790-9c16-4892-8d47-600dd5e66823 1073741824" returned: 0 in 0.488s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-636414f0-7945-48d8-aa88-7176918ae99e tempest-CreateVolumesFromImageTest-1083081755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-62548790-9c16-4892-8d47-600dd5e66823 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:31 devstack sudo[106480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-62548790-9c16-4892-8d47-600dd5e66823 Sep 04 22:58:31 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:31 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d95a7768-ee39-4136-b992-48c99587ca9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7da10008-72e3-4b46-8ca9-f2c1909c1239', 'volume_name': 'volume-7da10008-72e3-4b46-8ca9-f2c1909c1239', 'volume_size': 1, 'image_id': '93765a35-6312-41bf-aaa6-a4b7c6d4ffa7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/93765a35-6312-41bf-aaa6-a4b7c6d4ffa7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5fc79dc18cbababafcf6e75ebd0abdbc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1d176668d70e4496ba3c03b309f70dc2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3e1311287d1c04fcb907ec0a5ff5652c8da966f93e7714d33aa76d0d2919fa94cfaadb7e88d9cf49c8d93c6a97772b5e6d8e1cc98bf3e930e3cd6481aacc4ca4', 'id': '93765a35-6312-41bf-aaa6-a4b7c6d4ffa7', 'created_at': datetime.datetime(2026, 9, 4, 20, 58, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 20, 58, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/93765a35-6312-41bf-aaa6-a4b7c6d4ffa7/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:31 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffc8c91d-8b18-4ecb-bf59-de14388fefe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:31 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffc8c91d-8b18-4ecb-bf59-de14388fefe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:31 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1e22855-fe3a-4317-b665-101f2e9bd223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:31 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] Volume 7da10008-72e3-4b46-8ca9-f2c1909c1239: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7da10008-72e3-4b46-8ca9-f2c1909c1239', 'volume_size': 1, 'image_id': '93765a35-6312-41bf-aaa6-a4b7c6d4ffa7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/93765a35-6312-41bf-aaa6-a4b7c6d4ffa7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5fc79dc18cbababafcf6e75ebd0abdbc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1d176668d70e4496ba3c03b309f70dc2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3e1311287d1c04fcb907ec0a5ff5652c8da966f93e7714d33aa76d0d2919fa94cfaadb7e88d9cf49c8d93c6a97772b5e6d8e1cc98bf3e930e3cd6481aacc4ca4', 'id': '93765a35-6312-41bf-aaa6-a4b7c6d4ffa7', 'created_at': datetime.datetime(2026, 9, 4, 20, 58, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 20, 58, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/93765a35-6312-41bf-aaa6-a4b7c6d4ffa7/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 04 22:58:31 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] Trying to clone 7da10008-72e3-4b46-8ca9-f2c1909c1239 from image 93765a35-6312-41bf-aaa6-a4b7c6d4ffa7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/93765a35-6312-41bf-aaa6-a4b7c6d4ffa7', 'metadata': {}}]). {{(pid=87576) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 04 22:58:31 devstack cinder-volume[87576]: DEBUG cinder.image.image_utils [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_93765a35-6312-41bf-aaa6-a4b7c6d4ffa7_sd_t6lp0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87576) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 04 22:58:31 devstack cinder-volume[87576]: INFO cinder.image.image_utils [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] Image download 0.00 MB at 0.00 MB/s Sep 04 22:58:31 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8bf3b2-9033-47a9-8fab-a45eeed1bf17]: (4, 'raw') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:58:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_93765a35-6312-41bf-aaa6-a4b7c6d4ffa7_sd_t6lp0devstack@QuobyteHD {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:31 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-636414f0-7945-48d8-aa88-7176918ae99e tempest-CreateVolumesFromImageTest-1083081755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-62548790-9c16-4892-8d47-600dd5e66823" returned: 0 in 0.277s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:31 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-636414f0-7945-48d8-aa88-7176918ae99e tempest-CreateVolumesFromImageTest-1083081755 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:58:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-636414f0-7945-48d8-aa88-7176918ae99e tempest-CreateVolumesFromImageTest-1083081755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:58:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-10fdc54e-28dd-46d9-a33c-50d15cfd604e tempest-CreateVolumesFromImageTest-1083081755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.806s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:58:31 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-10fdc54e-28dd-46d9-a33c-50d15cfd604e tempest-CreateVolumesFromImageTest-1083081755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:58:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-721617330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d6ddb69-e803-4603-bae8-b354edec48bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c9100f3ab4c4383833f608fafc7703e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:58:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:58:29Z,use_quota=True,user_id='66ac3d0fc74440ad9b5f49945c2e1d02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:58:31 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-10fdc54e-28dd-46d9-a33c-50d15cfd604e tempest-CreateVolumesFromImageTest-1083081755 None] Creating volume 9d6ddb69-e803-4603-bae8-b354edec48bb {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:58:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-10fdc54e-28dd-46d9-a33c-50d15cfd604e tempest-CreateVolumesFromImageTest-1083081755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:58:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-10fdc54e-28dd-46d9-a33c-50d15cfd604e tempest-CreateVolumesFromImageTest-1083081755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:58:31 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-10fdc54e-28dd-46d9-a33c-50d15cfd604e tempest-CreateVolumesFromImageTest-1083081755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:58:31 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-10fdc54e-28dd-46d9-a33c-50d15cfd604e tempest-CreateVolumesFromImageTest-1083081755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:58:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-10fdc54e-28dd-46d9-a33c-50d15cfd604e tempest-CreateVolumesFromImageTest-1083081755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:58:31 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-10fdc54e-28dd-46d9-a33c-50d15cfd604e tempest-CreateVolumesFromImageTest-1083081755 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:58:31 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-10fdc54e-28dd-46d9-a33c-50d15cfd604e tempest-CreateVolumesFromImageTest-1083081755 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:58:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-10fdc54e-28dd-46d9-a33c-50d15cfd604e tempest-CreateVolumesFromImageTest-1083081755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9d6ddb69-e803-4603-bae8-b354edec48bb 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:31 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-636414f0-7945-48d8-aa88-7176918ae99e tempest-CreateVolumesFromImageTest-1083081755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b65fbb62-58d3-4614-b031-81b187457c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62548790-9c16-4892-8d47-600dd5e66823', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:31 devstack sudo[106484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9d6ddb69-e803-4603-bae8-b354edec48bb 1073741824 Sep 04 22:58:31 devstack sudo[106484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:31 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-636414f0-7945-48d8-aa88-7176918ae99e tempest-CreateVolumesFromImageTest-1083081755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26f79ba3-1625-4c21-ba88-b12e4684ad4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:31 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-636414f0-7945-48d8-aa88-7176918ae99e tempest-CreateVolumesFromImageTest-1083081755 None] Volume volume-62548790-9c16-4892-8d47-600dd5e66823 (62548790-9c16-4892-8d47-600dd5e66823): created successfully Sep 04 22:58:31 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-636414f0-7945-48d8-aa88-7176918ae99e tempest-CreateVolumesFromImageTest-1083081755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26f79ba3-1625-4c21-ba88-b12e4684ad4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:31 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-636414f0-7945-48d8-aa88-7176918ae99e tempest-CreateVolumesFromImageTest-1083081755 None] Flow 'volume_create_manager' (1b28d02f-7fb0-4c6e-baec-023623e4e053) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:58:31 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-636414f0-7945-48d8-aa88-7176918ae99e tempest-CreateVolumesFromImageTest-1083081755 None] Created volume successfully. Sep 04 22:58:31 devstack sudo[106483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_93765a35-6312-41bf-aaa6-a4b7c6d4ffa7_sd_t6lp0devstack@QuobyteHD Sep 04 22:58:31 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:32 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:32 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_93765a35-6312-41bf-aaa6-a4b7c6d4ffa7_sd_t6lp0devstack@QuobyteHD" returned: 0 in 0.364s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:32 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_93765a35-6312-41bf-aaa6-a4b7c6d4ffa7_sd_t6lp0devstack@QuobyteHD {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:32 devstack sudo[106493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_93765a35-6312-41bf-aaa6-a4b7c6d4ffa7_sd_t6lp0devstack@QuobyteHD Sep 04 22:58:32 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:32 devstack sudo[106484]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:32 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-10fdc54e-28dd-46d9-a33c-50d15cfd604e tempest-CreateVolumesFromImageTest-1083081755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9d6ddb69-e803-4603-bae8-b354edec48bb 1073741824" returned: 0 in 0.484s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:32 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-10fdc54e-28dd-46d9-a33c-50d15cfd604e tempest-CreateVolumesFromImageTest-1083081755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9d6ddb69-e803-4603-bae8-b354edec48bb {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:32 devstack sudo[106495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9d6ddb69-e803-4603-bae8-b354edec48bb Sep 04 22:58:32 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:32 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:32 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_93765a35-6312-41bf-aaa6-a4b7c6d4ffa7_sd_t6lp0devstack@QuobyteHD" returned: 1 in 0.491s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:32 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_93765a35-6312-41bf-aaa6-a4b7c6d4ffa7_sd_t6lp0devstack@QuobyteHD' failed. Not Retrying. {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 22:58:32 devstack cinder-volume[87576]: DEBUG cinder.image.image_utils [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] Temporary image 93765a35-6312-41bf-aaa6-a4b7c6d4ffa7 is fetched for user d8efa80b9f9b4eae8afcc613a7359195. {{(pid=87576) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 04 22:58:32 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:32 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-10fdc54e-28dd-46d9-a33c-50d15cfd604e tempest-CreateVolumesFromImageTest-1083081755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9d6ddb69-e803-4603-bae8-b354edec48bb" returned: 0 in 0.311s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:32 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-10fdc54e-28dd-46d9-a33c-50d15cfd604e tempest-CreateVolumesFromImageTest-1083081755 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:58:32 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-10fdc54e-28dd-46d9-a33c-50d15cfd604e tempest-CreateVolumesFromImageTest-1083081755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:58:32 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-ca63ce91-d139-4687-a53a-a7c3dbb07f77 tempest-CreateVolumesFromImageTest-1083081755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.343s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:58:32 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-ca63ce91-d139-4687-a53a-a7c3dbb07f77 tempest-CreateVolumesFromImageTest-1083081755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:58:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1099521041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eca3d4e-f5d7-44b4-9688-5e20b0f199a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c9100f3ab4c4383833f608fafc7703e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:58:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:58:29Z,use_quota=True,user_id='66ac3d0fc74440ad9b5f49945c2e1d02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:58:32 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-ca63ce91-d139-4687-a53a-a7c3dbb07f77 tempest-CreateVolumesFromImageTest-1083081755 None] Creating volume 9eca3d4e-f5d7-44b4-9688-5e20b0f199a1 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:58:32 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-ca63ce91-d139-4687-a53a-a7c3dbb07f77 tempest-CreateVolumesFromImageTest-1083081755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:58:32 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-ca63ce91-d139-4687-a53a-a7c3dbb07f77 tempest-CreateVolumesFromImageTest-1083081755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:58:32 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-ca63ce91-d139-4687-a53a-a7c3dbb07f77 tempest-CreateVolumesFromImageTest-1083081755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:58:32 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-ca63ce91-d139-4687-a53a-a7c3dbb07f77 tempest-CreateVolumesFromImageTest-1083081755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:58:32 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-ca63ce91-d139-4687-a53a-a7c3dbb07f77 tempest-CreateVolumesFromImageTest-1083081755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:58:32 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-ca63ce91-d139-4687-a53a-a7c3dbb07f77 tempest-CreateVolumesFromImageTest-1083081755 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:58:32 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-ca63ce91-d139-4687-a53a-a7c3dbb07f77 tempest-CreateVolumesFromImageTest-1083081755 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:58:32 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ca63ce91-d139-4687-a53a-a7c3dbb07f77 tempest-CreateVolumesFromImageTest-1083081755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9eca3d4e-f5d7-44b4-9688-5e20b0f199a1 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:32 devstack sudo[106501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9eca3d4e-f5d7-44b4-9688-5e20b0f199a1 1073741824 Sep 04 22:58:32 devstack sudo[106501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:32 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-10fdc54e-28dd-46d9-a33c-50d15cfd604e tempest-CreateVolumesFromImageTest-1083081755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f05cc73a-b9c7-46a6-8d2a-a573cb86178a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d6ddb69-e803-4603-bae8-b354edec48bb', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:32 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-10fdc54e-28dd-46d9-a33c-50d15cfd604e tempest-CreateVolumesFromImageTest-1083081755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f9ecbf6-ca44-4271-894b-8493fcd7a1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:32 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-772ca971-9daf-40ca-8358-bdec5c41ba38 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:58:32 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-772ca971-9daf-40ca-8358-bdec5c41ba38 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Flow 'volume_create_manager' (0bc3bf30-a010-4fef-b9a0-6e84da3b253d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:58:32 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-772ca971-9daf-40ca-8358-bdec5c41ba38 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0678c431-9167-416a-a176-66a008dc7777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:32 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-10fdc54e-28dd-46d9-a33c-50d15cfd604e tempest-CreateVolumesFromImageTest-1083081755 None] Volume volume-9d6ddb69-e803-4603-bae8-b354edec48bb (9d6ddb69-e803-4603-bae8-b354edec48bb): created successfully Sep 04 22:58:32 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-10fdc54e-28dd-46d9-a33c-50d15cfd604e tempest-CreateVolumesFromImageTest-1083081755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f9ecbf6-ca44-4271-894b-8493fcd7a1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:32 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-10fdc54e-28dd-46d9-a33c-50d15cfd604e tempest-CreateVolumesFromImageTest-1083081755 None] Flow 'volume_create_manager' (9d73cb6b-5351-424c-b22f-e9c4fb98db79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:58:32 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-772ca971-9daf-40ca-8358-bdec5c41ba38 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0678c431-9167-416a-a176-66a008dc7777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:58:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2090089057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2315f5e-3875-4ac7-a576-d32dec034d16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3913b24435564094b06cf966a7519108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:58:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:58:33Z,use_quota=True,user_id='037be85aa8164820bb32e122937a8866',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:32 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-772ca971-9daf-40ca-8358-bdec5c41ba38 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71c9a6f3-5254-4c4e-bb0f-77d993e0324c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:32 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-772ca971-9daf-40ca-8358-bdec5c41ba38 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71c9a6f3-5254-4c4e-bb0f-77d993e0324c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:32 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-772ca971-9daf-40ca-8358-bdec5c41ba38 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ca5b3eb-17b4-4b5f-be43-302a87bd121b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:32 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-772ca971-9daf-40ca-8358-bdec5c41ba38 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ca5b3eb-17b4-4b5f-be43-302a87bd121b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2315f5e-3875-4ac7-a576-d32dec034d16', 'volume_name': 'volume-a2315f5e-3875-4ac7-a576-d32dec034d16', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:32 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-772ca971-9daf-40ca-8358-bdec5c41ba38 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a75d86b-3e06-4d17-a78b-b927e8e83a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:32 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-772ca971-9daf-40ca-8358-bdec5c41ba38 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a75d86b-3e06-4d17-a78b-b927e8e83a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:32 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-772ca971-9daf-40ca-8358-bdec5c41ba38 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7eecc9b-9235-4c55-a437-fb06ba5d00b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:32 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-772ca971-9daf-40ca-8358-bdec5c41ba38 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Volume a2315f5e-3875-4ac7-a576-d32dec034d16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2315f5e-3875-4ac7-a576-d32dec034d16', 'volume_size': 1} Sep 04 22:58:32 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-772ca971-9daf-40ca-8358-bdec5c41ba38 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:58:32 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-10fdc54e-28dd-46d9-a33c-50d15cfd604e tempest-CreateVolumesFromImageTest-1083081755 None] Created volume successfully. Sep 04 22:58:33 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22be876-790f-4d38-9d09-acb71295ab95]: (4, 'raw') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:58:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_93765a35-6312-41bf-aaa6-a4b7c6d4ffa7_sd_t6lp0devstack@QuobyteHD {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:33 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce524978-2244-4331-bd25-d75f2dd22141 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:58:33 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-ce524978-2244-4331-bd25-d75f2dd22141 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Flow 'volume_create_manager' (ea1304ec-3396-4815-831f-fa9de42dee94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:58:33 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-ce524978-2244-4331-bd25-d75f2dd22141 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaeff090-330b-4cbe-a618-ed95e0e9194a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:33 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-ce524978-2244-4331-bd25-d75f2dd22141 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaeff090-330b-4cbe-a618-ed95e0e9194a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:58:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1881723065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21eb224d-0f4a-4b70-91d3-59d694cf128c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3913b24435564094b06cf966a7519108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:58:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:58:33Z,use_quota=True,user_id='037be85aa8164820bb32e122937a8866',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:33 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-ce524978-2244-4331-bd25-d75f2dd22141 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c377525b-d084-4182-9d1f-e6875d0bb071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:33 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-ce524978-2244-4331-bd25-d75f2dd22141 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c377525b-d084-4182-9d1f-e6875d0bb071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:33 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-ce524978-2244-4331-bd25-d75f2dd22141 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46de86d6-773e-4cf7-bf80-a7255283f4d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:33 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-ce524978-2244-4331-bd25-d75f2dd22141 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46de86d6-773e-4cf7-bf80-a7255283f4d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21eb224d-0f4a-4b70-91d3-59d694cf128c', 'volume_name': 'volume-21eb224d-0f4a-4b70-91d3-59d694cf128c', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:33 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-ce524978-2244-4331-bd25-d75f2dd22141 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48d741e5-53c9-4100-89bf-ce3714b38d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:33 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-ce524978-2244-4331-bd25-d75f2dd22141 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48d741e5-53c9-4100-89bf-ce3714b38d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:33 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-ce524978-2244-4331-bd25-d75f2dd22141 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f11430c2-1184-4159-be1d-f8aca9b37118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:33 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-ce524978-2244-4331-bd25-d75f2dd22141 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Volume 21eb224d-0f4a-4b70-91d3-59d694cf128c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21eb224d-0f4a-4b70-91d3-59d694cf128c', 'volume_size': 1} Sep 04 22:58:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-ce524978-2244-4331-bd25-d75f2dd22141 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:58:33 devstack sudo[106506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_93765a35-6312-41bf-aaa6-a4b7c6d4ffa7_sd_t6lp0devstack@QuobyteHD Sep 04 22:58:33 devstack sudo[106506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:33 devstack sudo[106501]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ca63ce91-d139-4687-a53a-a7c3dbb07f77 tempest-CreateVolumesFromImageTest-1083081755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9eca3d4e-f5d7-44b4-9688-5e20b0f199a1 1073741824" returned: 0 in 0.528s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ca63ce91-d139-4687-a53a-a7c3dbb07f77 tempest-CreateVolumesFromImageTest-1083081755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9eca3d4e-f5d7-44b4-9688-5e20b0f199a1 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:33 devstack sudo[106510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9eca3d4e-f5d7-44b4-9688-5e20b0f199a1 Sep 04 22:58:33 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:33 devstack sudo[106506]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_93765a35-6312-41bf-aaa6-a4b7c6d4ffa7_sd_t6lp0devstack@QuobyteHD" returned: 0 in 0.464s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_93765a35-6312-41bf-aaa6-a4b7c6d4ffa7_sd_t6lp0devstack@QuobyteHD {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:33 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab2f6bcf-f88c-4b42-a362-6d833a7cc6a0 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:58:33 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-ab2f6bcf-f88c-4b42-a362-6d833a7cc6a0 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Flow 'volume_create_manager' (828ee1b0-64b0-412c-b9bd-dc8ffa757e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:58:33 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-ab2f6bcf-f88c-4b42-a362-6d833a7cc6a0 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ed7a228-0130-44e8-ba18-f3985115312b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:33 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-ab2f6bcf-f88c-4b42-a362-6d833a7cc6a0 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ed7a228-0130-44e8-ba18-f3985115312b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:58:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-185316464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6e71b68-577a-4bd2-8504-80b9b0c9982c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3913b24435564094b06cf966a7519108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:58:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:58:33Z,use_quota=True,user_id='037be85aa8164820bb32e122937a8866',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:33 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-ab2f6bcf-f88c-4b42-a362-6d833a7cc6a0 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20f69afb-83aa-4aaf-b22d-564c2166c46f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:33 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-ab2f6bcf-f88c-4b42-a362-6d833a7cc6a0 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20f69afb-83aa-4aaf-b22d-564c2166c46f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:33 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-ab2f6bcf-f88c-4b42-a362-6d833a7cc6a0 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a91bc02-065d-425e-aecf-39cb34291922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:33 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-ab2f6bcf-f88c-4b42-a362-6d833a7cc6a0 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a91bc02-065d-425e-aecf-39cb34291922) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6e71b68-577a-4bd2-8504-80b9b0c9982c', 'volume_name': 'volume-e6e71b68-577a-4bd2-8504-80b9b0c9982c', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:33 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-ab2f6bcf-f88c-4b42-a362-6d833a7cc6a0 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b04ce815-0a29-490e-b395-a38d98fe27bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:33 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-ab2f6bcf-f88c-4b42-a362-6d833a7cc6a0 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b04ce815-0a29-490e-b395-a38d98fe27bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:33 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-ab2f6bcf-f88c-4b42-a362-6d833a7cc6a0 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10dd6461-a6ff-491e-8cae-fc3e75770ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:33 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-ab2f6bcf-f88c-4b42-a362-6d833a7cc6a0 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Volume e6e71b68-577a-4bd2-8504-80b9b0c9982c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6e71b68-577a-4bd2-8504-80b9b0c9982c', 'volume_size': 1} Sep 04 22:58:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-ab2f6bcf-f88c-4b42-a362-6d833a7cc6a0 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:58:33 devstack sudo[106514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_93765a35-6312-41bf-aaa6-a4b7c6d4ffa7_sd_t6lp0devstack@QuobyteHD Sep 04 22:58:33 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:33 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ca63ce91-d139-4687-a53a-a7c3dbb07f77 tempest-CreateVolumesFromImageTest-1083081755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9eca3d4e-f5d7-44b4-9688-5e20b0f199a1" returned: 0 in 0.366s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:33 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-ca63ce91-d139-4687-a53a-a7c3dbb07f77 tempest-CreateVolumesFromImageTest-1083081755 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:58:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-ca63ce91-d139-4687-a53a-a7c3dbb07f77 tempest-CreateVolumesFromImageTest-1083081755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:58:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-24022f49-004a-4bb7-8ef5-49e5ea7df20e tempest-CinderUnicodeTest-9741368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.313s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:58:33 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-24022f49-004a-4bb7-8ef5-49e5ea7df20e tempest-CinderUnicodeTest-9741368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:58:30Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-313767958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42ec3740-81ed-44ad-9838-132407513835,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='136891daa8634c5786333ad612e49e15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:58:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:58:30Z,use_quota=True,user_id='54690204c78f4a9dbf67015921ba2973',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:58:33 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-24022f49-004a-4bb7-8ef5-49e5ea7df20e tempest-CinderUnicodeTest-9741368 None] Creating volume 42ec3740-81ed-44ad-9838-132407513835 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:58:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-24022f49-004a-4bb7-8ef5-49e5ea7df20e tempest-CinderUnicodeTest-9741368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:58:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-24022f49-004a-4bb7-8ef5-49e5ea7df20e tempest-CinderUnicodeTest-9741368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:58:33 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-24022f49-004a-4bb7-8ef5-49e5ea7df20e tempest-CinderUnicodeTest-9741368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:58:33 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-24022f49-004a-4bb7-8ef5-49e5ea7df20e tempest-CinderUnicodeTest-9741368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:58:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-24022f49-004a-4bb7-8ef5-49e5ea7df20e tempest-CinderUnicodeTest-9741368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:58:33 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-24022f49-004a-4bb7-8ef5-49e5ea7df20e tempest-CinderUnicodeTest-9741368 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:58:33 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-24022f49-004a-4bb7-8ef5-49e5ea7df20e tempest-CinderUnicodeTest-9741368 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:58:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-24022f49-004a-4bb7-8ef5-49e5ea7df20e tempest-CinderUnicodeTest-9741368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42ec3740-81ed-44ad-9838-132407513835 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:33 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-ca63ce91-d139-4687-a53a-a7c3dbb07f77 tempest-CreateVolumesFromImageTest-1083081755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38a4eaa7-172e-4849-8e2c-0b90cd1606c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9eca3d4e-f5d7-44b4-9688-5e20b0f199a1', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:33 devstack sudo[106517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42ec3740-81ed-44ad-9838-132407513835 1073741824 Sep 04 22:58:33 devstack sudo[106517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:33 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-ca63ce91-d139-4687-a53a-a7c3dbb07f77 tempest-CreateVolumesFromImageTest-1083081755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f55fe822-6651-4c3f-bd5d-9366f73ad9de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:33 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-ca63ce91-d139-4687-a53a-a7c3dbb07f77 tempest-CreateVolumesFromImageTest-1083081755 None] Volume volume-9eca3d4e-f5d7-44b4-9688-5e20b0f199a1 (9eca3d4e-f5d7-44b4-9688-5e20b0f199a1): created successfully Sep 04 22:58:33 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-ca63ce91-d139-4687-a53a-a7c3dbb07f77 tempest-CreateVolumesFromImageTest-1083081755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f55fe822-6651-4c3f-bd5d-9366f73ad9de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:33 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-ca63ce91-d139-4687-a53a-a7c3dbb07f77 tempest-CreateVolumesFromImageTest-1083081755 None] Flow 'volume_create_manager' (c47f0b0e-b736-455f-9d85-5f908fd59171) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:58:33 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-ca63ce91-d139-4687-a53a-a7c3dbb07f77 tempest-CreateVolumesFromImageTest-1083081755 None] Created volume successfully. Sep 04 22:58:33 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_93765a35-6312-41bf-aaa6-a4b7c6d4ffa7_sd_t6lp0devstack@QuobyteHD" returned: 1 in 0.441s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_93765a35-6312-41bf-aaa6-a4b7c6d4ffa7_sd_t6lp0devstack@QuobyteHD' failed. Not Retrying. {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 22:58:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:58:34 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-37b5a65f-6f2c-4351-8af8-26274448da70 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:58:34 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-37b5a65f-6f2c-4351-8af8-26274448da70 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Flow 'volume_create_manager' (376cfe58-2619-49e3-ba6e-d8b534bb37e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:58:34 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-37b5a65f-6f2c-4351-8af8-26274448da70 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73d7e28c-cbbe-480e-9f61-48e2804266d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:34 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-37b5a65f-6f2c-4351-8af8-26274448da70 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73d7e28c-cbbe-480e-9f61-48e2804266d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:58:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1797726351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a0e0d27-04ac-4c6a-ba82-5dc0f3cdbed5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3913b24435564094b06cf966a7519108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:58:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:58:34Z,use_quota=True,user_id='037be85aa8164820bb32e122937a8866',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:34 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-37b5a65f-6f2c-4351-8af8-26274448da70 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b25584a0-16b6-47b4-871d-a1663f4bd228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:34 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-37b5a65f-6f2c-4351-8af8-26274448da70 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b25584a0-16b6-47b4-871d-a1663f4bd228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:34 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-37b5a65f-6f2c-4351-8af8-26274448da70 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16b7e1e5-2c3a-4f9c-8304-cfd80a5bfe5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:34 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-37b5a65f-6f2c-4351-8af8-26274448da70 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16b7e1e5-2c3a-4f9c-8304-cfd80a5bfe5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a0e0d27-04ac-4c6a-ba82-5dc0f3cdbed5', 'volume_name': 'volume-0a0e0d27-04ac-4c6a-ba82-5dc0f3cdbed5', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:34 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-37b5a65f-6f2c-4351-8af8-26274448da70 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a0e8c6f-9f77-460e-9324-53112aae8c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:34 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-37b5a65f-6f2c-4351-8af8-26274448da70 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a0e8c6f-9f77-460e-9324-53112aae8c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:34 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-37b5a65f-6f2c-4351-8af8-26274448da70 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (012b2f5e-2ed6-4b97-8e0b-015585b36ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:34 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-37b5a65f-6f2c-4351-8af8-26274448da70 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Volume 0a0e0d27-04ac-4c6a-ba82-5dc0f3cdbed5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a0e0d27-04ac-4c6a-ba82-5dc0f3cdbed5', 'volume_size': 1} Sep 04 22:58:34 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-37b5a65f-6f2c-4351-8af8-26274448da70 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:58:34 devstack sudo[106517]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:34 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-24022f49-004a-4bb7-8ef5-49e5ea7df20e tempest-CinderUnicodeTest-9741368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42ec3740-81ed-44ad-9838-132407513835 1073741824" returned: 0 in 0.520s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:34 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-24022f49-004a-4bb7-8ef5-49e5ea7df20e tempest-CinderUnicodeTest-9741368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42ec3740-81ed-44ad-9838-132407513835 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:34 devstack sudo[106526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42ec3740-81ed-44ad-9838-132407513835 Sep 04 22:58:34 devstack sudo[106526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:34 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc34b933-6437-440c-9ec0-cf4ccdb88536 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:58:34 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-cc34b933-6437-440c-9ec0-cf4ccdb88536 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Flow 'volume_create_manager' (1b3d93db-2915-4836-8a2a-4455b8c95753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:58:34 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-cc34b933-6437-440c-9ec0-cf4ccdb88536 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7611f51-e7ef-46bd-94e3-1d09a8ae793a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:34 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-cc34b933-6437-440c-9ec0-cf4ccdb88536 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7611f51-e7ef-46bd-94e3-1d09a8ae793a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:58:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1035436472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1577f970-8f77-48b3-9802-71b94e04f5c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3913b24435564094b06cf966a7519108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:58:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:58:34Z,use_quota=True,user_id='037be85aa8164820bb32e122937a8866',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:34 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-cc34b933-6437-440c-9ec0-cf4ccdb88536 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (906261d3-83ae-4980-8f42-66843e660a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:34 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-cc34b933-6437-440c-9ec0-cf4ccdb88536 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (906261d3-83ae-4980-8f42-66843e660a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:34 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-cc34b933-6437-440c-9ec0-cf4ccdb88536 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a65db9c6-54cc-43ad-a4a6-8a0cd73152db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:34 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-cc34b933-6437-440c-9ec0-cf4ccdb88536 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a65db9c6-54cc-43ad-a4a6-8a0cd73152db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1577f970-8f77-48b3-9802-71b94e04f5c7', 'volume_name': 'volume-1577f970-8f77-48b3-9802-71b94e04f5c7', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:34 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-cc34b933-6437-440c-9ec0-cf4ccdb88536 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (168a675e-695c-447a-b8d4-f99079f5b8f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:34 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-cc34b933-6437-440c-9ec0-cf4ccdb88536 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (168a675e-695c-447a-b8d4-f99079f5b8f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:34 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-cc34b933-6437-440c-9ec0-cf4ccdb88536 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3563d9c9-773b-49e7-99c2-78911e12bea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:34 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-cc34b933-6437-440c-9ec0-cf4ccdb88536 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Volume 1577f970-8f77-48b3-9802-71b94e04f5c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1577f970-8f77-48b3-9802-71b94e04f5c7', 'volume_size': 1} Sep 04 22:58:34 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-cc34b933-6437-440c-9ec0-cf4ccdb88536 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:58:34 devstack sudo[106526]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:34 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-24022f49-004a-4bb7-8ef5-49e5ea7df20e tempest-CinderUnicodeTest-9741368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42ec3740-81ed-44ad-9838-132407513835" returned: 0 in 0.275s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:34 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-24022f49-004a-4bb7-8ef5-49e5ea7df20e tempest-CinderUnicodeTest-9741368 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:58:34 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-24022f49-004a-4bb7-8ef5-49e5ea7df20e tempest-CinderUnicodeTest-9741368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:58:34 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-772ca971-9daf-40ca-8358-bdec5c41ba38 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.546s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:58:34 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-772ca971-9daf-40ca-8358-bdec5c41ba38 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:58:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2090089057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2315f5e-3875-4ac7-a576-d32dec034d16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3913b24435564094b06cf966a7519108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:58:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:58:33Z,use_quota=True,user_id='037be85aa8164820bb32e122937a8866',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:58:34 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-772ca971-9daf-40ca-8358-bdec5c41ba38 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Creating volume a2315f5e-3875-4ac7-a576-d32dec034d16 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:58:34 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-772ca971-9daf-40ca-8358-bdec5c41ba38 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:58:34 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-772ca971-9daf-40ca-8358-bdec5c41ba38 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:58:34 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-772ca971-9daf-40ca-8358-bdec5c41ba38 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:58:34 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-772ca971-9daf-40ca-8358-bdec5c41ba38 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:58:34 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-772ca971-9daf-40ca-8358-bdec5c41ba38 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:58:34 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-772ca971-9daf-40ca-8358-bdec5c41ba38 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:58:34 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-772ca971-9daf-40ca-8358-bdec5c41ba38 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:58:34 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-772ca971-9daf-40ca-8358-bdec5c41ba38 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-a2315f5e-3875-4ac7-a576-d32dec034d16 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:34 devstack sudo[106529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-a2315f5e-3875-4ac7-a576-d32dec034d16 1073741824 Sep 04 22:58:34 devstack sudo[106529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:34 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-24022f49-004a-4bb7-8ef5-49e5ea7df20e tempest-CinderUnicodeTest-9741368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64ac2245-b828-4cbf-b76f-b6dc52f3bc18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42ec3740-81ed-44ad-9838-132407513835', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:34 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-24022f49-004a-4bb7-8ef5-49e5ea7df20e tempest-CinderUnicodeTest-9741368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa536f79-797b-4d2e-9618-879f7289fbe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:34 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-24022f49-004a-4bb7-8ef5-49e5ea7df20e tempest-CinderUnicodeTest-9741368 None] Volume volume-42ec3740-81ed-44ad-9838-132407513835 (42ec3740-81ed-44ad-9838-132407513835): created successfully Sep 04 22:58:34 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-24022f49-004a-4bb7-8ef5-49e5ea7df20e tempest-CinderUnicodeTest-9741368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa536f79-797b-4d2e-9618-879f7289fbe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:34 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-24022f49-004a-4bb7-8ef5-49e5ea7df20e tempest-CinderUnicodeTest-9741368 None] Flow 'volume_create_manager' (8b8e4604-9f2f-49af-b359-acb80ec2964c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:58:34 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-24022f49-004a-4bb7-8ef5-49e5ea7df20e tempest-CinderUnicodeTest-9741368 None] Created volume successfully. Sep 04 22:58:34 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-912ad983-7ed6-43fd-b4b8-3f392f3a9ae5 tempest-CreateVolumesFromImageTest-1083081755 None] Acquiring lock "cinder-9eca3d4e-f5d7-44b4-9688-5e20b0f199a1-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:58:34 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-912ad983-7ed6-43fd-b4b8-3f392f3a9ae5 tempest-CreateVolumesFromImageTest-1083081755 None] Lock "cinder-9eca3d4e-f5d7-44b4-9688-5e20b0f199a1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:58:34 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-912ad983-7ed6-43fd-b4b8-3f392f3a9ae5 tempest-CreateVolumesFromImageTest-1083081755 None] Acquiring lock "cinder-quobyte-9eca3d4e-f5d7-44b4-9688-5e20b0f199a1" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:58:34 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-912ad983-7ed6-43fd-b4b8-3f392f3a9ae5 tempest-CreateVolumesFromImageTest-1083081755 None] Lock "cinder-quobyte-9eca3d4e-f5d7-44b4-9688-5e20b0f199a1" acquired by "delete_volume" :: waited 0.016s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:58:34 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[287f1c5f-c916-40ce-8a83-d9ce7a845356]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:58:34 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-912ad983-7ed6-43fd-b4b8-3f392f3a9ae5 tempest-CreateVolumesFromImageTest-1083081755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9eca3d4e-f5d7-44b4-9688-5e20b0f199a1 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:34 devstack sudo[106529]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:34 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-772ca971-9daf-40ca-8358-bdec5c41ba38 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-a2315f5e-3875-4ac7-a576-d32dec034d16 1073741824" returned: 0 in 0.457s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-772ca971-9daf-40ca-8358-bdec5c41ba38 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-a2315f5e-3875-4ac7-a576-d32dec034d16 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:35 devstack sudo[106535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9eca3d4e-f5d7-44b4-9688-5e20b0f199a1 Sep 04 22:58:35 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:35 devstack sudo[106536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-a2315f5e-3875-4ac7-a576-d32dec034d16 Sep 04 22:58:35 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:35 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-772ca971-9daf-40ca-8358-bdec5c41ba38 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-a2315f5e-3875-4ac7-a576-d32dec034d16" returned: 0 in 0.242s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:35 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-772ca971-9daf-40ca-8358-bdec5c41ba38 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:58:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-772ca971-9daf-40ca-8358-bdec5c41ba38 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:58:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-ce524978-2244-4331-bd25-d75f2dd22141 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.144s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:58:35 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-ce524978-2244-4331-bd25-d75f2dd22141 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:58:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1881723065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21eb224d-0f4a-4b70-91d3-59d694cf128c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3913b24435564094b06cf966a7519108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:58:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:58:33Z,use_quota=True,user_id='037be85aa8164820bb32e122937a8866',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:58:35 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-ce524978-2244-4331-bd25-d75f2dd22141 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Creating volume 21eb224d-0f4a-4b70-91d3-59d694cf128c {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:58:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-ce524978-2244-4331-bd25-d75f2dd22141 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:58:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-ce524978-2244-4331-bd25-d75f2dd22141 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:58:35 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-ce524978-2244-4331-bd25-d75f2dd22141 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:58:35 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-ce524978-2244-4331-bd25-d75f2dd22141 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:58:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-ce524978-2244-4331-bd25-d75f2dd22141 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:58:35 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-ce524978-2244-4331-bd25-d75f2dd22141 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:58:35 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-ce524978-2244-4331-bd25-d75f2dd22141 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:58:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ce524978-2244-4331-bd25-d75f2dd22141 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-21eb224d-0f4a-4b70-91d3-59d694cf128c 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:35 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-912ad983-7ed6-43fd-b4b8-3f392f3a9ae5 tempest-CreateVolumesFromImageTest-1083081755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9eca3d4e-f5d7-44b4-9688-5e20b0f199a1" returned: 0 in 0.381s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-912ad983-7ed6-43fd-b4b8-3f392f3a9ae5 tempest-CreateVolumesFromImageTest-1083081755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9eca3d4e-f5d7-44b4-9688-5e20b0f199a1 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:35 devstack sudo[106543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-21eb224d-0f4a-4b70-91d3-59d694cf128c 1073741824 Sep 04 22:58:35 devstack sudo[106543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:35 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-772ca971-9daf-40ca-8358-bdec5c41ba38 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7eecc9b-9235-4c55-a437-fb06ba5d00b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2315f5e-3875-4ac7-a576-d32dec034d16', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:35 devstack sudo[106544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9eca3d4e-f5d7-44b4-9688-5e20b0f199a1 Sep 04 22:58:35 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-772ca971-9daf-40ca-8358-bdec5c41ba38 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41674abd-ec3f-47c2-a422-a5899bb9bb07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:35 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:35 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-772ca971-9daf-40ca-8358-bdec5c41ba38 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Volume volume-a2315f5e-3875-4ac7-a576-d32dec034d16 (a2315f5e-3875-4ac7-a576-d32dec034d16): created successfully Sep 04 22:58:35 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-772ca971-9daf-40ca-8358-bdec5c41ba38 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41674abd-ec3f-47c2-a422-a5899bb9bb07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:35 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-772ca971-9daf-40ca-8358-bdec5c41ba38 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Flow 'volume_create_manager' (0bc3bf30-a010-4fef-b9a0-6e84da3b253d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:58:35 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-772ca971-9daf-40ca-8358-bdec5c41ba38 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Created volume successfully. Sep 04 22:58:35 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-912ad983-7ed6-43fd-b4b8-3f392f3a9ae5 tempest-CreateVolumesFromImageTest-1083081755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9eca3d4e-f5d7-44b4-9688-5e20b0f199a1" returned: 0 in 0.279s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:35 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-912ad983-7ed6-43fd-b4b8-3f392f3a9ae5 tempest-CreateVolumesFromImageTest-1083081755 None] Lock "cinder-quobyte-9eca3d4e-f5d7-44b4-9688-5e20b0f199a1" released by "delete_volume" :: held 0.699s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:58:35 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-912ad983-7ed6-43fd-b4b8-3f392f3a9ae5 tempest-CreateVolumesFromImageTest-1083081755 None] Created reservations ['a24338d6-9f1f-48cf-85e8-51cd6c72c051', '0a683744-e920-47c5-9ef7-d24ac06cfa15', 'c504bb48-b19f-468a-8f88-c020dbc4bb6d', '39a0b77e-c24c-4367-84b4-c857cc677570'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:58:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-912ad983-7ed6-43fd-b4b8-3f392f3a9ae5 tempest-CreateVolumesFromImageTest-1083081755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:58:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-912ad983-7ed6-43fd-b4b8-3f392f3a9ae5 tempest-CreateVolumesFromImageTest-1083081755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:58:35 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-912ad983-7ed6-43fd-b4b8-3f392f3a9ae5 tempest-CreateVolumesFromImageTest-1083081755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:58:35 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-912ad983-7ed6-43fd-b4b8-3f392f3a9ae5 tempest-CreateVolumesFromImageTest-1083081755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:58:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-912ad983-7ed6-43fd-b4b8-3f392f3a9ae5 tempest-CreateVolumesFromImageTest-1083081755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:58:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-912ad983-7ed6-43fd-b4b8-3f392f3a9ae5 tempest-CreateVolumesFromImageTest-1083081755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:35 devstack sudo[106543]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ce524978-2244-4331-bd25-d75f2dd22141 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-21eb224d-0f4a-4b70-91d3-59d694cf128c 1073741824" returned: 0 in 0.506s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:35 devstack sudo[106552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:58:35 devstack sudo[106552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ce524978-2244-4331-bd25-d75f2dd22141 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-21eb224d-0f4a-4b70-91d3-59d694cf128c {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:35 devstack sudo[106554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-21eb224d-0f4a-4b70-91d3-59d694cf128c Sep 04 22:58:35 devstack sudo[106554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-5778456f-632d-4e73-ad2f-2dd88880d1d7 tempest-CinderUnicodeTest-9741368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:58:35 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-5c9d4f14-7715-4a98-a91d-663533c3a65e tempest-CreateVolumesFromImageTest-1083081755 None] Acquiring lock "cinder-9d6ddb69-e803-4603-bae8-b354edec48bb-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:58:35 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-5c9d4f14-7715-4a98-a91d-663533c3a65e tempest-CreateVolumesFromImageTest-1083081755 None] Lock "cinder-9d6ddb69-e803-4603-bae8-b354edec48bb-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:58:36 devstack sudo[106552]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:36 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-5c9d4f14-7715-4a98-a91d-663533c3a65e tempest-CreateVolumesFromImageTest-1083081755 None] Acquiring lock "cinder-quobyte-9d6ddb69-e803-4603-bae8-b354edec48bb" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:58:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-912ad983-7ed6-43fd-b4b8-3f392f3a9ae5 tempest-CreateVolumesFromImageTest-1083081755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.314s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:36 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-912ad983-7ed6-43fd-b4b8-3f392f3a9ae5 tempest-CreateVolumesFromImageTest-1083081755 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:58:36 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-912ad983-7ed6-43fd-b4b8-3f392f3a9ae5 tempest-CreateVolumesFromImageTest-1083081755 None] Deleted volume successfully. Sep 04 22:58:36 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-5c9d4f14-7715-4a98-a91d-663533c3a65e tempest-CreateVolumesFromImageTest-1083081755 None] Lock "cinder-quobyte-9d6ddb69-e803-4603-bae8-b354edec48bb" acquired by "delete_volume" :: waited 0.032s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:58:36 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-912ad983-7ed6-43fd-b4b8-3f392f3a9ae5 tempest-CreateVolumesFromImageTest-1083081755 None] Lock "cinder-9eca3d4e-f5d7-44b4-9688-5e20b0f199a1-delete_volume" released by "delete_volume" :: held 1.269s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:58:36 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e00c53f-905a-4bc4-ab3a-056ac40ed9ca]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:58:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5c9d4f14-7715-4a98-a91d-663533c3a65e tempest-CreateVolumesFromImageTest-1083081755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9d6ddb69-e803-4603-bae8-b354edec48bb {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:36 devstack sudo[106554]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ce524978-2244-4331-bd25-d75f2dd22141 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-21eb224d-0f4a-4b70-91d3-59d694cf128c" returned: 0 in 0.297s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:36 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-ce524978-2244-4331-bd25-d75f2dd22141 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:58:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-ce524978-2244-4331-bd25-d75f2dd22141 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:58:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-ab2f6bcf-f88c-4b42-a362-6d833a7cc6a0 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.526s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:58:36 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-ab2f6bcf-f88c-4b42-a362-6d833a7cc6a0 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:58:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-185316464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6e71b68-577a-4bd2-8504-80b9b0c9982c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3913b24435564094b06cf966a7519108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:58:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:58:33Z,use_quota=True,user_id='037be85aa8164820bb32e122937a8866',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:58:36 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-ab2f6bcf-f88c-4b42-a362-6d833a7cc6a0 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Creating volume e6e71b68-577a-4bd2-8504-80b9b0c9982c {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:58:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-ab2f6bcf-f88c-4b42-a362-6d833a7cc6a0 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:58:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-ab2f6bcf-f88c-4b42-a362-6d833a7cc6a0 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:58:36 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-ab2f6bcf-f88c-4b42-a362-6d833a7cc6a0 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:58:36 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-ab2f6bcf-f88c-4b42-a362-6d833a7cc6a0 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:58:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-ab2f6bcf-f88c-4b42-a362-6d833a7cc6a0 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:58:36 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-ab2f6bcf-f88c-4b42-a362-6d833a7cc6a0 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:58:36 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-ab2f6bcf-f88c-4b42-a362-6d833a7cc6a0 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:58:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ab2f6bcf-f88c-4b42-a362-6d833a7cc6a0 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e6e71b68-577a-4bd2-8504-80b9b0c9982c 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:36 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-ce524978-2244-4331-bd25-d75f2dd22141 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f11430c2-1184-4159-be1d-f8aca9b37118) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21eb224d-0f4a-4b70-91d3-59d694cf128c', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:36 devstack sudo[106559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e6e71b68-577a-4bd2-8504-80b9b0c9982c 1073741824 Sep 04 22:58:36 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:36 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-ce524978-2244-4331-bd25-d75f2dd22141 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa7f76bb-2aa4-408e-a7d7-6b2e761f18ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:36 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-ce524978-2244-4331-bd25-d75f2dd22141 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Volume volume-21eb224d-0f4a-4b70-91d3-59d694cf128c (21eb224d-0f4a-4b70-91d3-59d694cf128c): created successfully Sep 04 22:58:36 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-ce524978-2244-4331-bd25-d75f2dd22141 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa7f76bb-2aa4-408e-a7d7-6b2e761f18ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:36 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-ce524978-2244-4331-bd25-d75f2dd22141 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Flow 'volume_create_manager' (ea1304ec-3396-4815-831f-fa9de42dee94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:58:36 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-ce524978-2244-4331-bd25-d75f2dd22141 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Created volume successfully. Sep 04 22:58:36 devstack sudo[106558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9d6ddb69-e803-4603-bae8-b354edec48bb Sep 04 22:58:36 devstack sudo[106558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:36 devstack sudo[106558]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5c9d4f14-7715-4a98-a91d-663533c3a65e tempest-CreateVolumesFromImageTest-1083081755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9d6ddb69-e803-4603-bae8-b354edec48bb" returned: 0 in 0.372s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5c9d4f14-7715-4a98-a91d-663533c3a65e tempest-CreateVolumesFromImageTest-1083081755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9d6ddb69-e803-4603-bae8-b354edec48bb {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:36 devstack sudo[106568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9d6ddb69-e803-4603-bae8-b354edec48bb Sep 04 22:58:36 devstack sudo[106568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:36 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ab2f6bcf-f88c-4b42-a362-6d833a7cc6a0 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e6e71b68-577a-4bd2-8504-80b9b0c9982c 1073741824" returned: 0 in 0.499s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ab2f6bcf-f88c-4b42-a362-6d833a7cc6a0 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e6e71b68-577a-4bd2-8504-80b9b0c9982c {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:36 devstack sudo[106571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e6e71b68-577a-4bd2-8504-80b9b0c9982c Sep 04 22:58:36 devstack sudo[106571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:36 devstack sudo[106568]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5c9d4f14-7715-4a98-a91d-663533c3a65e tempest-CreateVolumesFromImageTest-1083081755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9d6ddb69-e803-4603-bae8-b354edec48bb" returned: 0 in 0.259s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:36 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-5c9d4f14-7715-4a98-a91d-663533c3a65e tempest-CreateVolumesFromImageTest-1083081755 None] Lock "cinder-quobyte-9d6ddb69-e803-4603-bae8-b354edec48bb" released by "delete_volume" :: held 0.677s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:58:36 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-5c9d4f14-7715-4a98-a91d-663533c3a65e tempest-CreateVolumesFromImageTest-1083081755 None] Created reservations ['073fe418-bde3-4482-8e43-b84c9e19c371', '3553424f-2723-480f-b03e-191a60360757', '36872ef3-4940-4be9-8b02-166ee255c80d', '40ea5498-fa2e-48f5-81a1-38fd5e178b15'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:58:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-5c9d4f14-7715-4a98-a91d-663533c3a65e tempest-CreateVolumesFromImageTest-1083081755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:58:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-5c9d4f14-7715-4a98-a91d-663533c3a65e tempest-CreateVolumesFromImageTest-1083081755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:58:36 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-5c9d4f14-7715-4a98-a91d-663533c3a65e tempest-CreateVolumesFromImageTest-1083081755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:58:36 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-5c9d4f14-7715-4a98-a91d-663533c3a65e tempest-CreateVolumesFromImageTest-1083081755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:58:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-5c9d4f14-7715-4a98-a91d-663533c3a65e tempest-CreateVolumesFromImageTest-1083081755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:58:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5c9d4f14-7715-4a98-a91d-663533c3a65e tempest-CreateVolumesFromImageTest-1083081755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:36 devstack sudo[106574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:58:36 devstack sudo[106574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:36 devstack sudo[106571]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ab2f6bcf-f88c-4b42-a362-6d833a7cc6a0 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e6e71b68-577a-4bd2-8504-80b9b0c9982c" returned: 0 in 0.279s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:36 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-ab2f6bcf-f88c-4b42-a362-6d833a7cc6a0 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:58:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-ab2f6bcf-f88c-4b42-a362-6d833a7cc6a0 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:58:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.040s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:58:36 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:58:31Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7da10008-72e3-4b46-8ca9-f2c1909c1239,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d176668d70e4496ba3c03b309f70dc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:58:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:58:31Z,use_quota=True,user_id='d8efa80b9f9b4eae8afcc613a7359195',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f92aba62-3bd4-4ac5-a036-96952ed3743d),volume_type_id=f92aba62-3bd4-4ac5-a036-96952ed3743d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:58:36 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] Creating volume 7da10008-72e3-4b46-8ca9-f2c1909c1239 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:58:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:58:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:58:36 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:58:36 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:58:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:58:36 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:58:36 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:58:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7da10008-72e3-4b46-8ca9-f2c1909c1239 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:36 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-ab2f6bcf-f88c-4b42-a362-6d833a7cc6a0 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10dd6461-a6ff-491e-8cae-fc3e75770ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6e71b68-577a-4bd2-8504-80b9b0c9982c', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:36 devstack sudo[106577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7da10008-72e3-4b46-8ca9-f2c1909c1239 1073741824 Sep 04 22:58:37 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-ab2f6bcf-f88c-4b42-a362-6d833a7cc6a0 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bea150f9-d423-4bff-843c-12ad2c8e2047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:37 devstack sudo[106577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:37 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-ab2f6bcf-f88c-4b42-a362-6d833a7cc6a0 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Volume volume-e6e71b68-577a-4bd2-8504-80b9b0c9982c (e6e71b68-577a-4bd2-8504-80b9b0c9982c): created successfully Sep 04 22:58:37 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-ab2f6bcf-f88c-4b42-a362-6d833a7cc6a0 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bea150f9-d423-4bff-843c-12ad2c8e2047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:37 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-ab2f6bcf-f88c-4b42-a362-6d833a7cc6a0 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Flow 'volume_create_manager' (828ee1b0-64b0-412c-b9bd-dc8ffa757e83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:58:37 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-ab2f6bcf-f88c-4b42-a362-6d833a7cc6a0 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Created volume successfully. Sep 04 22:58:37 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-a59e9c08-e2a7-4b06-88af-77cd3c0d8e7e tempest-CreateVolumesFromImageTest-1083081755 None] Acquiring lock "cinder-62548790-9c16-4892-8d47-600dd5e66823-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:58:37 devstack sudo[106574]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:37 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-a59e9c08-e2a7-4b06-88af-77cd3c0d8e7e tempest-CreateVolumesFromImageTest-1083081755 None] Lock "cinder-62548790-9c16-4892-8d47-600dd5e66823-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:58:37 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5c9d4f14-7715-4a98-a91d-663533c3a65e tempest-CreateVolumesFromImageTest-1083081755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.303s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:37 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-5c9d4f14-7715-4a98-a91d-663533c3a65e tempest-CreateVolumesFromImageTest-1083081755 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:58:37 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-5c9d4f14-7715-4a98-a91d-663533c3a65e tempest-CreateVolumesFromImageTest-1083081755 None] Deleted volume successfully. Sep 04 22:58:37 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-a59e9c08-e2a7-4b06-88af-77cd3c0d8e7e tempest-CreateVolumesFromImageTest-1083081755 None] Acquiring lock "cinder-quobyte-62548790-9c16-4892-8d47-600dd5e66823" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:58:37 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-5c9d4f14-7715-4a98-a91d-663533c3a65e tempest-CreateVolumesFromImageTest-1083081755 None] Lock "cinder-9d6ddb69-e803-4603-bae8-b354edec48bb-delete_volume" released by "delete_volume" :: held 1.252s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:58:37 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-a59e9c08-e2a7-4b06-88af-77cd3c0d8e7e tempest-CreateVolumesFromImageTest-1083081755 None] Lock "cinder-quobyte-62548790-9c16-4892-8d47-600dd5e66823" acquired by "delete_volume" :: waited 0.022s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:58:37 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c5a635a-c122-449c-a58a-429971bee8ca]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:58:37 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a59e9c08-e2a7-4b06-88af-77cd3c0d8e7e tempest-CreateVolumesFromImageTest-1083081755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-62548790-9c16-4892-8d47-600dd5e66823 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:37 devstack sudo[106583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-62548790-9c16-4892-8d47-600dd5e66823 Sep 04 22:58:37 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:37 devstack sudo[106577]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:37 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7da10008-72e3-4b46-8ca9-f2c1909c1239 1073741824" returned: 0 in 0.502s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:37 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7da10008-72e3-4b46-8ca9-f2c1909c1239 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:37 devstack sudo[106586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7da10008-72e3-4b46-8ca9-f2c1909c1239 Sep 04 22:58:37 devstack sudo[106586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:37 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:37 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a59e9c08-e2a7-4b06-88af-77cd3c0d8e7e tempest-CreateVolumesFromImageTest-1083081755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-62548790-9c16-4892-8d47-600dd5e66823" returned: 0 in 0.452s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:37 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a59e9c08-e2a7-4b06-88af-77cd3c0d8e7e tempest-CreateVolumesFromImageTest-1083081755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-62548790-9c16-4892-8d47-600dd5e66823 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:37 devstack sudo[106626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-62548790-9c16-4892-8d47-600dd5e66823 Sep 04 22:58:37 devstack sudo[106626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:37 devstack sudo[106586]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:37 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7da10008-72e3-4b46-8ca9-f2c1909c1239" returned: 0 in 0.305s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:37 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:58:37 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:58:37 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-37b5a65f-6f2c-4351-8af8-26274448da70 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.691s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:58:37 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-37b5a65f-6f2c-4351-8af8-26274448da70 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:58:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1797726351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a0e0d27-04ac-4c6a-ba82-5dc0f3cdbed5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3913b24435564094b06cf966a7519108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:58:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:58:34Z,use_quota=True,user_id='037be85aa8164820bb32e122937a8866',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:58:37 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-37b5a65f-6f2c-4351-8af8-26274448da70 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Creating volume 0a0e0d27-04ac-4c6a-ba82-5dc0f3cdbed5 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:58:37 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-37b5a65f-6f2c-4351-8af8-26274448da70 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:58:37 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-37b5a65f-6f2c-4351-8af8-26274448da70 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:58:37 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-37b5a65f-6f2c-4351-8af8-26274448da70 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:58:37 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-37b5a65f-6f2c-4351-8af8-26274448da70 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:58:37 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-37b5a65f-6f2c-4351-8af8-26274448da70 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:58:37 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-37b5a65f-6f2c-4351-8af8-26274448da70 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:58:37 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-37b5a65f-6f2c-4351-8af8-26274448da70 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:58:37 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-37b5a65f-6f2c-4351-8af8-26274448da70 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-0a0e0d27-04ac-4c6a-ba82-5dc0f3cdbed5 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:37 devstack sudo[106628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-0a0e0d27-04ac-4c6a-ba82-5dc0f3cdbed5 1073741824 Sep 04 22:58:37 devstack sudo[106628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:37 devstack cinder-volume[87576]: DEBUG cinder.volume.volume_utils [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] Attempting download of 93765a35-6312-41bf-aaa6-a4b7c6d4ffa7 ((None, [{'url': 'file:///opt/stack/data/glance/images/93765a35-6312-41bf-aaa6-a4b7c6d4ffa7', 'metadata': {}}])) to volume 7da10008-72e3-4b46-8ca9-f2c1909c1239. {{(pid=87576) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 04 22:58:37 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f4431f-9501-40c8-86a7-954f3a284708]: (4, 'raw') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:58:37 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_93765a35-6312-41bf-aaa6-a4b7c6d4ffa7_9ip7durj {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:38 devstack sudo[106626]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:38 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a59e9c08-e2a7-4b06-88af-77cd3c0d8e7e tempest-CreateVolumesFromImageTest-1083081755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-62548790-9c16-4892-8d47-600dd5e66823" returned: 0 in 0.344s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:38 devstack sudo[106630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_93765a35-6312-41bf-aaa6-a4b7c6d4ffa7_9ip7durj Sep 04 22:58:38 devstack sudo[106630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:38 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-a59e9c08-e2a7-4b06-88af-77cd3c0d8e7e tempest-CreateVolumesFromImageTest-1083081755 None] Lock "cinder-quobyte-62548790-9c16-4892-8d47-600dd5e66823" released by "delete_volume" :: held 0.846s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:58:38 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-a59e9c08-e2a7-4b06-88af-77cd3c0d8e7e tempest-CreateVolumesFromImageTest-1083081755 None] Created reservations ['76f0007a-0d74-4a52-b5c1-946a9e2c68de', 'e33ad1cc-7417-4583-a3c3-52bc2c341e3f', 'c3738f98-0aca-4011-8980-ecc964134283', '645245c0-9778-4b4f-ac38-b086720c041c'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:58:38 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-a59e9c08-e2a7-4b06-88af-77cd3c0d8e7e tempest-CreateVolumesFromImageTest-1083081755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:58:38 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-a59e9c08-e2a7-4b06-88af-77cd3c0d8e7e tempest-CreateVolumesFromImageTest-1083081755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:58:38 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-a59e9c08-e2a7-4b06-88af-77cd3c0d8e7e tempest-CreateVolumesFromImageTest-1083081755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:58:38 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-a59e9c08-e2a7-4b06-88af-77cd3c0d8e7e tempest-CreateVolumesFromImageTest-1083081755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:58:38 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-a59e9c08-e2a7-4b06-88af-77cd3c0d8e7e tempest-CreateVolumesFromImageTest-1083081755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:58:38 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a59e9c08-e2a7-4b06-88af-77cd3c0d8e7e tempest-CreateVolumesFromImageTest-1083081755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:38 devstack sudo[106639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:58:38 devstack sudo[106639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:38 devstack sudo[106630]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:38 devstack sudo[106628]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:38 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_93765a35-6312-41bf-aaa6-a4b7c6d4ffa7_9ip7durj" returned: 0 in 0.450s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:38 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-37b5a65f-6f2c-4351-8af8-26274448da70 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-0a0e0d27-04ac-4c6a-ba82-5dc0f3cdbed5 1073741824" returned: 0 in 0.566s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:38 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_93765a35-6312-41bf-aaa6-a4b7c6d4ffa7_9ip7durj {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:38 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f594361b-a172-41c6-b3c8-9d7586800339 tempest-CreateVolumesFromImageTest-1083081755 None] Acquiring lock "cinder-c88ff913-df84-4ccd-96c0-83db388e35bd-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:58:38 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f594361b-a172-41c6-b3c8-9d7586800339 tempest-CreateVolumesFromImageTest-1083081755 None] Lock "cinder-c88ff913-df84-4ccd-96c0-83db388e35bd-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:58:38 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-37b5a65f-6f2c-4351-8af8-26274448da70 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-0a0e0d27-04ac-4c6a-ba82-5dc0f3cdbed5 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:38 devstack sudo[106644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-0a0e0d27-04ac-4c6a-ba82-5dc0f3cdbed5 Sep 04 22:58:38 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:38 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f594361b-a172-41c6-b3c8-9d7586800339 tempest-CreateVolumesFromImageTest-1083081755 None] Acquiring lock "cinder-quobyte-c88ff913-df84-4ccd-96c0-83db388e35bd" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:58:38 devstack sudo[106643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_93765a35-6312-41bf-aaa6-a4b7c6d4ffa7_9ip7durj Sep 04 22:58:38 devstack sudo[106643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:38 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f594361b-a172-41c6-b3c8-9d7586800339 tempest-CreateVolumesFromImageTest-1083081755 None] Lock "cinder-quobyte-c88ff913-df84-4ccd-96c0-83db388e35bd" acquired by "delete_volume" :: waited 0.020s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:58:38 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb8f82e-5e13-41f5-9612-204c91c28d50]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:58:38 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f594361b-a172-41c6-b3c8-9d7586800339 tempest-CreateVolumesFromImageTest-1083081755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c88ff913-df84-4ccd-96c0-83db388e35bd {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:38 devstack sudo[106639]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:38 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a59e9c08-e2a7-4b06-88af-77cd3c0d8e7e tempest-CreateVolumesFromImageTest-1083081755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.316s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:38 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-a59e9c08-e2a7-4b06-88af-77cd3c0d8e7e tempest-CreateVolumesFromImageTest-1083081755 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:58:38 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-a59e9c08-e2a7-4b06-88af-77cd3c0d8e7e tempest-CreateVolumesFromImageTest-1083081755 None] Deleted volume successfully. Sep 04 22:58:38 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-a59e9c08-e2a7-4b06-88af-77cd3c0d8e7e tempest-CreateVolumesFromImageTest-1083081755 None] Lock "cinder-62548790-9c16-4892-8d47-600dd5e66823-delete_volume" released by "delete_volume" :: held 1.480s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:58:38 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c88ff913-df84-4ccd-96c0-83db388e35bd Sep 04 22:58:38 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:38 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:38 devstack sudo[106643]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:38 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-37b5a65f-6f2c-4351-8af8-26274448da70 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-0a0e0d27-04ac-4c6a-ba82-5dc0f3cdbed5" returned: 0 in 0.304s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:38 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-37b5a65f-6f2c-4351-8af8-26274448da70 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:58:38 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-37b5a65f-6f2c-4351-8af8-26274448da70 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:58:38 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-cc34b933-6437-440c-9ec0-cf4ccdb88536 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.305s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:58:38 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-cc34b933-6437-440c-9ec0-cf4ccdb88536 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:58:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1035436472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1577f970-8f77-48b3-9802-71b94e04f5c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3913b24435564094b06cf966a7519108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:58:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:58:34Z,use_quota=True,user_id='037be85aa8164820bb32e122937a8866',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:58:38 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-cc34b933-6437-440c-9ec0-cf4ccdb88536 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Creating volume 1577f970-8f77-48b3-9802-71b94e04f5c7 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:58:38 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-cc34b933-6437-440c-9ec0-cf4ccdb88536 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:58:38 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-cc34b933-6437-440c-9ec0-cf4ccdb88536 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:58:38 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-cc34b933-6437-440c-9ec0-cf4ccdb88536 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:58:38 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-cc34b933-6437-440c-9ec0-cf4ccdb88536 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:58:38 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-cc34b933-6437-440c-9ec0-cf4ccdb88536 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:58:38 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-cc34b933-6437-440c-9ec0-cf4ccdb88536 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:58:38 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-cc34b933-6437-440c-9ec0-cf4ccdb88536 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:58:38 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-cc34b933-6437-440c-9ec0-cf4ccdb88536 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-1577f970-8f77-48b3-9802-71b94e04f5c7 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:38 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_93765a35-6312-41bf-aaa6-a4b7c6d4ffa7_9ip7durj" returned: 1 in 0.413s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:38 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_93765a35-6312-41bf-aaa6-a4b7c6d4ffa7_9ip7durj' failed. Not Retrying. {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 22:58:38 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea07d13d-89ae-4e88-aad1-7add689c5fc0]: (4, 'raw') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:58:38 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_93765a35-6312-41bf-aaa6-a4b7c6d4ffa7_sd_t6lp0devstack@QuobyteHD {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:38 devstack sudo[106653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-1577f970-8f77-48b3-9802-71b94e04f5c7 1073741824 Sep 04 22:58:38 devstack sudo[106653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:38 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-37b5a65f-6f2c-4351-8af8-26274448da70 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (012b2f5e-2ed6-4b97-8e0b-015585b36ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a0e0d27-04ac-4c6a-ba82-5dc0f3cdbed5', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:38 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-37b5a65f-6f2c-4351-8af8-26274448da70 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10621ff0-3f82-4fd5-a7a7-37a571fe2c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:38 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-37b5a65f-6f2c-4351-8af8-26274448da70 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Volume volume-0a0e0d27-04ac-4c6a-ba82-5dc0f3cdbed5 (0a0e0d27-04ac-4c6a-ba82-5dc0f3cdbed5): created successfully Sep 04 22:58:38 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-37b5a65f-6f2c-4351-8af8-26274448da70 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10621ff0-3f82-4fd5-a7a7-37a571fe2c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:38 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-37b5a65f-6f2c-4351-8af8-26274448da70 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Flow 'volume_create_manager' (376cfe58-2619-49e3-ba6e-d8b534bb37e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:58:38 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-37b5a65f-6f2c-4351-8af8-26274448da70 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Created volume successfully. Sep 04 22:58:38 devstack sudo[106654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_93765a35-6312-41bf-aaa6-a4b7c6d4ffa7_sd_t6lp0devstack@QuobyteHD Sep 04 22:58:38 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:39 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f594361b-a172-41c6-b3c8-9d7586800339 tempest-CreateVolumesFromImageTest-1083081755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c88ff913-df84-4ccd-96c0-83db388e35bd" returned: 0 in 0.447s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f594361b-a172-41c6-b3c8-9d7586800339 tempest-CreateVolumesFromImageTest-1083081755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c88ff913-df84-4ccd-96c0-83db388e35bd {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:39 devstack sudo[106661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c88ff913-df84-4ccd-96c0-83db388e35bd Sep 04 22:58:39 devstack sudo[106661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:39 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_93765a35-6312-41bf-aaa6-a4b7c6d4ffa7_sd_t6lp0devstack@QuobyteHD" returned: 0 in 0.395s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_93765a35-6312-41bf-aaa6-a4b7c6d4ffa7_sd_t6lp0devstack@QuobyteHD {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:39 devstack sudo[106653]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-cc34b933-6437-440c-9ec0-cf4ccdb88536 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-1577f970-8f77-48b3-9802-71b94e04f5c7 1073741824" returned: 0 in 0.447s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-cc34b933-6437-440c-9ec0-cf4ccdb88536 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-1577f970-8f77-48b3-9802-71b94e04f5c7 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:39 devstack sudo[106669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-1577f970-8f77-48b3-9802-71b94e04f5c7 Sep 04 22:58:39 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:39 devstack sudo[106661]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f594361b-a172-41c6-b3c8-9d7586800339 tempest-CreateVolumesFromImageTest-1083081755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c88ff913-df84-4ccd-96c0-83db388e35bd" returned: 0 in 0.306s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:39 devstack sudo[106667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_93765a35-6312-41bf-aaa6-a4b7c6d4ffa7_sd_t6lp0devstack@QuobyteHD Sep 04 22:58:39 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:39 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f594361b-a172-41c6-b3c8-9d7586800339 tempest-CreateVolumesFromImageTest-1083081755 None] Lock "cinder-quobyte-c88ff913-df84-4ccd-96c0-83db388e35bd" released by "delete_volume" :: held 0.806s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:58:39 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-f594361b-a172-41c6-b3c8-9d7586800339 tempest-CreateVolumesFromImageTest-1083081755 None] Created reservations ['ecafe50d-9d7a-4f4e-9774-951eeaf65c0f', '52933de7-0b07-4d8e-aeb2-b3deb205d80f', 'e18e8ecd-ca81-4b7d-94f6-119f0ae177be', 'c78dd486-5048-4fd0-81f0-e1705b71a446'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:58:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f594361b-a172-41c6-b3c8-9d7586800339 tempest-CreateVolumesFromImageTest-1083081755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:58:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f594361b-a172-41c6-b3c8-9d7586800339 tempest-CreateVolumesFromImageTest-1083081755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:58:39 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-f594361b-a172-41c6-b3c8-9d7586800339 tempest-CreateVolumesFromImageTest-1083081755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:58:39 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-f594361b-a172-41c6-b3c8-9d7586800339 tempest-CreateVolumesFromImageTest-1083081755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:58:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f594361b-a172-41c6-b3c8-9d7586800339 tempest-CreateVolumesFromImageTest-1083081755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:58:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f594361b-a172-41c6-b3c8-9d7586800339 tempest-CreateVolumesFromImageTest-1083081755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:39 devstack sudo[106672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:58:39 devstack sudo[106672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:39 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-cc34b933-6437-440c-9ec0-cf4ccdb88536 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-1577f970-8f77-48b3-9802-71b94e04f5c7" returned: 0 in 0.272s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:39 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-cc34b933-6437-440c-9ec0-cf4ccdb88536 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:58:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-cc34b933-6437-440c-9ec0-cf4ccdb88536 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:58:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-5778456f-632d-4e73-ad2f-2dd88880d1d7 tempest-CinderUnicodeTest-9741368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.707s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:58:39 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:39 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-5778456f-632d-4e73-ad2f-2dd88880d1d7 tempest-CinderUnicodeTest-9741368 None] Creating offline snapshot 28f23f36-0f31-4e52-bdf7-7c4c7b2a9d52 of volume 42ec3740-81ed-44ad-9838-132407513835 {{(pid=87576) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 22:58:39 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-cc34b933-6437-440c-9ec0-cf4ccdb88536 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3563d9c9-773b-49e7-99c2-78911e12bea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1577f970-8f77-48b3-9802-71b94e04f5c7', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:39 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-cc34b933-6437-440c-9ec0-cf4ccdb88536 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a86684d4-0ae9-4655-88fe-b7cb364df793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:39 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c8d36d04-6304-44b5-bdd2-d9d5d982401f tempest-CreateVolumesFromImageTest-1083081755 None] Acquiring lock "cinder-22d207d2-9653-4307-9d4b-705916e6db9a-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:58:39 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeccfa14-c689-4b0f-92fb-06c0c7592314]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:58:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5778456f-632d-4e73-ad2f-2dd88880d1d7 tempest-CinderUnicodeTest-9741368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42ec3740-81ed-44ad-9838-132407513835 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_93765a35-6312-41bf-aaa6-a4b7c6d4ffa7_sd_t6lp0devstack@QuobyteHD" returned: 1 in 0.429s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_93765a35-6312-41bf-aaa6-a4b7c6d4ffa7_sd_t6lp0devstack@QuobyteHD' failed. Not Retrying. {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 22:58:39 devstack cinder-volume[87576]: DEBUG cinder.image.image_utils [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] 93765a35-6312-41bf-aaa6-a4b7c6d4ffa7 was raw, converting to qcow2 {{(pid=87576) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 04 22:58:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_93765a35-6312-41bf-aaa6-a4b7c6d4ffa7_sd_t6lp0devstack@QuobyteHD /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7da10008-72e3-4b46-8ca9-f2c1909c1239 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:39 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-cc34b933-6437-440c-9ec0-cf4ccdb88536 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Volume volume-1577f970-8f77-48b3-9802-71b94e04f5c7 (1577f970-8f77-48b3-9802-71b94e04f5c7): created successfully Sep 04 22:58:39 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-cc34b933-6437-440c-9ec0-cf4ccdb88536 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a86684d4-0ae9-4655-88fe-b7cb364df793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:39 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-cc34b933-6437-440c-9ec0-cf4ccdb88536 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Flow 'volume_create_manager' (1b3d93db-2915-4836-8a2a-4455b8c95753) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:58:39 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c8d36d04-6304-44b5-bdd2-d9d5d982401f tempest-CreateVolumesFromImageTest-1083081755 None] Lock "cinder-22d207d2-9653-4307-9d4b-705916e6db9a-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:58:39 devstack sudo[106679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_93765a35-6312-41bf-aaa6-a4b7c6d4ffa7_sd_t6lp0devstack@QuobyteHD /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7da10008-72e3-4b46-8ca9-f2c1909c1239 Sep 04 22:58:39 devstack sudo[106679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:39 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-cc34b933-6437-440c-9ec0-cf4ccdb88536 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Created volume successfully. Sep 04 22:58:39 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c8d36d04-6304-44b5-bdd2-d9d5d982401f tempest-CreateVolumesFromImageTest-1083081755 None] Acquiring lock "cinder-quobyte-22d207d2-9653-4307-9d4b-705916e6db9a" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:58:39 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c8d36d04-6304-44b5-bdd2-d9d5d982401f tempest-CreateVolumesFromImageTest-1083081755 None] Lock "cinder-quobyte-22d207d2-9653-4307-9d4b-705916e6db9a" acquired by "delete_volume" :: waited 0.024s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:58:39 devstack sudo[106672]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f594361b-a172-41c6-b3c8-9d7586800339 tempest-CreateVolumesFromImageTest-1083081755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.324s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:39 devstack sudo[106678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42ec3740-81ed-44ad-9838-132407513835 Sep 04 22:58:39 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:39 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-f594361b-a172-41c6-b3c8-9d7586800339 tempest-CreateVolumesFromImageTest-1083081755 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:58:39 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-f594361b-a172-41c6-b3c8-9d7586800339 tempest-CreateVolumesFromImageTest-1083081755 None] Deleted volume successfully. Sep 04 22:58:39 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b2639d-092e-4ee2-9672-eda528ed767e]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:58:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c8d36d04-6304-44b5-bdd2-d9d5d982401f tempest-CreateVolumesFromImageTest-1083081755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-22d207d2-9653-4307-9d4b-705916e6db9a {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:39 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f594361b-a172-41c6-b3c8-9d7586800339 tempest-CreateVolumesFromImageTest-1083081755 None] Lock "cinder-c88ff913-df84-4ccd-96c0-83db388e35bd-delete_volume" released by "delete_volume" :: held 1.395s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:58:39 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c21ed81d-f93a-4788-94e2-01a948662fb0 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Acquiring lock "cinder-1577f970-8f77-48b3-9802-71b94e04f5c7-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:58:40 devstack sudo[106683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-22d207d2-9653-4307-9d4b-705916e6db9a Sep 04 22:58:40 devstack sudo[106683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:40 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c21ed81d-f93a-4788-94e2-01a948662fb0 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Lock "cinder-1577f970-8f77-48b3-9802-71b94e04f5c7-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:58:40 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c21ed81d-f93a-4788-94e2-01a948662fb0 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Acquiring lock "cinder-quobyte-1577f970-8f77-48b3-9802-71b94e04f5c7" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:58:40 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c21ed81d-f93a-4788-94e2-01a948662fb0 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Lock "cinder-quobyte-1577f970-8f77-48b3-9802-71b94e04f5c7" acquired by "delete_volume" :: waited 0.020s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:58:40 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5778456f-632d-4e73-ad2f-2dd88880d1d7 tempest-CinderUnicodeTest-9741368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42ec3740-81ed-44ad-9838-132407513835" returned: 0 in 0.496s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5778456f-632d-4e73-ad2f-2dd88880d1d7 tempest-CinderUnicodeTest-9741368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42ec3740-81ed-44ad-9838-132407513835,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42ec3740-81ed-44ad-9838-132407513835.28f23f36-0f31-4e52-bdf7-7c4c7b2a9d52 1G {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:40 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[66af4b51-616d-4374-8690-fd4e9e4e0642]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:58:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c21ed81d-f93a-4788-94e2-01a948662fb0 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-1577f970-8f77-48b3-9802-71b94e04f5c7 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:40 devstack sudo[106692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42ec3740-81ed-44ad-9838-132407513835,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42ec3740-81ed-44ad-9838-132407513835.28f23f36-0f31-4e52-bdf7-7c4c7b2a9d52 1G Sep 04 22:58:40 devstack sudo[106692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:40 devstack sudo[106693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-1577f970-8f77-48b3-9802-71b94e04f5c7 Sep 04 22:58:40 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:40 devstack sudo[106679]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_93765a35-6312-41bf-aaa6-a4b7c6d4ffa7_sd_t6lp0devstack@QuobyteHD /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7da10008-72e3-4b46-8ca9-f2c1909c1239" returned: 0 in 0.651s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:40 devstack cinder-volume[87576]: DEBUG cinder.image.image_utils [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_93765a35-6312-41bf-aaa6-a4b7c6d4ffa7_sd_t6lp0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7da10008-72e3-4b46-8ca9-f2c1909c1239 {{(pid=87576) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 22:58:40 devstack cinder-volume[87576]: INFO cinder.image.image_utils [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] Converted 0.00 MB image at 0.00 MB/s Sep 04 22:58:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7da10008-72e3-4b46-8ca9-f2c1909c1239 1G {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:40 devstack sudo[106683]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:40 devstack sudo[106699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7da10008-72e3-4b46-8ca9-f2c1909c1239 1G Sep 04 22:58:40 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c8d36d04-6304-44b5-bdd2-d9d5d982401f tempest-CreateVolumesFromImageTest-1083081755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-22d207d2-9653-4307-9d4b-705916e6db9a" returned: 0 in 0.525s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c8d36d04-6304-44b5-bdd2-d9d5d982401f tempest-CreateVolumesFromImageTest-1083081755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-22d207d2-9653-4307-9d4b-705916e6db9a {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:40 devstack sudo[106701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-22d207d2-9653-4307-9d4b-705916e6db9a Sep 04 22:58:40 devstack sudo[106701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:40 devstack sudo[106692]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:40 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5778456f-632d-4e73-ad2f-2dd88880d1d7 tempest-CinderUnicodeTest-9741368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42ec3740-81ed-44ad-9838-132407513835,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42ec3740-81ed-44ad-9838-132407513835.28f23f36-0f31-4e52-bdf7-7c4c7b2a9d52 1G" returned: 0 in 0.431s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5778456f-632d-4e73-ad2f-2dd88880d1d7 tempest-CinderUnicodeTest-9741368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42ec3740-81ed-44ad-9838-132407513835 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42ec3740-81ed-44ad-9838-132407513835.28f23f36-0f31-4e52-bdf7-7c4c7b2a9d52 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c21ed81d-f93a-4788-94e2-01a948662fb0 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-1577f970-8f77-48b3-9802-71b94e04f5c7" returned: 0 in 0.420s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c21ed81d-f93a-4788-94e2-01a948662fb0 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-1577f970-8f77-48b3-9802-71b94e04f5c7 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:40 devstack sudo[106711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42ec3740-81ed-44ad-9838-132407513835 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42ec3740-81ed-44ad-9838-132407513835.28f23f36-0f31-4e52-bdf7-7c4c7b2a9d52 Sep 04 22:58:40 devstack sudo[106711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:40 devstack sudo[106715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-1577f970-8f77-48b3-9802-71b94e04f5c7 Sep 04 22:58:40 devstack sudo[106715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:40 devstack sudo[106701]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c8d36d04-6304-44b5-bdd2-d9d5d982401f tempest-CreateVolumesFromImageTest-1083081755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-22d207d2-9653-4307-9d4b-705916e6db9a" returned: 0 in 0.275s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:40 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c8d36d04-6304-44b5-bdd2-d9d5d982401f tempest-CreateVolumesFromImageTest-1083081755 None] Lock "cinder-quobyte-22d207d2-9653-4307-9d4b-705916e6db9a" released by "delete_volume" :: held 0.862s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:58:40 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-c8d36d04-6304-44b5-bdd2-d9d5d982401f tempest-CreateVolumesFromImageTest-1083081755 None] Created reservations ['c242193e-46fd-4eeb-9f04-ce9514ec7a42', 'a82bb75e-0a6b-4f89-ae04-8730c4cf0902', 'b9e997b4-7ed8-495f-8f6f-af02f1c810c1', 'f8cd283b-bfaa-4838-b2e0-043c663ed0ae'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:58:40 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7da10008-72e3-4b46-8ca9-f2c1909c1239 1G" returned: 0 in 0.401s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:40 devstack cinder-volume[87576]: DEBUG cinder.volume.volume_utils [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] Downloaded image 93765a35-6312-41bf-aaa6-a4b7c6d4ffa7 ((None, [{'url': 'file:///opt/stack/data/glance/images/93765a35-6312-41bf-aaa6-a4b7c6d4ffa7', 'metadata': {}}])) to volume 7da10008-72e3-4b46-8ca9-f2c1909c1239 successfully. {{(pid=87576) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 04 22:58:40 devstack cinder-volume[87576]: DEBUG cinder.image.image_utils [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] Temporary image 93765a35-6312-41bf-aaa6-a4b7c6d4ffa7 for user d8efa80b9f9b4eae8afcc613a7359195 is deleted. {{(pid=87576) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 04 22:58:40 devstack cinder-volume[87576]: DEBUG cinder.volume.volume_utils [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] Marking volume 7da10008-72e3-4b46-8ca9-f2c1909c1239 as bootable. {{(pid=87576) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 04 22:58:40 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] Copying metadata from image 93765a35-6312-41bf-aaa6-a4b7c6d4ffa7 to 7da10008-72e3-4b46-8ca9-f2c1909c1239. {{(pid=87576) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 04 22:58:40 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] Creating volume glance metadata for volume 7da10008-72e3-4b46-8ca9-f2c1909c1239 backed by image 93765a35-6312-41bf-aaa6-a4b7c6d4ffa7 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '93765a35-6312-41bf-aaa6-a4b7c6d4ffa7', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '5fc79dc18cbababafcf6e75ebd0abdbc', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87576) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 04 22:58:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-c8d36d04-6304-44b5-bdd2-d9d5d982401f tempest-CreateVolumesFromImageTest-1083081755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:58:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-c8d36d04-6304-44b5-bdd2-d9d5d982401f tempest-CreateVolumesFromImageTest-1083081755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:58:40 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-c8d36d04-6304-44b5-bdd2-d9d5d982401f tempest-CreateVolumesFromImageTest-1083081755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:58:40 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-c8d36d04-6304-44b5-bdd2-d9d5d982401f tempest-CreateVolumesFromImageTest-1083081755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:58:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-c8d36d04-6304-44b5-bdd2-d9d5d982401f tempest-CreateVolumesFromImageTest-1083081755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:58:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c8d36d04-6304-44b5-bdd2-d9d5d982401f tempest-CreateVolumesFromImageTest-1083081755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:40 devstack sudo[106715]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:40 devstack sudo[106721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:58:40 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:40 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1e22855-fe3a-4317-b665-101f2e9bd223) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7da10008-72e3-4b46-8ca9-f2c1909c1239', 'volume_size': 1, 'image_id': '93765a35-6312-41bf-aaa6-a4b7c6d4ffa7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/93765a35-6312-41bf-aaa6-a4b7c6d4ffa7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5fc79dc18cbababafcf6e75ebd0abdbc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1d176668d70e4496ba3c03b309f70dc2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3e1311287d1c04fcb907ec0a5ff5652c8da966f93e7714d33aa76d0d2919fa94cfaadb7e88d9cf49c8d93c6a97772b5e6d8e1cc98bf3e930e3cd6481aacc4ca4', 'id': '93765a35-6312-41bf-aaa6-a4b7c6d4ffa7', 'created_at': datetime.datetime(2026, 9, 4, 20, 58, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 20, 58, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/93765a35-6312-41bf-aaa6-a4b7c6d4ffa7/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:40 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0d93235-07e5-4df3-b87d-e5cfd89bdcfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c21ed81d-f93a-4788-94e2-01a948662fb0 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-1577f970-8f77-48b3-9802-71b94e04f5c7" returned: 0 in 0.312s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:40 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c21ed81d-f93a-4788-94e2-01a948662fb0 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Lock "cinder-quobyte-1577f970-8f77-48b3-9802-71b94e04f5c7" released by "delete_volume" :: held 0.791s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:58:40 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] Volume volume-7da10008-72e3-4b46-8ca9-f2c1909c1239 (7da10008-72e3-4b46-8ca9-f2c1909c1239): created successfully Sep 04 22:58:40 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0d93235-07e5-4df3-b87d-e5cfd89bdcfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:40 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] Flow 'volume_create_manager' (0de5a38f-3cfc-477c-8c24-2a06e50326ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:58:40 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-0030cb62-1ed5-43cc-8e46-11770e14e3a4 tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] Created volume successfully. Sep 04 22:58:40 devstack sudo[106711]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:40 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-c21ed81d-f93a-4788-94e2-01a948662fb0 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Created reservations ['b505b9e7-8cb7-4c11-8c17-28dd07396d30', '780a1cfe-0fa1-4700-a999-70e9d753f3ae', '42bfed37-3cd4-4772-802c-2ec7abfd8265', 'b6fb75c4-c081-4826-89d6-2824f4541ed3'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:58:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5778456f-632d-4e73-ad2f-2dd88880d1d7 tempest-CinderUnicodeTest-9741368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42ec3740-81ed-44ad-9838-132407513835 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42ec3740-81ed-44ad-9838-132407513835.28f23f36-0f31-4e52-bdf7-7c4c7b2a9d52" returned: 0 in 0.419s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:40 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-5778456f-632d-4e73-ad2f-2dd88880d1d7 tempest-CinderUnicodeTest-9741368 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42ec3740-81ed-44ad-9838-132407513835.28f23f36-0f31-4e52-bdf7-7c4c7b2a9d52 is being set with open permissions: ugo+rw Sep 04 22:58:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5778456f-632d-4e73-ad2f-2dd88880d1d7 tempest-CinderUnicodeTest-9741368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42ec3740-81ed-44ad-9838-132407513835.28f23f36-0f31-4e52-bdf7-7c4c7b2a9d52 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:41 devstack sudo[106726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42ec3740-81ed-44ad-9838-132407513835.28f23f36-0f31-4e52-bdf7-7c4c7b2a9d52 Sep 04 22:58:41 devstack sudo[106726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-c21ed81d-f93a-4788-94e2-01a948662fb0 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:58:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-c21ed81d-f93a-4788-94e2-01a948662fb0 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:58:41 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-c21ed81d-f93a-4788-94e2-01a948662fb0 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:58:41 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-c21ed81d-f93a-4788-94e2-01a948662fb0 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:58:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-c21ed81d-f93a-4788-94e2-01a948662fb0 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:58:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c21ed81d-f93a-4788-94e2-01a948662fb0 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:41 devstack sudo[106728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:58:41 devstack sudo[106728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:41 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c8d36d04-6304-44b5-bdd2-d9d5d982401f tempest-CreateVolumesFromImageTest-1083081755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.317s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:41 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-c8d36d04-6304-44b5-bdd2-d9d5d982401f tempest-CreateVolumesFromImageTest-1083081755 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:58:41 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-c8d36d04-6304-44b5-bdd2-d9d5d982401f tempest-CreateVolumesFromImageTest-1083081755 None] Deleted volume successfully. Sep 04 22:58:41 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c8d36d04-6304-44b5-bdd2-d9d5d982401f tempest-CreateVolumesFromImageTest-1083081755 None] Lock "cinder-22d207d2-9653-4307-9d4b-705916e6db9a-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:58:41 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f7e025a1-a294-45b7-aa97-9177c27dc7ea tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Acquiring lock "cinder-0a0e0d27-04ac-4c6a-ba82-5dc0f3cdbed5-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:58:41 devstack sudo[106726]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5778456f-632d-4e73-ad2f-2dd88880d1d7 tempest-CinderUnicodeTest-9741368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42ec3740-81ed-44ad-9838-132407513835.28f23f36-0f31-4e52-bdf7-7c4c7b2a9d52" returned: 0 in 0.296s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:41 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f7e025a1-a294-45b7-aa97-9177c27dc7ea tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Lock "cinder-0a0e0d27-04ac-4c6a-ba82-5dc0f3cdbed5-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:58:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5778456f-632d-4e73-ad2f-2dd88880d1d7 tempest-CinderUnicodeTest-9741368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42ec3740-81ed-44ad-9838-132407513835.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:41 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-156bf772-ba24-4e45-9668-eaf5fe5c10fc tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] Acquiring lock "cinder-7da10008-72e3-4b46-8ca9-f2c1909c1239-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:58:41 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f7e025a1-a294-45b7-aa97-9177c27dc7ea tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Acquiring lock "cinder-quobyte-0a0e0d27-04ac-4c6a-ba82-5dc0f3cdbed5" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:58:41 devstack sudo[106732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42ec3740-81ed-44ad-9838-132407513835.info Sep 04 22:58:41 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:41 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f7e025a1-a294-45b7-aa97-9177c27dc7ea tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Lock "cinder-quobyte-0a0e0d27-04ac-4c6a-ba82-5dc0f3cdbed5" acquired by "delete_volume" :: waited 0.024s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:58:41 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-156bf772-ba24-4e45-9668-eaf5fe5c10fc tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] Lock "cinder-7da10008-72e3-4b46-8ca9-f2c1909c1239-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:58:41 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee21741-ea10-49d7-b5ea-7707a7e38c07]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:58:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f7e025a1-a294-45b7-aa97-9177c27dc7ea tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-0a0e0d27-04ac-4c6a-ba82-5dc0f3cdbed5 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:41 devstack sudo[106728]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c21ed81d-f93a-4788-94e2-01a948662fb0 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.386s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:41 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-c21ed81d-f93a-4788-94e2-01a948662fb0 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:58:41 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-c21ed81d-f93a-4788-94e2-01a948662fb0 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Deleted volume successfully. Sep 04 22:58:41 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-156bf772-ba24-4e45-9668-eaf5fe5c10fc tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] Acquiring lock "cinder-quobyte-7da10008-72e3-4b46-8ca9-f2c1909c1239" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:58:41 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c21ed81d-f93a-4788-94e2-01a948662fb0 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Lock "cinder-1577f970-8f77-48b3-9802-71b94e04f5c7-delete_volume" released by "delete_volume" :: held 1.474s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:58:41 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-156bf772-ba24-4e45-9668-eaf5fe5c10fc tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] Lock "cinder-quobyte-7da10008-72e3-4b46-8ca9-f2c1909c1239" acquired by "delete_volume" :: waited 0.022s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:58:41 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a1e0d56-a16c-4f36-a092-e78dad2b200e]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:58:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-156bf772-ba24-4e45-9668-eaf5fe5c10fc tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7da10008-72e3-4b46-8ca9-f2c1909c1239 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:41 devstack sudo[106735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-0a0e0d27-04ac-4c6a-ba82-5dc0f3cdbed5 Sep 04 22:58:41 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:41 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5778456f-632d-4e73-ad2f-2dd88880d1d7 tempest-CinderUnicodeTest-9741368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42ec3740-81ed-44ad-9838-132407513835.info" returned: 0 in 0.309s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:41 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-5778456f-632d-4e73-ad2f-2dd88880d1d7 tempest-CinderUnicodeTest-9741368 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42ec3740-81ed-44ad-9838-132407513835.info is being set with open permissions: ugo+rw Sep 04 22:58:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5778456f-632d-4e73-ad2f-2dd88880d1d7 tempest-CinderUnicodeTest-9741368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42ec3740-81ed-44ad-9838-132407513835.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:41 devstack sudo[106736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7da10008-72e3-4b46-8ca9-f2c1909c1239 Sep 04 22:58:41 devstack sudo[106736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:41 devstack sudo[106739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42ec3740-81ed-44ad-9838-132407513835.info Sep 04 22:58:41 devstack sudo[106739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:41 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f7e025a1-a294-45b7-aa97-9177c27dc7ea tempest-CreateVolumesFromSourceVolumeTest-649217495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-0a0e0d27-04ac-4c6a-ba82-5dc0f3cdbed5" returned: 0 in 0.421s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f7e025a1-a294-45b7-aa97-9177c27dc7ea tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-0a0e0d27-04ac-4c6a-ba82-5dc0f3cdbed5 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:41 devstack sudo[106745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-0a0e0d27-04ac-4c6a-ba82-5dc0f3cdbed5 Sep 04 22:58:41 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:41 devstack sudo[106739]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5778456f-632d-4e73-ad2f-2dd88880d1d7 tempest-CinderUnicodeTest-9741368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42ec3740-81ed-44ad-9838-132407513835.info" returned: 0 in 0.273s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-5778456f-632d-4e73-ad2f-2dd88880d1d7 tempest-CinderUnicodeTest-9741368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.389s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:58:41 devstack sudo[106736]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-156bf772-ba24-4e45-9668-eaf5fe5c10fc tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7da10008-72e3-4b46-8ca9-f2c1909c1239" returned: 0 in 0.439s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-156bf772-ba24-4e45-9668-eaf5fe5c10fc tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7da10008-72e3-4b46-8ca9-f2c1909c1239 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:42 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-5778456f-632d-4e73-ad2f-2dd88880d1d7 tempest-CinderUnicodeTest-9741368 None] Create snapshot completed successfully Sep 04 22:58:42 devstack sudo[106751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7da10008-72e3-4b46-8ca9-f2c1909c1239 Sep 04 22:58:42 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:42 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f7e025a1-a294-45b7-aa97-9177c27dc7ea tempest-CreateVolumesFromSourceVolumeTest-649217495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-0a0e0d27-04ac-4c6a-ba82-5dc0f3cdbed5" returned: 0 in 0.316s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:42 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f7e025a1-a294-45b7-aa97-9177c27dc7ea tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Lock "cinder-quobyte-0a0e0d27-04ac-4c6a-ba82-5dc0f3cdbed5" released by "delete_volume" :: held 0.800s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:58:42 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-66378eb5-acf5-4471-9536-243b9821cfe9 tempest-CinderUnicodeTest-9741368 None] Acquiring lock "cinder-28f23f36-0f31-4e52-bdf7-7c4c7b2a9d52-delete_snapshot" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:58:42 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-66378eb5-acf5-4471-9536-243b9821cfe9 tempest-CinderUnicodeTest-9741368 None] Lock "cinder-28f23f36-0f31-4e52-bdf7-7c4c7b2a9d52-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:58:42 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-66378eb5-acf5-4471-9536-243b9821cfe9 tempest-CinderUnicodeTest-9741368 None] Acquiring lock "cinder-quobyte-42ec3740-81ed-44ad-9838-132407513835" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:58:42 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-66378eb5-acf5-4471-9536-243b9821cfe9 tempest-CinderUnicodeTest-9741368 None] Lock "cinder-quobyte-42ec3740-81ed-44ad-9838-132407513835" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:58:42 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-66378eb5-acf5-4471-9536-243b9821cfe9 tempest-CinderUnicodeTest-9741368 None] Acquiring lock "cinder-quobyte-28f23f36-0f31-4e52-bdf7-7c4c7b2a9d52" by "_delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:58:42 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-66378eb5-acf5-4471-9536-243b9821cfe9 tempest-CinderUnicodeTest-9741368 None] Lock "cinder-quobyte-28f23f36-0f31-4e52-bdf7-7c4c7b2a9d52" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:58:42 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-66378eb5-acf5-4471-9536-243b9821cfe9 tempest-CinderUnicodeTest-9741368 None] Deleting offline snapshot 28f23f36-0f31-4e52-bdf7-7c4c7b2a9d52 of volume 42ec3740-81ed-44ad-9838-132407513835 {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 22:58:42 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-66378eb5-acf5-4471-9536-243b9821cfe9 tempest-CinderUnicodeTest-9741368 None] snapshot_file for this snap is: volume-42ec3740-81ed-44ad-9838-132407513835.28f23f36-0f31-4e52-bdf7-7c4c7b2a9d52 {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 22:58:42 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-f7e025a1-a294-45b7-aa97-9177c27dc7ea tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Created reservations ['7f36589d-0d6b-4e30-bb83-02442618aee3', 'ae9ac399-daa5-4de7-8d89-e4a411f4b143', '4d1a0e73-9e0a-4c5b-a96c-93b136090ad5', '7d01ddd5-dbf9-4291-94d3-c354e59d7977'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:58:42 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-156bf772-ba24-4e45-9668-eaf5fe5c10fc tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-7da10008-72e3-4b46-8ca9-f2c1909c1239" returned: 0 in 0.379s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:42 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a41878b-807c-4f4b-90a2-d54c5d6344c7]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:58:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-66378eb5-acf5-4471-9536-243b9821cfe9 tempest-CinderUnicodeTest-9741368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42ec3740-81ed-44ad-9838-132407513835.28f23f36-0f31-4e52-bdf7-7c4c7b2a9d52 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:42 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-156bf772-ba24-4e45-9668-eaf5fe5c10fc tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] Lock "cinder-quobyte-7da10008-72e3-4b46-8ca9-f2c1909c1239" released by "delete_volume" :: held 0.896s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:58:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f7e025a1-a294-45b7-aa97-9177c27dc7ea tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:58:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f7e025a1-a294-45b7-aa97-9177c27dc7ea tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:58:42 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-f7e025a1-a294-45b7-aa97-9177c27dc7ea tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:58:42 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-f7e025a1-a294-45b7-aa97-9177c27dc7ea tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:58:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f7e025a1-a294-45b7-aa97-9177c27dc7ea tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:58:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f7e025a1-a294-45b7-aa97-9177c27dc7ea tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:42 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-156bf772-ba24-4e45-9668-eaf5fe5c10fc tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] Created reservations ['ecf4d128-ac1c-430a-891e-13160255edbb', 'c825f497-4aa4-44d3-9697-af21f61472c0', '9fe9d06e-baad-417e-87b1-060045088df9', 'bc0563ee-aef8-44fb-b232-e7c690c76984'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:58:42 devstack sudo[106756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:58:42 devstack sudo[106756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:42 devstack sudo[106755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42ec3740-81ed-44ad-9838-132407513835.28f23f36-0f31-4e52-bdf7-7c4c7b2a9d52 Sep 04 22:58:42 devstack sudo[106755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-156bf772-ba24-4e45-9668-eaf5fe5c10fc tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:58:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-156bf772-ba24-4e45-9668-eaf5fe5c10fc tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:58:42 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-156bf772-ba24-4e45-9668-eaf5fe5c10fc tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:58:42 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-156bf772-ba24-4e45-9668-eaf5fe5c10fc tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:58:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-156bf772-ba24-4e45-9668-eaf5fe5c10fc tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:58:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-156bf772-ba24-4e45-9668-eaf5fe5c10fc tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:42 devstack sudo[106759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:58:42 devstack sudo[106759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:42 devstack sudo[106756]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f7e025a1-a294-45b7-aa97-9177c27dc7ea tempest-CreateVolumesFromSourceVolumeTest-649217495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.303s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:42 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-f7e025a1-a294-45b7-aa97-9177c27dc7ea tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:58:42 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-f7e025a1-a294-45b7-aa97-9177c27dc7ea tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Deleted volume successfully. Sep 04 22:58:42 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f7e025a1-a294-45b7-aa97-9177c27dc7ea tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Lock "cinder-0a0e0d27-04ac-4c6a-ba82-5dc0f3cdbed5-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:58:42 devstack sudo[106755]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-66378eb5-acf5-4471-9536-243b9821cfe9 tempest-CinderUnicodeTest-9741368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42ec3740-81ed-44ad-9838-132407513835.28f23f36-0f31-4e52-bdf7-7c4c7b2a9d52" returned: 0 in 0.507s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:42 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-66378eb5-acf5-4471-9536-243b9821cfe9 tempest-CinderUnicodeTest-9741368 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42ec3740-81ed-44ad-9838-132407513835(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 22:58:42 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[b166eff8-757e-429c-9110-61c75e4d4db5]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:58:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-66378eb5-acf5-4471-9536-243b9821cfe9 tempest-CinderUnicodeTest-9741368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42ec3740-81ed-44ad-9838-132407513835 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:42 devstack sudo[106759]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-156bf772-ba24-4e45-9668-eaf5fe5c10fc tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.326s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:42 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-156bf772-ba24-4e45-9668-eaf5fe5c10fc tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:58:42 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-156bf772-ba24-4e45-9668-eaf5fe5c10fc tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] Deleted volume successfully. Sep 04 22:58:42 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-156bf772-ba24-4e45-9668-eaf5fe5c10fc tempest-VolumeAndVolumeTypeFromImageTest-1468417603 None] Lock "cinder-7da10008-72e3-4b46-8ca9-f2c1909c1239-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:58:43 devstack sudo[106766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42ec3740-81ed-44ad-9838-132407513835 Sep 04 22:58:43 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:43 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-66378eb5-acf5-4471-9536-243b9821cfe9 tempest-CinderUnicodeTest-9741368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42ec3740-81ed-44ad-9838-132407513835" returned: 0 in 0.411s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-66378eb5-acf5-4471-9536-243b9821cfe9 tempest-CinderUnicodeTest-9741368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42ec3740-81ed-44ad-9838-132407513835.28f23f36-0f31-4e52-bdf7-7c4c7b2a9d52 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:43 devstack sudo[106773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42ec3740-81ed-44ad-9838-132407513835.28f23f36-0f31-4e52-bdf7-7c4c7b2a9d52 Sep 04 22:58:43 devstack sudo[106773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:43 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-690762c9-2adb-45cd-8fa9-2bc55b07227c tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Acquiring lock "cinder-e6e71b68-577a-4bd2-8504-80b9b0c9982c-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:58:43 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-690762c9-2adb-45cd-8fa9-2bc55b07227c tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Lock "cinder-e6e71b68-577a-4bd2-8504-80b9b0c9982c-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:58:43 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-690762c9-2adb-45cd-8fa9-2bc55b07227c tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Acquiring lock "cinder-quobyte-e6e71b68-577a-4bd2-8504-80b9b0c9982c" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:58:43 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-690762c9-2adb-45cd-8fa9-2bc55b07227c tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Lock "cinder-quobyte-e6e71b68-577a-4bd2-8504-80b9b0c9982c" acquired by "delete_volume" :: waited 0.027s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:58:43 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f92c6f-f482-4a46-b4ec-986c19b294da]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:58:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-690762c9-2adb-45cd-8fa9-2bc55b07227c tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e6e71b68-577a-4bd2-8504-80b9b0c9982c {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:43 devstack sudo[106773]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-66378eb5-acf5-4471-9536-243b9821cfe9 tempest-CinderUnicodeTest-9741368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42ec3740-81ed-44ad-9838-132407513835.28f23f36-0f31-4e52-bdf7-7c4c7b2a9d52" returned: 0 in 0.490s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-66378eb5-acf5-4471-9536-243b9821cfe9 tempest-CinderUnicodeTest-9741368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42ec3740-81ed-44ad-9838-132407513835.28f23f36-0f31-4e52-bdf7-7c4c7b2a9d52 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:43 devstack sudo[106781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42ec3740-81ed-44ad-9838-132407513835.28f23f36-0f31-4e52-bdf7-7c4c7b2a9d52 Sep 04 22:58:43 devstack sudo[106781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:43 devstack sudo[106779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e6e71b68-577a-4bd2-8504-80b9b0c9982c Sep 04 22:58:43 devstack sudo[106779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:44 devstack sudo[106781]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:44 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-66378eb5-acf5-4471-9536-243b9821cfe9 tempest-CinderUnicodeTest-9741368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42ec3740-81ed-44ad-9838-132407513835.28f23f36-0f31-4e52-bdf7-7c4c7b2a9d52" returned: 0 in 0.303s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:44 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-66378eb5-acf5-4471-9536-243b9821cfe9 tempest-CinderUnicodeTest-9741368 None] Lock "cinder-quobyte-28f23f36-0f31-4e52-bdf7-7c4c7b2a9d52" released by "_delete_snapshot" :: held 1.873s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:58:44 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-66378eb5-acf5-4471-9536-243b9821cfe9 tempest-CinderUnicodeTest-9741368 None] Lock "cinder-quobyte-42ec3740-81ed-44ad-9838-132407513835" released by "delete_snapshot" :: held 1.914s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:58:44 devstack sudo[106779]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:44 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-690762c9-2adb-45cd-8fa9-2bc55b07227c tempest-CreateVolumesFromSourceVolumeTest-649217495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e6e71b68-577a-4bd2-8504-80b9b0c9982c" returned: 0 in 0.482s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:44 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-690762c9-2adb-45cd-8fa9-2bc55b07227c tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e6e71b68-577a-4bd2-8504-80b9b0c9982c {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:44 devstack sudo[106788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e6e71b68-577a-4bd2-8504-80b9b0c9982c Sep 04 22:58:44 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:44 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-66378eb5-acf5-4471-9536-243b9821cfe9 tempest-CinderUnicodeTest-9741368 None] Created reservations ['ef2ee6f8-3d48-4da5-9552-65302b67a62f', '6b3e2076-335c-4aaa-a93a-1ec5b64d2153', '5ab70f08-6fec-40b8-9c77-4bc09cbbfc0f', 'fdbaf3b2-59ad-4dd8-8497-6a69494c1a78'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:58:44 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-66378eb5-acf5-4471-9536-243b9821cfe9 tempest-CinderUnicodeTest-9741368 None] Delete snapshot completed successfully. Sep 04 22:58:44 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-66378eb5-acf5-4471-9536-243b9821cfe9 tempest-CinderUnicodeTest-9741368 None] Lock "cinder-28f23f36-0f31-4e52-bdf7-7c4c7b2a9d52-delete_snapshot" released by "delete_snapshot" :: held 2.189s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:58:44 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:44 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-690762c9-2adb-45cd-8fa9-2bc55b07227c tempest-CreateVolumesFromSourceVolumeTest-649217495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-e6e71b68-577a-4bd2-8504-80b9b0c9982c" returned: 0 in 0.317s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:44 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-690762c9-2adb-45cd-8fa9-2bc55b07227c tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Lock "cinder-quobyte-e6e71b68-577a-4bd2-8504-80b9b0c9982c" released by "delete_volume" :: held 0.854s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:58:44 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-690762c9-2adb-45cd-8fa9-2bc55b07227c tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Created reservations ['42546d46-e1f7-476d-8a5b-0d5c244a5018', '20173a74-a054-4705-9dc6-a5f50c350326', '4380940e-828c-457e-bc25-820c16bc0421', '44210875-b163-4b52-87b3-8d5abd9ac3ee'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:58:44 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-690762c9-2adb-45cd-8fa9-2bc55b07227c tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:58:44 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-690762c9-2adb-45cd-8fa9-2bc55b07227c tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:58:44 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-690762c9-2adb-45cd-8fa9-2bc55b07227c tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:58:44 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-690762c9-2adb-45cd-8fa9-2bc55b07227c tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:58:44 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-690762c9-2adb-45cd-8fa9-2bc55b07227c tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:58:44 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-690762c9-2adb-45cd-8fa9-2bc55b07227c tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:44 devstack sudo[106791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:58:44 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:44 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c73e2093-7c36-4fc9-9bc7-8235e4cb92ad tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Acquiring lock "cinder-21eb224d-0f4a-4b70-91d3-59d694cf128c-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:58:44 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c73e2093-7c36-4fc9-9bc7-8235e4cb92ad tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Lock "cinder-21eb224d-0f4a-4b70-91d3-59d694cf128c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:58:44 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c73e2093-7c36-4fc9-9bc7-8235e4cb92ad tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Acquiring lock "cinder-quobyte-21eb224d-0f4a-4b70-91d3-59d694cf128c" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:58:44 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c73e2093-7c36-4fc9-9bc7-8235e4cb92ad tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Lock "cinder-quobyte-21eb224d-0f4a-4b70-91d3-59d694cf128c" acquired by "delete_volume" :: waited 0.027s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:58:44 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df351e7-4001-4ee5-9389-d88b4fb3adbd]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:58:44 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c73e2093-7c36-4fc9-9bc7-8235e4cb92ad tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-21eb224d-0f4a-4b70-91d3-59d694cf128c {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:45 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:45 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-690762c9-2adb-45cd-8fa9-2bc55b07227c tempest-CreateVolumesFromSourceVolumeTest-649217495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.355s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:45 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-690762c9-2adb-45cd-8fa9-2bc55b07227c tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:58:45 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-690762c9-2adb-45cd-8fa9-2bc55b07227c tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Deleted volume successfully. Sep 04 22:58:45 devstack sudo[106793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-21eb224d-0f4a-4b70-91d3-59d694cf128c Sep 04 22:58:45 devstack sudo[106793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:45 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-690762c9-2adb-45cd-8fa9-2bc55b07227c tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Lock "cinder-e6e71b68-577a-4bd2-8504-80b9b0c9982c-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:58:45 devstack sudo[106793]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:45 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c73e2093-7c36-4fc9-9bc7-8235e4cb92ad tempest-CreateVolumesFromSourceVolumeTest-649217495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-21eb224d-0f4a-4b70-91d3-59d694cf128c" returned: 0 in 0.458s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:45 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c73e2093-7c36-4fc9-9bc7-8235e4cb92ad tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-21eb224d-0f4a-4b70-91d3-59d694cf128c {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:45 devstack sudo[106799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-21eb224d-0f4a-4b70-91d3-59d694cf128c Sep 04 22:58:45 devstack sudo[106799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:45 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-1993fbd2-3ad7-42b7-959f-5769d1e0dac0 tempest-CinderUnicodeTest-9741368 None] Acquiring lock "cinder-42ec3740-81ed-44ad-9838-132407513835-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:58:45 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-1993fbd2-3ad7-42b7-959f-5769d1e0dac0 tempest-CinderUnicodeTest-9741368 None] Lock "cinder-42ec3740-81ed-44ad-9838-132407513835-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:58:45 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-1993fbd2-3ad7-42b7-959f-5769d1e0dac0 tempest-CinderUnicodeTest-9741368 None] Acquiring lock "cinder-quobyte-42ec3740-81ed-44ad-9838-132407513835" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:58:45 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-1993fbd2-3ad7-42b7-959f-5769d1e0dac0 tempest-CinderUnicodeTest-9741368 None] Lock "cinder-quobyte-42ec3740-81ed-44ad-9838-132407513835" acquired by "delete_volume" :: waited 0.028s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:58:45 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4312fb7-897c-461f-b662-0690644951b1]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:58:45 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-1993fbd2-3ad7-42b7-959f-5769d1e0dac0 tempest-CinderUnicodeTest-9741368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42ec3740-81ed-44ad-9838-132407513835 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:45 devstack sudo[106799]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:45 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c73e2093-7c36-4fc9-9bc7-8235e4cb92ad tempest-CreateVolumesFromSourceVolumeTest-649217495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-21eb224d-0f4a-4b70-91d3-59d694cf128c" returned: 0 in 0.324s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:45 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c73e2093-7c36-4fc9-9bc7-8235e4cb92ad tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Lock "cinder-quobyte-21eb224d-0f4a-4b70-91d3-59d694cf128c" released by "delete_volume" :: held 0.845s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:58:45 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-c73e2093-7c36-4fc9-9bc7-8235e4cb92ad tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Created reservations ['6858819a-82b3-4631-a944-b32cc8526f4b', '27346b6e-bca3-4fb7-a591-290e635b332c', '3f34b067-48bd-4641-93ed-d2d9cc7d58db', 'e85ebe85-2460-40ab-b3cc-24e0fa66af7a'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:58:45 devstack sudo[106802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42ec3740-81ed-44ad-9838-132407513835 Sep 04 22:58:45 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:45 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d268446-7beb-490f-8f72-bce3ad0249c3 tempest-CreateVolumesFromSnapshotTest-298673937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:58:45 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6d268446-7beb-490f-8f72-bce3ad0249c3 tempest-CreateVolumesFromSnapshotTest-298673937 None] Flow 'volume_create_manager' (5a7a594d-2cf7-4e81-a434-e367cb7b20ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:58:45 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6d268446-7beb-490f-8f72-bce3ad0249c3 tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (756a2ac6-de9e-4576-91cb-f367779e9924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:45 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6d268446-7beb-490f-8f72-bce3ad0249c3 tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (756a2ac6-de9e-4576-91cb-f367779e9924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:58:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1231781288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70b22b3d-7f93-4490-89e3-0b8d1c1ae830,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e903096c1764673b95099778fb4e663',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:58:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:58:46Z,use_quota=True,user_id='cf5b01a88d494cbba6ba4fedaa7a4651',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:45 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6d268446-7beb-490f-8f72-bce3ad0249c3 tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (537f6f0f-a5c1-4d42-9519-e534e56ccffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:45 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6d268446-7beb-490f-8f72-bce3ad0249c3 tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (537f6f0f-a5c1-4d42-9519-e534e56ccffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:45 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6d268446-7beb-490f-8f72-bce3ad0249c3 tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (311d8930-e4b6-4d30-8344-b7910ab1dcc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:45 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6d268446-7beb-490f-8f72-bce3ad0249c3 tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (311d8930-e4b6-4d30-8344-b7910ab1dcc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70b22b3d-7f93-4490-89e3-0b8d1c1ae830', 'volume_name': 'volume-70b22b3d-7f93-4490-89e3-0b8d1c1ae830', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:46 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6d268446-7beb-490f-8f72-bce3ad0249c3 tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a6c9b58-a1f8-4ad5-9b43-da289daffeea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:46 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6d268446-7beb-490f-8f72-bce3ad0249c3 tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a6c9b58-a1f8-4ad5-9b43-da289daffeea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:46 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6d268446-7beb-490f-8f72-bce3ad0249c3 tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da640798-4f16-4d73-a4ff-96aad79efa16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:46 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-6d268446-7beb-490f-8f72-bce3ad0249c3 tempest-CreateVolumesFromSnapshotTest-298673937 None] Volume 70b22b3d-7f93-4490-89e3-0b8d1c1ae830: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70b22b3d-7f93-4490-89e3-0b8d1c1ae830', 'volume_size': 1} Sep 04 22:58:46 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-6d268446-7beb-490f-8f72-bce3ad0249c3 tempest-CreateVolumesFromSnapshotTest-298673937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:58:46 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-6d268446-7beb-490f-8f72-bce3ad0249c3 tempest-CreateVolumesFromSnapshotTest-298673937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:58:46 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-6d268446-7beb-490f-8f72-bce3ad0249c3 tempest-CreateVolumesFromSnapshotTest-298673937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:58:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1231781288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70b22b3d-7f93-4490-89e3-0b8d1c1ae830,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e903096c1764673b95099778fb4e663',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:58:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:58:46Z,use_quota=True,user_id='cf5b01a88d494cbba6ba4fedaa7a4651',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:58:46 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-6d268446-7beb-490f-8f72-bce3ad0249c3 tempest-CreateVolumesFromSnapshotTest-298673937 None] Creating volume 70b22b3d-7f93-4490-89e3-0b8d1c1ae830 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:58:46 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-6d268446-7beb-490f-8f72-bce3ad0249c3 tempest-CreateVolumesFromSnapshotTest-298673937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:58:46 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-6d268446-7beb-490f-8f72-bce3ad0249c3 tempest-CreateVolumesFromSnapshotTest-298673937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:58:46 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-6d268446-7beb-490f-8f72-bce3ad0249c3 tempest-CreateVolumesFromSnapshotTest-298673937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:58:46 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-6d268446-7beb-490f-8f72-bce3ad0249c3 tempest-CreateVolumesFromSnapshotTest-298673937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:58:46 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-6d268446-7beb-490f-8f72-bce3ad0249c3 tempest-CreateVolumesFromSnapshotTest-298673937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:58:46 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-6d268446-7beb-490f-8f72-bce3ad0249c3 tempest-CreateVolumesFromSnapshotTest-298673937 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:58:46 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-6d268446-7beb-490f-8f72-bce3ad0249c3 tempest-CreateVolumesFromSnapshotTest-298673937 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:58:46 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-6d268446-7beb-490f-8f72-bce3ad0249c3 tempest-CreateVolumesFromSnapshotTest-298673937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-70b22b3d-7f93-4490-89e3-0b8d1c1ae830 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:46 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f7d3d399-593a-41fe-9643-9272e793e9f2 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Acquiring lock "cinder-a2315f5e-3875-4ac7-a576-d32dec034d16-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:58:46 devstack sudo[106804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-70b22b3d-7f93-4490-89e3-0b8d1c1ae830 1073741824 Sep 04 22:58:46 devstack sudo[106804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:46 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f7d3d399-593a-41fe-9643-9272e793e9f2 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Lock "cinder-a2315f5e-3875-4ac7-a576-d32dec034d16-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:58:46 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-c73e2093-7c36-4fc9-9bc7-8235e4cb92ad tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:58:46 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-c73e2093-7c36-4fc9-9bc7-8235e4cb92ad tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:58:46 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-c73e2093-7c36-4fc9-9bc7-8235e4cb92ad tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:58:46 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-c73e2093-7c36-4fc9-9bc7-8235e4cb92ad tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:58:46 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-c73e2093-7c36-4fc9-9bc7-8235e4cb92ad tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:58:46 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c73e2093-7c36-4fc9-9bc7-8235e4cb92ad tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:46 devstack sudo[106807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:58:46 devstack sudo[106807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:46 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f7d3d399-593a-41fe-9643-9272e793e9f2 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Acquiring lock "cinder-quobyte-a2315f5e-3875-4ac7-a576-d32dec034d16" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:58:46 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f7d3d399-593a-41fe-9643-9272e793e9f2 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Lock "cinder-quobyte-a2315f5e-3875-4ac7-a576-d32dec034d16" acquired by "delete_volume" :: waited 0.032s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:58:46 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:46 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c6cb77-4241-4881-9bf6-0b71abf1ccb4]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:58:46 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f7d3d399-593a-41fe-9643-9272e793e9f2 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-a2315f5e-3875-4ac7-a576-d32dec034d16 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:46 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-1993fbd2-3ad7-42b7-959f-5769d1e0dac0 tempest-CinderUnicodeTest-9741368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42ec3740-81ed-44ad-9838-132407513835" returned: 0 in 0.604s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:46 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-1993fbd2-3ad7-42b7-959f-5769d1e0dac0 tempest-CinderUnicodeTest-9741368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42ec3740-81ed-44ad-9838-132407513835 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:46 devstack sudo[106815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42ec3740-81ed-44ad-9838-132407513835 Sep 04 22:58:46 devstack sudo[106815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:46 devstack sudo[106813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-a2315f5e-3875-4ac7-a576-d32dec034d16 Sep 04 22:58:46 devstack sudo[106813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:46 devstack sudo[106807]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:46 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c73e2093-7c36-4fc9-9bc7-8235e4cb92ad tempest-CreateVolumesFromSourceVolumeTest-649217495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.436s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:46 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-c73e2093-7c36-4fc9-9bc7-8235e4cb92ad tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:58:46 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-c73e2093-7c36-4fc9-9bc7-8235e4cb92ad tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Deleted volume successfully. Sep 04 22:58:46 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c73e2093-7c36-4fc9-9bc7-8235e4cb92ad tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Lock "cinder-21eb224d-0f4a-4b70-91d3-59d694cf128c-delete_volume" released by "delete_volume" :: held 1.783s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:58:46 devstack sudo[106815]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:46 devstack sudo[106804]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:46 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-1993fbd2-3ad7-42b7-959f-5769d1e0dac0 tempest-CinderUnicodeTest-9741368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-42ec3740-81ed-44ad-9838-132407513835" returned: 0 in 0.319s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:46 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-6d268446-7beb-490f-8f72-bce3ad0249c3 tempest-CreateVolumesFromSnapshotTest-298673937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-70b22b3d-7f93-4490-89e3-0b8d1c1ae830 1073741824" returned: 0 in 0.626s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:46 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-1993fbd2-3ad7-42b7-959f-5769d1e0dac0 tempest-CinderUnicodeTest-9741368 None] Lock "cinder-quobyte-42ec3740-81ed-44ad-9838-132407513835" released by "delete_volume" :: held 1.008s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:58:46 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-6d268446-7beb-490f-8f72-bce3ad0249c3 tempest-CreateVolumesFromSnapshotTest-298673937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-70b22b3d-7f93-4490-89e3-0b8d1c1ae830 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:46 devstack sudo[106826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-70b22b3d-7f93-4490-89e3-0b8d1c1ae830 Sep 04 22:58:46 devstack sudo[106826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:46 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-1993fbd2-3ad7-42b7-959f-5769d1e0dac0 tempest-CinderUnicodeTest-9741368 None] Created reservations ['188159b6-0f45-4d59-93c5-69a16fc502dc', '974622d8-baf7-4172-90cd-ce4340f98824', '330e524e-baf1-488c-8718-2ec08611ee40', 'c94fb664-33b9-483b-b84e-c4eefbc0944e'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:58:46 devstack sudo[106813]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:46 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f7d3d399-593a-41fe-9643-9272e793e9f2 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-a2315f5e-3875-4ac7-a576-d32dec034d16" returned: 0 in 0.482s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:46 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f7d3d399-593a-41fe-9643-9272e793e9f2 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-a2315f5e-3875-4ac7-a576-d32dec034d16 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:46 devstack sudo[106828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-a2315f5e-3875-4ac7-a576-d32dec034d16 Sep 04 22:58:46 devstack sudo[106828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:46 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-1993fbd2-3ad7-42b7-959f-5769d1e0dac0 tempest-CinderUnicodeTest-9741368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:58:46 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-1993fbd2-3ad7-42b7-959f-5769d1e0dac0 tempest-CinderUnicodeTest-9741368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:58:46 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-1993fbd2-3ad7-42b7-959f-5769d1e0dac0 tempest-CinderUnicodeTest-9741368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:58:46 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-1993fbd2-3ad7-42b7-959f-5769d1e0dac0 tempest-CinderUnicodeTest-9741368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:58:46 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-1993fbd2-3ad7-42b7-959f-5769d1e0dac0 tempest-CinderUnicodeTest-9741368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:58:46 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-1993fbd2-3ad7-42b7-959f-5769d1e0dac0 tempest-CinderUnicodeTest-9741368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:46 devstack sudo[106830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:58:46 devstack sudo[106830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:47 devstack sudo[106826]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:47 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-6d268446-7beb-490f-8f72-bce3ad0249c3 tempest-CreateVolumesFromSnapshotTest-298673937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-70b22b3d-7f93-4490-89e3-0b8d1c1ae830" returned: 0 in 0.365s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:47 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-6d268446-7beb-490f-8f72-bce3ad0249c3 tempest-CreateVolumesFromSnapshotTest-298673937 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:58:47 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-6d268446-7beb-490f-8f72-bce3ad0249c3 tempest-CreateVolumesFromSnapshotTest-298673937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:58:47 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6d268446-7beb-490f-8f72-bce3ad0249c3 tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da640798-4f16-4d73-a4ff-96aad79efa16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70b22b3d-7f93-4490-89e3-0b8d1c1ae830', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:47 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6d268446-7beb-490f-8f72-bce3ad0249c3 tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c59be57d-408c-4da4-b940-c0b3948b14c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:47 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-6d268446-7beb-490f-8f72-bce3ad0249c3 tempest-CreateVolumesFromSnapshotTest-298673937 None] Volume volume-70b22b3d-7f93-4490-89e3-0b8d1c1ae830 (70b22b3d-7f93-4490-89e3-0b8d1c1ae830): created successfully Sep 04 22:58:47 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6d268446-7beb-490f-8f72-bce3ad0249c3 tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c59be57d-408c-4da4-b940-c0b3948b14c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:47 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6d268446-7beb-490f-8f72-bce3ad0249c3 tempest-CreateVolumesFromSnapshotTest-298673937 None] Flow 'volume_create_manager' (5a7a594d-2cf7-4e81-a434-e367cb7b20ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:58:47 devstack sudo[106828]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:47 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f7d3d399-593a-41fe-9643-9272e793e9f2 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-a2315f5e-3875-4ac7-a576-d32dec034d16" returned: 0 in 0.362s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:47 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-6d268446-7beb-490f-8f72-bce3ad0249c3 tempest-CreateVolumesFromSnapshotTest-298673937 None] Created volume successfully. Sep 04 22:58:47 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f7d3d399-593a-41fe-9643-9272e793e9f2 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Lock "cinder-quobyte-a2315f5e-3875-4ac7-a576-d32dec034d16" released by "delete_volume" :: held 0.934s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:58:47 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-f7d3d399-593a-41fe-9643-9272e793e9f2 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Created reservations ['e9a2b585-db9c-437e-aae9-d64d3cf6fe44', '45e60bda-f3a1-41de-a570-35105de95795', '54deaf6c-135b-4fa6-8f83-4c977403edb5', '336300e4-17c9-4d5c-a057-0f699024e250'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:58:47 devstack sudo[106830]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:47 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-1993fbd2-3ad7-42b7-959f-5769d1e0dac0 tempest-CinderUnicodeTest-9741368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.352s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:47 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-1993fbd2-3ad7-42b7-959f-5769d1e0dac0 tempest-CinderUnicodeTest-9741368 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:58:47 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-1993fbd2-3ad7-42b7-959f-5769d1e0dac0 tempest-CinderUnicodeTest-9741368 None] Deleted volume successfully. Sep 04 22:58:47 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-1993fbd2-3ad7-42b7-959f-5769d1e0dac0 tempest-CinderUnicodeTest-9741368 None] Lock "cinder-42ec3740-81ed-44ad-9838-132407513835-delete_volume" released by "delete_volume" :: held 1.734s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:58:47 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f7d3d399-593a-41fe-9643-9272e793e9f2 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:58:47 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f7d3d399-593a-41fe-9643-9272e793e9f2 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:58:47 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-f7d3d399-593a-41fe-9643-9272e793e9f2 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:58:47 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-f7d3d399-593a-41fe-9643-9272e793e9f2 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:58:47 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f7d3d399-593a-41fe-9643-9272e793e9f2 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:58:47 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f7d3d399-593a-41fe-9643-9272e793e9f2 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:47 devstack sudo[106835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:58:47 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:47 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:47 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f7d3d399-593a-41fe-9643-9272e793e9f2 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.275s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:47 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-f7d3d399-593a-41fe-9643-9272e793e9f2 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:58:47 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-f7d3d399-593a-41fe-9643-9272e793e9f2 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Deleted volume successfully. Sep 04 22:58:47 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f7d3d399-593a-41fe-9643-9272e793e9f2 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Lock "cinder-a2315f5e-3875-4ac7-a576-d32dec034d16-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:58:47 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-8686cc2d-3638-431d-9d32-3e2873bae077 tempest-CinderUnicodeTest-9741368 None] Acquiring lock "cinder-dd157d7d-8ca3-4358-aa87-1392822b14f7-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:58:47 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-8686cc2d-3638-431d-9d32-3e2873bae077 tempest-CinderUnicodeTest-9741368 None] Lock "cinder-dd157d7d-8ca3-4358-aa87-1392822b14f7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:58:47 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-8686cc2d-3638-431d-9d32-3e2873bae077 tempest-CinderUnicodeTest-9741368 None] Acquiring lock "cinder-quobyte-dd157d7d-8ca3-4358-aa87-1392822b14f7" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:58:47 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-8686cc2d-3638-431d-9d32-3e2873bae077 tempest-CinderUnicodeTest-9741368 None] Lock "cinder-quobyte-dd157d7d-8ca3-4358-aa87-1392822b14f7" acquired by "delete_volume" :: waited 0.018s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:58:47 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ded337d-9dfd-4776-8c46-6966a4eaef3b]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:58:47 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-8686cc2d-3638-431d-9d32-3e2873bae077 tempest-CinderUnicodeTest-9741368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-dd157d7d-8ca3-4358-aa87-1392822b14f7 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:48 devstack sudo[106844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-dd157d7d-8ca3-4358-aa87-1392822b14f7 Sep 04 22:58:48 devstack sudo[106844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:48 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-6fb688f0-6449-43f1-b24a-67c5ebbc5b6b tempest-CreateVolumesFromSnapshotTest-298673937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:58:48 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-6fb688f0-6449-43f1-b24a-67c5ebbc5b6b tempest-CreateVolumesFromSnapshotTest-298673937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:58:48 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-6fb688f0-6449-43f1-b24a-67c5ebbc5b6b tempest-CreateVolumesFromSnapshotTest-298673937 None] Creating offline snapshot 4be91fcc-8671-4020-bf0e-f55e8b8bd97f of volume 70b22b3d-7f93-4490-89e3-0b8d1c1ae830 {{(pid=87576) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 22:58:48 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[402c4aae-29ab-4bd2-89c9-9e9eea621ff9]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:58:48 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-6fb688f0-6449-43f1-b24a-67c5ebbc5b6b tempest-CreateVolumesFromSnapshotTest-298673937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-70b22b3d-7f93-4490-89e3-0b8d1c1ae830 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:48 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-7625d01a-64d4-40c1-9f0b-8b9b457ec880 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Acquiring lock "cinder-443949d2-5678-4a29-ba5a-25d561f016aa-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:58:48 devstack sudo[106844]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:48 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-8686cc2d-3638-431d-9d32-3e2873bae077 tempest-CinderUnicodeTest-9741368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-dd157d7d-8ca3-4358-aa87-1392822b14f7" returned: 0 in 0.449s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:48 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-8686cc2d-3638-431d-9d32-3e2873bae077 tempest-CinderUnicodeTest-9741368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-dd157d7d-8ca3-4358-aa87-1392822b14f7 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:48 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-7625d01a-64d4-40c1-9f0b-8b9b457ec880 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Lock "cinder-443949d2-5678-4a29-ba5a-25d561f016aa-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:58:48 devstack sudo[106846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-70b22b3d-7f93-4490-89e3-0b8d1c1ae830 Sep 04 22:58:48 devstack sudo[106846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:48 devstack sudo[106850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-dd157d7d-8ca3-4358-aa87-1392822b14f7 Sep 04 22:58:48 devstack sudo[106850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:48 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-7625d01a-64d4-40c1-9f0b-8b9b457ec880 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Acquiring lock "cinder-quobyte-443949d2-5678-4a29-ba5a-25d561f016aa" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:58:48 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-7625d01a-64d4-40c1-9f0b-8b9b457ec880 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Lock "cinder-quobyte-443949d2-5678-4a29-ba5a-25d561f016aa" acquired by "delete_volume" :: waited 0.017s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:58:48 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba90b93-1de5-4538-9614-a254f911df32]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:58:48 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-7625d01a-64d4-40c1-9f0b-8b9b457ec880 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-443949d2-5678-4a29-ba5a-25d561f016aa {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:48 devstack sudo[106853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-443949d2-5678-4a29-ba5a-25d561f016aa Sep 04 22:58:48 devstack sudo[106853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:48 devstack sudo[106850]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:48 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-8686cc2d-3638-431d-9d32-3e2873bae077 tempest-CinderUnicodeTest-9741368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-dd157d7d-8ca3-4358-aa87-1392822b14f7" returned: 0 in 0.300s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:48 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-8686cc2d-3638-431d-9d32-3e2873bae077 tempest-CinderUnicodeTest-9741368 None] Lock "cinder-quobyte-dd157d7d-8ca3-4358-aa87-1392822b14f7" released by "delete_volume" :: held 0.802s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:58:48 devstack sudo[106846]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:48 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-8686cc2d-3638-431d-9d32-3e2873bae077 tempest-CinderUnicodeTest-9741368 None] Created reservations ['6de71620-b2e4-4d78-846c-7d4dc8da0380', '05b1df4b-803d-49d1-814f-a8448e11ce5d', 'e70f1bcd-d098-44a9-87ce-39bfdb15cc78', '25f8e25b-0643-469d-abf2-d05dcc7bda18'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:58:48 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-6fb688f0-6449-43f1-b24a-67c5ebbc5b6b tempest-CreateVolumesFromSnapshotTest-298673937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-70b22b3d-7f93-4490-89e3-0b8d1c1ae830" returned: 0 in 0.529s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:48 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-6fb688f0-6449-43f1-b24a-67c5ebbc5b6b tempest-CreateVolumesFromSnapshotTest-298673937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-70b22b3d-7f93-4490-89e3-0b8d1c1ae830,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-70b22b3d-7f93-4490-89e3-0b8d1c1ae830.4be91fcc-8671-4020-bf0e-f55e8b8bd97f 1G {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:48 devstack sudo[106859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-70b22b3d-7f93-4490-89e3-0b8d1c1ae830,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-70b22b3d-7f93-4490-89e3-0b8d1c1ae830.4be91fcc-8671-4020-bf0e-f55e8b8bd97f 1G Sep 04 22:58:48 devstack sudo[106859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:48 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-8686cc2d-3638-431d-9d32-3e2873bae077 tempest-CinderUnicodeTest-9741368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:58:48 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-8686cc2d-3638-431d-9d32-3e2873bae077 tempest-CinderUnicodeTest-9741368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:58:48 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-8686cc2d-3638-431d-9d32-3e2873bae077 tempest-CinderUnicodeTest-9741368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:58:48 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-8686cc2d-3638-431d-9d32-3e2873bae077 tempest-CinderUnicodeTest-9741368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:58:48 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-8686cc2d-3638-431d-9d32-3e2873bae077 tempest-CinderUnicodeTest-9741368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:58:48 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-8686cc2d-3638-431d-9d32-3e2873bae077 tempest-CinderUnicodeTest-9741368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:48 devstack sudo[106865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:58:48 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:48 devstack sudo[106853]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:48 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-7625d01a-64d4-40c1-9f0b-8b9b457ec880 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-443949d2-5678-4a29-ba5a-25d561f016aa" returned: 0 in 0.472s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:48 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-7625d01a-64d4-40c1-9f0b-8b9b457ec880 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-443949d2-5678-4a29-ba5a-25d561f016aa {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:49 devstack sudo[106867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-443949d2-5678-4a29-ba5a-25d561f016aa Sep 04 22:58:49 devstack sudo[106867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:49 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:49 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-8686cc2d-3638-431d-9d32-3e2873bae077 tempest-CinderUnicodeTest-9741368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.366s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:49 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-8686cc2d-3638-431d-9d32-3e2873bae077 tempest-CinderUnicodeTest-9741368 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:58:49 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-8686cc2d-3638-431d-9d32-3e2873bae077 tempest-CinderUnicodeTest-9741368 None] Deleted volume successfully. Sep 04 22:58:49 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-8686cc2d-3638-431d-9d32-3e2873bae077 tempest-CinderUnicodeTest-9741368 None] Lock "cinder-dd157d7d-8ca3-4358-aa87-1392822b14f7-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:58:49 devstack sudo[106867]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:49 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-7625d01a-64d4-40c1-9f0b-8b9b457ec880 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-443949d2-5678-4a29-ba5a-25d561f016aa" returned: 0 in 0.382s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:49 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-7625d01a-64d4-40c1-9f0b-8b9b457ec880 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Lock "cinder-quobyte-443949d2-5678-4a29-ba5a-25d561f016aa" released by "delete_volume" :: held 0.903s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:58:49 devstack sudo[106859]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:49 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-6fb688f0-6449-43f1-b24a-67c5ebbc5b6b tempest-CreateVolumesFromSnapshotTest-298673937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-70b22b3d-7f93-4490-89e3-0b8d1c1ae830,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-70b22b3d-7f93-4490-89e3-0b8d1c1ae830.4be91fcc-8671-4020-bf0e-f55e8b8bd97f 1G" returned: 0 in 0.610s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:49 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-6fb688f0-6449-43f1-b24a-67c5ebbc5b6b tempest-CreateVolumesFromSnapshotTest-298673937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70b22b3d-7f93-4490-89e3-0b8d1c1ae830 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-70b22b3d-7f93-4490-89e3-0b8d1c1ae830.4be91fcc-8671-4020-bf0e-f55e8b8bd97f {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:49 devstack sudo[106874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70b22b3d-7f93-4490-89e3-0b8d1c1ae830 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-70b22b3d-7f93-4490-89e3-0b8d1c1ae830.4be91fcc-8671-4020-bf0e-f55e8b8bd97f Sep 04 22:58:49 devstack sudo[106874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:49 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-7625d01a-64d4-40c1-9f0b-8b9b457ec880 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Created reservations ['6272cc7b-e3b1-47f6-8d62-06d9ecc87721', 'e42bf5ff-262a-4c09-ab01-cca39735d82c', 'e6b62140-d917-471f-80cc-386bb0c7ee82', '4a42cbde-40cb-43ea-b87d-32e677b38348'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:58:49 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-7625d01a-64d4-40c1-9f0b-8b9b457ec880 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:58:49 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-7625d01a-64d4-40c1-9f0b-8b9b457ec880 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:58:49 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-7625d01a-64d4-40c1-9f0b-8b9b457ec880 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:58:49 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-7625d01a-64d4-40c1-9f0b-8b9b457ec880 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:58:49 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-7625d01a-64d4-40c1-9f0b-8b9b457ec880 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:58:49 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-7625d01a-64d4-40c1-9f0b-8b9b457ec880 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:49 devstack sudo[106876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:58:49 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:49 devstack sudo[106874]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:49 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-6fb688f0-6449-43f1-b24a-67c5ebbc5b6b tempest-CreateVolumesFromSnapshotTest-298673937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70b22b3d-7f93-4490-89e3-0b8d1c1ae830 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-70b22b3d-7f93-4490-89e3-0b8d1c1ae830.4be91fcc-8671-4020-bf0e-f55e8b8bd97f" returned: 0 in 0.362s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:49 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-6fb688f0-6449-43f1-b24a-67c5ebbc5b6b tempest-CreateVolumesFromSnapshotTest-298673937 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-70b22b3d-7f93-4490-89e3-0b8d1c1ae830.4be91fcc-8671-4020-bf0e-f55e8b8bd97f is being set with open permissions: ugo+rw Sep 04 22:58:49 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-6fb688f0-6449-43f1-b24a-67c5ebbc5b6b tempest-CreateVolumesFromSnapshotTest-298673937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-70b22b3d-7f93-4490-89e3-0b8d1c1ae830.4be91fcc-8671-4020-bf0e-f55e8b8bd97f {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:49 devstack sudo[106881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-70b22b3d-7f93-4490-89e3-0b8d1c1ae830.4be91fcc-8671-4020-bf0e-f55e8b8bd97f Sep 04 22:58:49 devstack sudo[106881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:49 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:49 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-7625d01a-64d4-40c1-9f0b-8b9b457ec880 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.294s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:49 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-7625d01a-64d4-40c1-9f0b-8b9b457ec880 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:58:49 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-7625d01a-64d4-40c1-9f0b-8b9b457ec880 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Deleted volume successfully. Sep 04 22:58:49 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-7625d01a-64d4-40c1-9f0b-8b9b457ec880 tempest-CreateVolumesFromSourceVolumeTest-649217495 None] Lock "cinder-443949d2-5678-4a29-ba5a-25d561f016aa-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:58:50 devstack sudo[106881]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:50 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-6fb688f0-6449-43f1-b24a-67c5ebbc5b6b tempest-CreateVolumesFromSnapshotTest-298673937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-70b22b3d-7f93-4490-89e3-0b8d1c1ae830.4be91fcc-8671-4020-bf0e-f55e8b8bd97f" returned: 0 in 0.317s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:50 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-6fb688f0-6449-43f1-b24a-67c5ebbc5b6b tempest-CreateVolumesFromSnapshotTest-298673937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-70b22b3d-7f93-4490-89e3-0b8d1c1ae830.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:50 devstack sudo[106885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-70b22b3d-7f93-4490-89e3-0b8d1c1ae830.info Sep 04 22:58:50 devstack sudo[106885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:50 devstack sudo[106885]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:50 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-6fb688f0-6449-43f1-b24a-67c5ebbc5b6b tempest-CreateVolumesFromSnapshotTest-298673937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-70b22b3d-7f93-4490-89e3-0b8d1c1ae830.info" returned: 0 in 0.284s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:50 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-6fb688f0-6449-43f1-b24a-67c5ebbc5b6b tempest-CreateVolumesFromSnapshotTest-298673937 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-70b22b3d-7f93-4490-89e3-0b8d1c1ae830.info is being set with open permissions: ugo+rw Sep 04 22:58:50 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-6fb688f0-6449-43f1-b24a-67c5ebbc5b6b tempest-CreateVolumesFromSnapshotTest-298673937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-70b22b3d-7f93-4490-89e3-0b8d1c1ae830.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:50 devstack sudo[106888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-70b22b3d-7f93-4490-89e3-0b8d1c1ae830.info Sep 04 22:58:50 devstack sudo[106888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:50 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-152a85c4-a0da-45b1-b08b-8adaf3bd523a tempest-ProjectReaderTests-144208897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:58:50 devstack sudo[106888]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:50 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-152a85c4-a0da-45b1-b08b-8adaf3bd523a tempest-ProjectReaderTests-144208897 None] Flow 'volume_create_manager' (5b448a75-d166-4c6b-9afe-6a217fb7ad9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:58:50 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-152a85c4-a0da-45b1-b08b-8adaf3bd523a tempest-ProjectReaderTests-144208897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb5ad9be-bf66-4afc-a954-c012744d3d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:50 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-6fb688f0-6449-43f1-b24a-67c5ebbc5b6b tempest-CreateVolumesFromSnapshotTest-298673937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-70b22b3d-7f93-4490-89e3-0b8d1c1ae830.info" returned: 0 in 0.331s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:50 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-6fb688f0-6449-43f1-b24a-67c5ebbc5b6b tempest-CreateVolumesFromSnapshotTest-298673937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.545s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:58:50 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-152a85c4-a0da-45b1-b08b-8adaf3bd523a tempest-ProjectReaderTests-144208897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb5ad9be-bf66-4afc-a954-c012744d3d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:58:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1877455779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2cf7f43-e824-47e3-bcce-7ebd0b49fbcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63e43a45529e4d3cbc3f4c88d615f0db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:58:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:58:51Z,use_quota=True,user_id='5bbdd8019f1644f99a01e156b80c6dbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:50 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-152a85c4-a0da-45b1-b08b-8adaf3bd523a tempest-ProjectReaderTests-144208897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a4f169c-ed91-4ffd-ad2e-82d7493471ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:50 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-152a85c4-a0da-45b1-b08b-8adaf3bd523a tempest-ProjectReaderTests-144208897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a4f169c-ed91-4ffd-ad2e-82d7493471ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:50 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-152a85c4-a0da-45b1-b08b-8adaf3bd523a tempest-ProjectReaderTests-144208897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9e8a2a5-a05d-415e-8237-520c55ae6e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:50 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-152a85c4-a0da-45b1-b08b-8adaf3bd523a tempest-ProjectReaderTests-144208897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9e8a2a5-a05d-415e-8237-520c55ae6e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2cf7f43-e824-47e3-bcce-7ebd0b49fbcb', 'volume_name': 'volume-d2cf7f43-e824-47e3-bcce-7ebd0b49fbcb', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:50 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-152a85c4-a0da-45b1-b08b-8adaf3bd523a tempest-ProjectReaderTests-144208897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a93b2729-c25d-4c4b-8368-e8a96878ee54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:50 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-152a85c4-a0da-45b1-b08b-8adaf3bd523a tempest-ProjectReaderTests-144208897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a93b2729-c25d-4c4b-8368-e8a96878ee54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:50 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-152a85c4-a0da-45b1-b08b-8adaf3bd523a tempest-ProjectReaderTests-144208897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1942b28f-b77c-4008-9afa-33c825dbe05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:50 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-152a85c4-a0da-45b1-b08b-8adaf3bd523a tempest-ProjectReaderTests-144208897 None] Volume d2cf7f43-e824-47e3-bcce-7ebd0b49fbcb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2cf7f43-e824-47e3-bcce-7ebd0b49fbcb', 'volume_size': 1} Sep 04 22:58:50 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-152a85c4-a0da-45b1-b08b-8adaf3bd523a tempest-ProjectReaderTests-144208897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:58:50 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-152a85c4-a0da-45b1-b08b-8adaf3bd523a tempest-ProjectReaderTests-144208897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:58:50 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-152a85c4-a0da-45b1-b08b-8adaf3bd523a tempest-ProjectReaderTests-144208897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:58:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1877455779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2cf7f43-e824-47e3-bcce-7ebd0b49fbcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63e43a45529e4d3cbc3f4c88d615f0db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:58:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:58:51Z,use_quota=True,user_id='5bbdd8019f1644f99a01e156b80c6dbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:58:50 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-152a85c4-a0da-45b1-b08b-8adaf3bd523a tempest-ProjectReaderTests-144208897 None] Creating volume d2cf7f43-e824-47e3-bcce-7ebd0b49fbcb {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:58:50 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-152a85c4-a0da-45b1-b08b-8adaf3bd523a tempest-ProjectReaderTests-144208897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:58:50 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-152a85c4-a0da-45b1-b08b-8adaf3bd523a tempest-ProjectReaderTests-144208897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:58:50 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-152a85c4-a0da-45b1-b08b-8adaf3bd523a tempest-ProjectReaderTests-144208897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:58:50 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-152a85c4-a0da-45b1-b08b-8adaf3bd523a tempest-ProjectReaderTests-144208897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:58:50 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-152a85c4-a0da-45b1-b08b-8adaf3bd523a tempest-ProjectReaderTests-144208897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:58:50 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-152a85c4-a0da-45b1-b08b-8adaf3bd523a tempest-ProjectReaderTests-144208897 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:58:50 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-152a85c4-a0da-45b1-b08b-8adaf3bd523a tempest-ProjectReaderTests-144208897 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:58:50 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-152a85c4-a0da-45b1-b08b-8adaf3bd523a tempest-ProjectReaderTests-144208897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d2cf7f43-e824-47e3-bcce-7ebd0b49fbcb 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:50 devstack sudo[106891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d2cf7f43-e824-47e3-bcce-7ebd0b49fbcb 1073741824 Sep 04 22:58:50 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-6fb688f0-6449-43f1-b24a-67c5ebbc5b6b tempest-CreateVolumesFromSnapshotTest-298673937 None] Create snapshot completed successfully Sep 04 22:58:50 devstack sudo[106891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:51 devstack sudo[106891]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:51 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-152a85c4-a0da-45b1-b08b-8adaf3bd523a tempest-ProjectReaderTests-144208897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d2cf7f43-e824-47e3-bcce-7ebd0b49fbcb 1073741824" returned: 0 in 0.545s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:51 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-152a85c4-a0da-45b1-b08b-8adaf3bd523a tempest-ProjectReaderTests-144208897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d2cf7f43-e824-47e3-bcce-7ebd0b49fbcb {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:51 devstack sudo[106897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d2cf7f43-e824-47e3-bcce-7ebd0b49fbcb Sep 04 22:58:51 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:51 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:51 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-152a85c4-a0da-45b1-b08b-8adaf3bd523a tempest-ProjectReaderTests-144208897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d2cf7f43-e824-47e3-bcce-7ebd0b49fbcb" returned: 0 in 0.363s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:51 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-152a85c4-a0da-45b1-b08b-8adaf3bd523a tempest-ProjectReaderTests-144208897 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:58:51 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-152a85c4-a0da-45b1-b08b-8adaf3bd523a tempest-ProjectReaderTests-144208897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:58:51 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-152a85c4-a0da-45b1-b08b-8adaf3bd523a tempest-ProjectReaderTests-144208897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1942b28f-b77c-4008-9afa-33c825dbe05a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2cf7f43-e824-47e3-bcce-7ebd0b49fbcb', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:51 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-152a85c4-a0da-45b1-b08b-8adaf3bd523a tempest-ProjectReaderTests-144208897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00c4e82b-c531-413f-ad3b-735a2c016ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:51 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-152a85c4-a0da-45b1-b08b-8adaf3bd523a tempest-ProjectReaderTests-144208897 None] Volume volume-d2cf7f43-e824-47e3-bcce-7ebd0b49fbcb (d2cf7f43-e824-47e3-bcce-7ebd0b49fbcb): created successfully Sep 04 22:58:51 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-152a85c4-a0da-45b1-b08b-8adaf3bd523a tempest-ProjectReaderTests-144208897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00c4e82b-c531-413f-ad3b-735a2c016ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:51 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-152a85c4-a0da-45b1-b08b-8adaf3bd523a tempest-ProjectReaderTests-144208897 None] Flow 'volume_create_manager' (5b448a75-d166-4c6b-9afe-6a217fb7ad9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:58:51 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-152a85c4-a0da-45b1-b08b-8adaf3bd523a tempest-ProjectReaderTests-144208897 None] Created volume successfully. Sep 04 22:58:52 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-547e081c-50b3-4ce8-82c2-37cb546fd9d1 tempest-CreateVolumesFromSnapshotTest-298673937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:58:52 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-547e081c-50b3-4ce8-82c2-37cb546fd9d1 tempest-CreateVolumesFromSnapshotTest-298673937 None] Flow 'volume_create_manager' (03c178cf-f408-4375-816f-3fcc997cdee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:58:52 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-547e081c-50b3-4ce8-82c2-37cb546fd9d1 tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c41d663d-3e2c-47a5-ba81-63215c5d05cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:52 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-547e081c-50b3-4ce8-82c2-37cb546fd9d1 tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c41d663d-3e2c-47a5-ba81-63215c5d05cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:58:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-110971772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b67c8389-386b-4932-b1dd-874c96cd0b82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e903096c1764673b95099778fb4e663',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:58:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:58:52Z,use_quota=True,user_id='cf5b01a88d494cbba6ba4fedaa7a4651',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:52 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-547e081c-50b3-4ce8-82c2-37cb546fd9d1 tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d90c08f-010c-4964-aecd-40cdc61585be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:52 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-547e081c-50b3-4ce8-82c2-37cb546fd9d1 tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d90c08f-010c-4964-aecd-40cdc61585be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:52 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-547e081c-50b3-4ce8-82c2-37cb546fd9d1 tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ef03ac4-ffd8-4245-8b08-cab1853d0637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:52 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-547e081c-50b3-4ce8-82c2-37cb546fd9d1 tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ef03ac4-ffd8-4245-8b08-cab1853d0637) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b67c8389-386b-4932-b1dd-874c96cd0b82', 'volume_name': 'volume-b67c8389-386b-4932-b1dd-874c96cd0b82', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:52 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-547e081c-50b3-4ce8-82c2-37cb546fd9d1 tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aafdfb29-cf1f-41da-9d2a-eaac0bb5247b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:52 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-547e081c-50b3-4ce8-82c2-37cb546fd9d1 tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aafdfb29-cf1f-41da-9d2a-eaac0bb5247b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:52 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-547e081c-50b3-4ce8-82c2-37cb546fd9d1 tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef77df0d-bc97-4069-8d04-f32593c5a4df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:52 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-547e081c-50b3-4ce8-82c2-37cb546fd9d1 tempest-CreateVolumesFromSnapshotTest-298673937 None] Volume b67c8389-386b-4932-b1dd-874c96cd0b82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b67c8389-386b-4932-b1dd-874c96cd0b82', 'volume_size': 1} Sep 04 22:58:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-547e081c-50b3-4ce8-82c2-37cb546fd9d1 tempest-CreateVolumesFromSnapshotTest-298673937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:58:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-547e081c-50b3-4ce8-82c2-37cb546fd9d1 tempest-CreateVolumesFromSnapshotTest-298673937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:58:52 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-547e081c-50b3-4ce8-82c2-37cb546fd9d1 tempest-CreateVolumesFromSnapshotTest-298673937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:58:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-110971772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b67c8389-386b-4932-b1dd-874c96cd0b82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e903096c1764673b95099778fb4e663',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:58:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:58:52Z,use_quota=True,user_id='cf5b01a88d494cbba6ba4fedaa7a4651',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:58:52 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-547e081c-50b3-4ce8-82c2-37cb546fd9d1 tempest-CreateVolumesFromSnapshotTest-298673937 None] Creating volume b67c8389-386b-4932-b1dd-874c96cd0b82 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:58:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-547e081c-50b3-4ce8-82c2-37cb546fd9d1 tempest-CreateVolumesFromSnapshotTest-298673937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:58:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-547e081c-50b3-4ce8-82c2-37cb546fd9d1 tempest-CreateVolumesFromSnapshotTest-298673937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:58:52 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-547e081c-50b3-4ce8-82c2-37cb546fd9d1 tempest-CreateVolumesFromSnapshotTest-298673937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:58:52 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-547e081c-50b3-4ce8-82c2-37cb546fd9d1 tempest-CreateVolumesFromSnapshotTest-298673937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:58:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-547e081c-50b3-4ce8-82c2-37cb546fd9d1 tempest-CreateVolumesFromSnapshotTest-298673937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:58:52 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-547e081c-50b3-4ce8-82c2-37cb546fd9d1 tempest-CreateVolumesFromSnapshotTest-298673937 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:58:52 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-547e081c-50b3-4ce8-82c2-37cb546fd9d1 tempest-CreateVolumesFromSnapshotTest-298673937 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:58:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-547e081c-50b3-4ce8-82c2-37cb546fd9d1 tempest-CreateVolumesFromSnapshotTest-298673937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b67c8389-386b-4932-b1dd-874c96cd0b82 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:52 devstack sudo[106900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b67c8389-386b-4932-b1dd-874c96cd0b82 1073741824 Sep 04 22:58:52 devstack sudo[106900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:52 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b56898b-758d-4c72-b62f-77a1504ce608 tempest-CreateVolumesFromSnapshotTest-298673937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:58:52 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-8b56898b-758d-4c72-b62f-77a1504ce608 tempest-CreateVolumesFromSnapshotTest-298673937 None] Flow 'volume_create_manager' (8d612424-1035-42ee-b78f-568215fffdad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:58:52 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-8b56898b-758d-4c72-b62f-77a1504ce608 tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66bad6b4-28fa-41b3-9db2-5e8bd090cbe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:52 devstack sudo[106900]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:52 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-8b56898b-758d-4c72-b62f-77a1504ce608 tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66bad6b4-28fa-41b3-9db2-5e8bd090cbe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:58:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-18203375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38de4868-7350-48b1-81e2-667b45a17e4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e903096c1764673b95099778fb4e663',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:58:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:58:53Z,use_quota=True,user_id='cf5b01a88d494cbba6ba4fedaa7a4651',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:52 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-8b56898b-758d-4c72-b62f-77a1504ce608 tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10a871ac-36b9-42d9-a1d4-d682e4818b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:52 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-8b56898b-758d-4c72-b62f-77a1504ce608 tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10a871ac-36b9-42d9-a1d4-d682e4818b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:52 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-8b56898b-758d-4c72-b62f-77a1504ce608 tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae63faac-eea5-43c1-a23f-8e034041a102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:52 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-8b56898b-758d-4c72-b62f-77a1504ce608 tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae63faac-eea5-43c1-a23f-8e034041a102) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38de4868-7350-48b1-81e2-667b45a17e4c', 'volume_name': 'volume-38de4868-7350-48b1-81e2-667b45a17e4c', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:52 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-8b56898b-758d-4c72-b62f-77a1504ce608 tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed102192-32b3-4b21-a652-675d984aa859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:52 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-8b56898b-758d-4c72-b62f-77a1504ce608 tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed102192-32b3-4b21-a652-675d984aa859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:52 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-8b56898b-758d-4c72-b62f-77a1504ce608 tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13758952-a99b-4720-8382-d43d52a18174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:52 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-8b56898b-758d-4c72-b62f-77a1504ce608 tempest-CreateVolumesFromSnapshotTest-298673937 None] Volume 38de4868-7350-48b1-81e2-667b45a17e4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38de4868-7350-48b1-81e2-667b45a17e4c', 'volume_size': 1} Sep 04 22:58:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-8b56898b-758d-4c72-b62f-77a1504ce608 tempest-CreateVolumesFromSnapshotTest-298673937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:58:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-547e081c-50b3-4ce8-82c2-37cb546fd9d1 tempest-CreateVolumesFromSnapshotTest-298673937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b67c8389-386b-4932-b1dd-874c96cd0b82 1073741824" returned: 0 in 0.660s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-547e081c-50b3-4ce8-82c2-37cb546fd9d1 tempest-CreateVolumesFromSnapshotTest-298673937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b67c8389-386b-4932-b1dd-874c96cd0b82 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:52 devstack sudo[106906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b67c8389-386b-4932-b1dd-874c96cd0b82 Sep 04 22:58:52 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:53 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-09a32dc9-2412-4a9b-9b83-36c3b0853f42 tempest-CreateVolumesFromSnapshotTest-298673937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:58:53 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:53 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-09a32dc9-2412-4a9b-9b83-36c3b0853f42 tempest-CreateVolumesFromSnapshotTest-298673937 None] Flow 'volume_create_manager' (b083de4b-b614-4c15-a5da-8aa1ff0f6278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:58:53 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-09a32dc9-2412-4a9b-9b83-36c3b0853f42 tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d093e2b-675c-450a-9664-75f433c56769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:53 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-547e081c-50b3-4ce8-82c2-37cb546fd9d1 tempest-CreateVolumesFromSnapshotTest-298673937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b67c8389-386b-4932-b1dd-874c96cd0b82" returned: 0 in 0.372s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:53 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-547e081c-50b3-4ce8-82c2-37cb546fd9d1 tempest-CreateVolumesFromSnapshotTest-298673937 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:58:53 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-547e081c-50b3-4ce8-82c2-37cb546fd9d1 tempest-CreateVolumesFromSnapshotTest-298673937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:58:53 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-8b56898b-758d-4c72-b62f-77a1504ce608 tempest-CreateVolumesFromSnapshotTest-298673937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.425s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:58:53 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-8b56898b-758d-4c72-b62f-77a1504ce608 tempest-CreateVolumesFromSnapshotTest-298673937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:58:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-18203375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38de4868-7350-48b1-81e2-667b45a17e4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e903096c1764673b95099778fb4e663',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:58:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:58:53Z,use_quota=True,user_id='cf5b01a88d494cbba6ba4fedaa7a4651',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:58:53 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-8b56898b-758d-4c72-b62f-77a1504ce608 tempest-CreateVolumesFromSnapshotTest-298673937 None] Creating volume 38de4868-7350-48b1-81e2-667b45a17e4c {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:58:53 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-8b56898b-758d-4c72-b62f-77a1504ce608 tempest-CreateVolumesFromSnapshotTest-298673937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:58:53 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-8b56898b-758d-4c72-b62f-77a1504ce608 tempest-CreateVolumesFromSnapshotTest-298673937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:58:53 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-8b56898b-758d-4c72-b62f-77a1504ce608 tempest-CreateVolumesFromSnapshotTest-298673937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:58:53 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-8b56898b-758d-4c72-b62f-77a1504ce608 tempest-CreateVolumesFromSnapshotTest-298673937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:58:53 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-8b56898b-758d-4c72-b62f-77a1504ce608 tempest-CreateVolumesFromSnapshotTest-298673937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:58:53 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-8b56898b-758d-4c72-b62f-77a1504ce608 tempest-CreateVolumesFromSnapshotTest-298673937 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:58:53 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-8b56898b-758d-4c72-b62f-77a1504ce608 tempest-CreateVolumesFromSnapshotTest-298673937 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:58:53 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-8b56898b-758d-4c72-b62f-77a1504ce608 tempest-CreateVolumesFromSnapshotTest-298673937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-38de4868-7350-48b1-81e2-667b45a17e4c 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:53 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-09a32dc9-2412-4a9b-9b83-36c3b0853f42 tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d093e2b-675c-450a-9664-75f433c56769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:58:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1072055811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68d841eb-05eb-4869-a346-1d295d4f2cff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e903096c1764673b95099778fb4e663',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:58:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:58:53Z,use_quota=True,user_id='cf5b01a88d494cbba6ba4fedaa7a4651',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:53 devstack sudo[106910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-38de4868-7350-48b1-81e2-667b45a17e4c 1073741824 Sep 04 22:58:53 devstack sudo[106910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:53 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-09a32dc9-2412-4a9b-9b83-36c3b0853f42 tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (060199b5-7761-4a9c-a83b-24ec7c8e1d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:53 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-09a32dc9-2412-4a9b-9b83-36c3b0853f42 tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (060199b5-7761-4a9c-a83b-24ec7c8e1d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:53 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-09a32dc9-2412-4a9b-9b83-36c3b0853f42 tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d027b5ee-4b7d-433b-8f24-a679580cf664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:53 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-09a32dc9-2412-4a9b-9b83-36c3b0853f42 tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d027b5ee-4b7d-433b-8f24-a679580cf664) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68d841eb-05eb-4869-a346-1d295d4f2cff', 'volume_name': 'volume-68d841eb-05eb-4869-a346-1d295d4f2cff', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:53 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-09a32dc9-2412-4a9b-9b83-36c3b0853f42 tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (803aa9d3-e699-4a98-8869-8987ec9645fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:53 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-09a32dc9-2412-4a9b-9b83-36c3b0853f42 tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (803aa9d3-e699-4a98-8869-8987ec9645fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:53 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-09a32dc9-2412-4a9b-9b83-36c3b0853f42 tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b9969e5-d9d6-4a0b-9fda-554e5010866e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:53 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-09a32dc9-2412-4a9b-9b83-36c3b0853f42 tempest-CreateVolumesFromSnapshotTest-298673937 None] Volume 68d841eb-05eb-4869-a346-1d295d4f2cff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68d841eb-05eb-4869-a346-1d295d4f2cff', 'volume_size': 1} Sep 04 22:58:53 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-09a32dc9-2412-4a9b-9b83-36c3b0853f42 tempest-CreateVolumesFromSnapshotTest-298673937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:58:53 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d0d668d5-c4be-4dff-ad32-a8f447f11d9d tempest-ProjectReaderTests-144208897 None] Acquiring lock "cinder-d2cf7f43-e824-47e3-bcce-7ebd0b49fbcb-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:58:53 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-547e081c-50b3-4ce8-82c2-37cb546fd9d1 tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef77df0d-bc97-4069-8d04-f32593c5a4df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b67c8389-386b-4932-b1dd-874c96cd0b82', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:53 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-547e081c-50b3-4ce8-82c2-37cb546fd9d1 tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c131ffe-fb31-40e1-b2cf-85eb31967ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:53 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d0d668d5-c4be-4dff-ad32-a8f447f11d9d tempest-ProjectReaderTests-144208897 None] Lock "cinder-d2cf7f43-e824-47e3-bcce-7ebd0b49fbcb-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:58:53 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-547e081c-50b3-4ce8-82c2-37cb546fd9d1 tempest-CreateVolumesFromSnapshotTest-298673937 None] Volume volume-b67c8389-386b-4932-b1dd-874c96cd0b82 (b67c8389-386b-4932-b1dd-874c96cd0b82): created successfully Sep 04 22:58:53 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-547e081c-50b3-4ce8-82c2-37cb546fd9d1 tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c131ffe-fb31-40e1-b2cf-85eb31967ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:53 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-547e081c-50b3-4ce8-82c2-37cb546fd9d1 tempest-CreateVolumesFromSnapshotTest-298673937 None] Flow 'volume_create_manager' (03c178cf-f408-4375-816f-3fcc997cdee6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:58:53 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-547e081c-50b3-4ce8-82c2-37cb546fd9d1 tempest-CreateVolumesFromSnapshotTest-298673937 None] Created volume successfully. Sep 04 22:58:53 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d0d668d5-c4be-4dff-ad32-a8f447f11d9d tempest-ProjectReaderTests-144208897 None] Acquiring lock "cinder-quobyte-d2cf7f43-e824-47e3-bcce-7ebd0b49fbcb" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:58:53 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d0d668d5-c4be-4dff-ad32-a8f447f11d9d tempest-ProjectReaderTests-144208897 None] Lock "cinder-quobyte-d2cf7f43-e824-47e3-bcce-7ebd0b49fbcb" acquired by "delete_volume" :: waited 0.029s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:58:53 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[c605c4d5-9ca6-4d2b-b244-f0361d2e0563]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:58:53 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d0d668d5-c4be-4dff-ad32-a8f447f11d9d tempest-ProjectReaderTests-144208897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d2cf7f43-e824-47e3-bcce-7ebd0b49fbcb {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:53 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-0eab9f9b-acdc-48ba-949a-e772bbd5d82d tempest-CreateVolumesFromSnapshotTest-298673937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:58:53 devstack sudo[106914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d2cf7f43-e824-47e3-bcce-7ebd0b49fbcb Sep 04 22:58:53 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:53 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0eab9f9b-acdc-48ba-949a-e772bbd5d82d tempest-CreateVolumesFromSnapshotTest-298673937 None] Flow 'volume_create_manager' (48ad8e18-56c9-4afe-b3e0-8ba350b8b012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:58:53 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0eab9f9b-acdc-48ba-949a-e772bbd5d82d tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa6fbcbe-f8cb-4933-a04c-41be6aa31431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:53 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0eab9f9b-acdc-48ba-949a-e772bbd5d82d tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa6fbcbe-f8cb-4933-a04c-41be6aa31431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:58:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-55063137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb27191b-a675-494c-baa4-244fe1f61a92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e903096c1764673b95099778fb4e663',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:58:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:58:54Z,use_quota=True,user_id='cf5b01a88d494cbba6ba4fedaa7a4651',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:53 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0eab9f9b-acdc-48ba-949a-e772bbd5d82d tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64a98f0f-9087-4dab-82ea-6d95372cfe0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:53 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0eab9f9b-acdc-48ba-949a-e772bbd5d82d tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64a98f0f-9087-4dab-82ea-6d95372cfe0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:53 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0eab9f9b-acdc-48ba-949a-e772bbd5d82d tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d99e2998-cfb6-4c47-bcaf-64382ee3d08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:53 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0eab9f9b-acdc-48ba-949a-e772bbd5d82d tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d99e2998-cfb6-4c47-bcaf-64382ee3d08e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb27191b-a675-494c-baa4-244fe1f61a92', 'volume_name': 'volume-eb27191b-a675-494c-baa4-244fe1f61a92', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:53 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0eab9f9b-acdc-48ba-949a-e772bbd5d82d tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05526424-d72b-432d-814f-6fe71a138a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:53 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0eab9f9b-acdc-48ba-949a-e772bbd5d82d tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05526424-d72b-432d-814f-6fe71a138a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:53 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0eab9f9b-acdc-48ba-949a-e772bbd5d82d tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67e65db7-2cda-4c75-8b6b-6d07648c5846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:53 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-0eab9f9b-acdc-48ba-949a-e772bbd5d82d tempest-CreateVolumesFromSnapshotTest-298673937 None] Volume eb27191b-a675-494c-baa4-244fe1f61a92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb27191b-a675-494c-baa4-244fe1f61a92', 'volume_size': 1} Sep 04 22:58:53 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-0eab9f9b-acdc-48ba-949a-e772bbd5d82d tempest-CreateVolumesFromSnapshotTest-298673937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:58:54 devstack sudo[106910]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-8b56898b-758d-4c72-b62f-77a1504ce608 tempest-CreateVolumesFromSnapshotTest-298673937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-38de4868-7350-48b1-81e2-667b45a17e4c 1073741824" returned: 0 in 0.775s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-8b56898b-758d-4c72-b62f-77a1504ce608 tempest-CreateVolumesFromSnapshotTest-298673937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-38de4868-7350-48b1-81e2-667b45a17e4c {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:54 devstack sudo[106919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-38de4868-7350-48b1-81e2-667b45a17e4c Sep 04 22:58:54 devstack sudo[106919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:54 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d0d668d5-c4be-4dff-ad32-a8f447f11d9d tempest-ProjectReaderTests-144208897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d2cf7f43-e824-47e3-bcce-7ebd0b49fbcb" returned: 0 in 0.645s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d0d668d5-c4be-4dff-ad32-a8f447f11d9d tempest-ProjectReaderTests-144208897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d2cf7f43-e824-47e3-bcce-7ebd0b49fbcb {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:54 devstack sudo[106923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d2cf7f43-e824-47e3-bcce-7ebd0b49fbcb Sep 04 22:58:54 devstack sudo[106923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:54 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-11596572-9728-440d-9051-2ecb0c35d0b7 tempest-CreateVolumesFromSnapshotTest-298673937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:58:54 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-11596572-9728-440d-9051-2ecb0c35d0b7 tempest-CreateVolumesFromSnapshotTest-298673937 None] Flow 'volume_create_manager' (7dabc2d1-4ebf-47b0-b0ac-09ca33224705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:58:54 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-11596572-9728-440d-9051-2ecb0c35d0b7 tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acf5d3ce-5656-4ab5-bfb8-e1e3343081d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:54 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-11596572-9728-440d-9051-2ecb0c35d0b7 tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acf5d3ce-5656-4ab5-bfb8-e1e3343081d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:58:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-296179459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c98f50e7-ddc0-4522-b6a4-e8d46a34e37e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e903096c1764673b95099778fb4e663',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:58:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:58:54Z,use_quota=True,user_id='cf5b01a88d494cbba6ba4fedaa7a4651',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:54 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-11596572-9728-440d-9051-2ecb0c35d0b7 tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44f40d95-9693-45d8-b109-ce8cb34c4882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:54 devstack sudo[106919]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:54 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-11596572-9728-440d-9051-2ecb0c35d0b7 tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44f40d95-9693-45d8-b109-ce8cb34c4882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:54 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-11596572-9728-440d-9051-2ecb0c35d0b7 tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d9709ad-8481-4df7-a65b-a73d7ad45e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:54 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-11596572-9728-440d-9051-2ecb0c35d0b7 tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d9709ad-8481-4df7-a65b-a73d7ad45e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c98f50e7-ddc0-4522-b6a4-e8d46a34e37e', 'volume_name': 'volume-c98f50e7-ddc0-4522-b6a4-e8d46a34e37e', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:54 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-11596572-9728-440d-9051-2ecb0c35d0b7 tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cbaff14-cb84-4a6e-90f9-91da5d4da8c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:54 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-11596572-9728-440d-9051-2ecb0c35d0b7 tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cbaff14-cb84-4a6e-90f9-91da5d4da8c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:54 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-11596572-9728-440d-9051-2ecb0c35d0b7 tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (892bb810-e70e-4272-aac5-75151a688310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:54 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-11596572-9728-440d-9051-2ecb0c35d0b7 tempest-CreateVolumesFromSnapshotTest-298673937 None] Volume c98f50e7-ddc0-4522-b6a4-e8d46a34e37e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c98f50e7-ddc0-4522-b6a4-e8d46a34e37e', 'volume_size': 1} Sep 04 22:58:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-11596572-9728-440d-9051-2ecb0c35d0b7 tempest-CreateVolumesFromSnapshotTest-298673937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:58:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-8b56898b-758d-4c72-b62f-77a1504ce608 tempest-CreateVolumesFromSnapshotTest-298673937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-38de4868-7350-48b1-81e2-667b45a17e4c" returned: 0 in 0.484s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:54 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-8b56898b-758d-4c72-b62f-77a1504ce608 tempest-CreateVolumesFromSnapshotTest-298673937 None] <== create_volume: return (1335ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:58:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-8b56898b-758d-4c72-b62f-77a1504ce608 tempest-CreateVolumesFromSnapshotTest-298673937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.340s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:58:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-09a32dc9-2412-4a9b-9b83-36c3b0853f42 tempest-CreateVolumesFromSnapshotTest-298673937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.203s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:58:54 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-09a32dc9-2412-4a9b-9b83-36c3b0853f42 tempest-CreateVolumesFromSnapshotTest-298673937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:58:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1072055811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68d841eb-05eb-4869-a346-1d295d4f2cff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e903096c1764673b95099778fb4e663',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:58:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:58:53Z,use_quota=True,user_id='cf5b01a88d494cbba6ba4fedaa7a4651',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:58:54 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-09a32dc9-2412-4a9b-9b83-36c3b0853f42 tempest-CreateVolumesFromSnapshotTest-298673937 None] Creating volume 68d841eb-05eb-4869-a346-1d295d4f2cff {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:58:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-09a32dc9-2412-4a9b-9b83-36c3b0853f42 tempest-CreateVolumesFromSnapshotTest-298673937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:58:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-09a32dc9-2412-4a9b-9b83-36c3b0853f42 tempest-CreateVolumesFromSnapshotTest-298673937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:58:54 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-09a32dc9-2412-4a9b-9b83-36c3b0853f42 tempest-CreateVolumesFromSnapshotTest-298673937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:58:54 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-09a32dc9-2412-4a9b-9b83-36c3b0853f42 tempest-CreateVolumesFromSnapshotTest-298673937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:58:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-09a32dc9-2412-4a9b-9b83-36c3b0853f42 tempest-CreateVolumesFromSnapshotTest-298673937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:58:54 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-09a32dc9-2412-4a9b-9b83-36c3b0853f42 tempest-CreateVolumesFromSnapshotTest-298673937 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:58:54 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-09a32dc9-2412-4a9b-9b83-36c3b0853f42 tempest-CreateVolumesFromSnapshotTest-298673937 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:58:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-09a32dc9-2412-4a9b-9b83-36c3b0853f42 tempest-CreateVolumesFromSnapshotTest-298673937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-68d841eb-05eb-4869-a346-1d295d4f2cff 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:54 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-8b56898b-758d-4c72-b62f-77a1504ce608 tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13758952-a99b-4720-8382-d43d52a18174) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38de4868-7350-48b1-81e2-667b45a17e4c', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:54 devstack sudo[106927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-68d841eb-05eb-4869-a346-1d295d4f2cff 1073741824 Sep 04 22:58:54 devstack sudo[106927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:54 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-8b56898b-758d-4c72-b62f-77a1504ce608 tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (863499c7-ab97-4801-abc8-9f31bf14485e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:54 devstack sudo[106923]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d0d668d5-c4be-4dff-ad32-a8f447f11d9d tempest-ProjectReaderTests-144208897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d2cf7f43-e824-47e3-bcce-7ebd0b49fbcb" returned: 0 in 0.379s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:54 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-8b56898b-758d-4c72-b62f-77a1504ce608 tempest-CreateVolumesFromSnapshotTest-298673937 None] Volume volume-38de4868-7350-48b1-81e2-667b45a17e4c (38de4868-7350-48b1-81e2-667b45a17e4c): created successfully Sep 04 22:58:54 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-8b56898b-758d-4c72-b62f-77a1504ce608 tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (863499c7-ab97-4801-abc8-9f31bf14485e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:54 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-8b56898b-758d-4c72-b62f-77a1504ce608 tempest-CreateVolumesFromSnapshotTest-298673937 None] Flow 'volume_create_manager' (8d612424-1035-42ee-b78f-568215fffdad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:58:54 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d0d668d5-c4be-4dff-ad32-a8f447f11d9d tempest-ProjectReaderTests-144208897 None] Lock "cinder-quobyte-d2cf7f43-e824-47e3-bcce-7ebd0b49fbcb" released by "delete_volume" :: held 1.130s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:58:54 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-8b56898b-758d-4c72-b62f-77a1504ce608 tempest-CreateVolumesFromSnapshotTest-298673937 None] Created volume successfully. Sep 04 22:58:54 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-d0d668d5-c4be-4dff-ad32-a8f447f11d9d tempest-ProjectReaderTests-144208897 None] Created reservations ['f05f3000-cf3f-4b63-9460-f430d35358ec', '5bfa8217-c512-43cb-99ce-a5e0799accce', '9351efc3-9eb9-4615-84d1-1ccec10cf103', '5acc47c5-376c-4212-a5e3-785cf2f9e130'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:58:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-d0d668d5-c4be-4dff-ad32-a8f447f11d9d tempest-ProjectReaderTests-144208897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:58:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-d0d668d5-c4be-4dff-ad32-a8f447f11d9d tempest-ProjectReaderTests-144208897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:58:54 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-d0d668d5-c4be-4dff-ad32-a8f447f11d9d tempest-ProjectReaderTests-144208897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:58:54 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-d0d668d5-c4be-4dff-ad32-a8f447f11d9d tempest-ProjectReaderTests-144208897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:58:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-d0d668d5-c4be-4dff-ad32-a8f447f11d9d tempest-ProjectReaderTests-144208897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:58:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d0d668d5-c4be-4dff-ad32-a8f447f11d9d tempest-ProjectReaderTests-144208897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:55 devstack sudo[106932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:58:55 devstack sudo[106932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:55 devstack sudo[106927]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-09a32dc9-2412-4a9b-9b83-36c3b0853f42 tempest-CreateVolumesFromSnapshotTest-298673937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-68d841eb-05eb-4869-a346-1d295d4f2cff 1073741824" returned: 0 in 0.537s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-09a32dc9-2412-4a9b-9b83-36c3b0853f42 tempest-CreateVolumesFromSnapshotTest-298673937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-68d841eb-05eb-4869-a346-1d295d4f2cff {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:55 devstack sudo[106935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-68d841eb-05eb-4869-a346-1d295d4f2cff Sep 04 22:58:55 devstack sudo[106935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:55 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-3216104a-02d3-4978-b58b-c7b20616a376 tempest-VolumeDependencyTests-217794804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:58:55 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3216104a-02d3-4978-b58b-c7b20616a376 tempest-VolumeDependencyTests-217794804 None] Flow 'volume_create_manager' (8df28606-23bb-4487-9d55-d7f01aaab25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:58:55 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3216104a-02d3-4978-b58b-c7b20616a376 tempest-VolumeDependencyTests-217794804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (458d4ba0-4a4a-44c1-8908-4c856d1b65fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:55 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3216104a-02d3-4978-b58b-c7b20616a376 tempest-VolumeDependencyTests-217794804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (458d4ba0-4a4a-44c1-8908-4c856d1b65fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:58:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1007297516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94642597-f21c-480d-85ff-29d708879b6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='612e70eb0fd74d4e8df3c3ab2c7c819a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:58:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:58:55Z,use_quota=True,user_id='057f24a5b27e47028f9032dfae8586f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:55 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3216104a-02d3-4978-b58b-c7b20616a376 tempest-VolumeDependencyTests-217794804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9089388-92b4-434f-a873-88e256e5a42c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:55 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3216104a-02d3-4978-b58b-c7b20616a376 tempest-VolumeDependencyTests-217794804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9089388-92b4-434f-a873-88e256e5a42c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:55 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3216104a-02d3-4978-b58b-c7b20616a376 tempest-VolumeDependencyTests-217794804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f588782-fad6-4548-a471-2fbdfd37e49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:55 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3216104a-02d3-4978-b58b-c7b20616a376 tempest-VolumeDependencyTests-217794804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f588782-fad6-4548-a471-2fbdfd37e49c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94642597-f21c-480d-85ff-29d708879b6f', 'volume_name': 'volume-94642597-f21c-480d-85ff-29d708879b6f', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:55 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3216104a-02d3-4978-b58b-c7b20616a376 tempest-VolumeDependencyTests-217794804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (416675bd-d0c0-411f-8825-4bf3042dd0a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:55 devstack sudo[106932]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:55 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3216104a-02d3-4978-b58b-c7b20616a376 tempest-VolumeDependencyTests-217794804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (416675bd-d0c0-411f-8825-4bf3042dd0a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:55 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3216104a-02d3-4978-b58b-c7b20616a376 tempest-VolumeDependencyTests-217794804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0af83fca-9e13-4ca5-8dd8-e5027f35875e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:55 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-3216104a-02d3-4978-b58b-c7b20616a376 tempest-VolumeDependencyTests-217794804 None] Volume 94642597-f21c-480d-85ff-29d708879b6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94642597-f21c-480d-85ff-29d708879b6f', 'volume_size': 1} Sep 04 22:58:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-3216104a-02d3-4978-b58b-c7b20616a376 tempest-VolumeDependencyTests-217794804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:58:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d0d668d5-c4be-4dff-ad32-a8f447f11d9d tempest-ProjectReaderTests-144208897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.351s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:55 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-d0d668d5-c4be-4dff-ad32-a8f447f11d9d tempest-ProjectReaderTests-144208897 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:58:55 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-d0d668d5-c4be-4dff-ad32-a8f447f11d9d tempest-ProjectReaderTests-144208897 None] Deleted volume successfully. Sep 04 22:58:55 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-d0d668d5-c4be-4dff-ad32-a8f447f11d9d tempest-ProjectReaderTests-144208897 None] Lock "cinder-d2cf7f43-e824-47e3-bcce-7ebd0b49fbcb-delete_volume" released by "delete_volume" :: held 1.880s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:58:55 devstack sudo[106935]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-09a32dc9-2412-4a9b-9b83-36c3b0853f42 tempest-CreateVolumesFromSnapshotTest-298673937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-68d841eb-05eb-4869-a346-1d295d4f2cff" returned: 0 in 0.353s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:55 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-09a32dc9-2412-4a9b-9b83-36c3b0853f42 tempest-CreateVolumesFromSnapshotTest-298673937 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:58:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-09a32dc9-2412-4a9b-9b83-36c3b0853f42 tempest-CreateVolumesFromSnapshotTest-298673937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:58:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-0eab9f9b-acdc-48ba-949a-e772bbd5d82d tempest-CreateVolumesFromSnapshotTest-298673937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.600s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:58:55 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-0eab9f9b-acdc-48ba-949a-e772bbd5d82d tempest-CreateVolumesFromSnapshotTest-298673937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:58:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-55063137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb27191b-a675-494c-baa4-244fe1f61a92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e903096c1764673b95099778fb4e663',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:58:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:58:54Z,use_quota=True,user_id='cf5b01a88d494cbba6ba4fedaa7a4651',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:58:55 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-0eab9f9b-acdc-48ba-949a-e772bbd5d82d tempest-CreateVolumesFromSnapshotTest-298673937 None] Creating volume eb27191b-a675-494c-baa4-244fe1f61a92 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:58:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-0eab9f9b-acdc-48ba-949a-e772bbd5d82d tempest-CreateVolumesFromSnapshotTest-298673937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:58:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-0eab9f9b-acdc-48ba-949a-e772bbd5d82d tempest-CreateVolumesFromSnapshotTest-298673937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:58:55 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-0eab9f9b-acdc-48ba-949a-e772bbd5d82d tempest-CreateVolumesFromSnapshotTest-298673937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:58:55 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-0eab9f9b-acdc-48ba-949a-e772bbd5d82d tempest-CreateVolumesFromSnapshotTest-298673937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:58:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-0eab9f9b-acdc-48ba-949a-e772bbd5d82d tempest-CreateVolumesFromSnapshotTest-298673937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:58:55 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-0eab9f9b-acdc-48ba-949a-e772bbd5d82d tempest-CreateVolumesFromSnapshotTest-298673937 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:58:55 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-0eab9f9b-acdc-48ba-949a-e772bbd5d82d tempest-CreateVolumesFromSnapshotTest-298673937 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:58:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0eab9f9b-acdc-48ba-949a-e772bbd5d82d tempest-CreateVolumesFromSnapshotTest-298673937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-eb27191b-a675-494c-baa4-244fe1f61a92 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:55 devstack sudo[106939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-eb27191b-a675-494c-baa4-244fe1f61a92 1073741824 Sep 04 22:58:55 devstack sudo[106939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:55 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-09a32dc9-2412-4a9b-9b83-36c3b0853f42 tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b9969e5-d9d6-4a0b-9fda-554e5010866e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68d841eb-05eb-4869-a346-1d295d4f2cff', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:55 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-09a32dc9-2412-4a9b-9b83-36c3b0853f42 tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c33adf4-ce2b-4f29-ba76-dbe66d64c28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:55 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-09a32dc9-2412-4a9b-9b83-36c3b0853f42 tempest-CreateVolumesFromSnapshotTest-298673937 None] Volume volume-68d841eb-05eb-4869-a346-1d295d4f2cff (68d841eb-05eb-4869-a346-1d295d4f2cff): created successfully Sep 04 22:58:55 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-09a32dc9-2412-4a9b-9b83-36c3b0853f42 tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c33adf4-ce2b-4f29-ba76-dbe66d64c28f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:55 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-09a32dc9-2412-4a9b-9b83-36c3b0853f42 tempest-CreateVolumesFromSnapshotTest-298673937 None] Flow 'volume_create_manager' (b083de4b-b614-4c15-a5da-8aa1ff0f6278) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:58:55 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-09a32dc9-2412-4a9b-9b83-36c3b0853f42 tempest-CreateVolumesFromSnapshotTest-298673937 None] Created volume successfully. Sep 04 22:58:56 devstack sudo[106939]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0eab9f9b-acdc-48ba-949a-e772bbd5d82d tempest-CreateVolumesFromSnapshotTest-298673937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-eb27191b-a675-494c-baa4-244fe1f61a92 1073741824" returned: 0 in 0.528s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0eab9f9b-acdc-48ba-949a-e772bbd5d82d tempest-CreateVolumesFromSnapshotTest-298673937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-eb27191b-a675-494c-baa4-244fe1f61a92 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:56 devstack sudo[106945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-eb27191b-a675-494c-baa4-244fe1f61a92 Sep 04 22:58:56 devstack sudo[106945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:56 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a7bdec2-2c70-41ac-952d-f45d5e68fc43 tempest-ProjectReaderTests-144208897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:58:56 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9a7bdec2-2c70-41ac-952d-f45d5e68fc43 tempest-ProjectReaderTests-144208897 None] Flow 'volume_create_manager' (e58309a0-2875-4827-a079-f53d9775b5eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:58:56 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9a7bdec2-2c70-41ac-952d-f45d5e68fc43 tempest-ProjectReaderTests-144208897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a30a240-95b9-4768-9bbc-839d16f47787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:56 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9a7bdec2-2c70-41ac-952d-f45d5e68fc43 tempest-ProjectReaderTests-144208897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a30a240-95b9-4768-9bbc-839d16f47787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:58:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1221191544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1961ace-c544-489a-b6d0-cc124985b3a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63e43a45529e4d3cbc3f4c88d615f0db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:58:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:58:56Z,use_quota=True,user_id='5bbdd8019f1644f99a01e156b80c6dbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:56 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9a7bdec2-2c70-41ac-952d-f45d5e68fc43 tempest-ProjectReaderTests-144208897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (461f470f-11cf-4e0b-97c6-f3f21e35c7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:56 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9a7bdec2-2c70-41ac-952d-f45d5e68fc43 tempest-ProjectReaderTests-144208897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (461f470f-11cf-4e0b-97c6-f3f21e35c7c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:56 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9a7bdec2-2c70-41ac-952d-f45d5e68fc43 tempest-ProjectReaderTests-144208897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8550cc16-7716-40e4-9110-65d77587451b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:56 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9a7bdec2-2c70-41ac-952d-f45d5e68fc43 tempest-ProjectReaderTests-144208897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8550cc16-7716-40e4-9110-65d77587451b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1961ace-c544-489a-b6d0-cc124985b3a3', 'volume_name': 'volume-d1961ace-c544-489a-b6d0-cc124985b3a3', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:56 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9a7bdec2-2c70-41ac-952d-f45d5e68fc43 tempest-ProjectReaderTests-144208897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffa659b2-447e-4f25-b543-4c02ec002cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:56 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9a7bdec2-2c70-41ac-952d-f45d5e68fc43 tempest-ProjectReaderTests-144208897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffa659b2-447e-4f25-b543-4c02ec002cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:56 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9a7bdec2-2c70-41ac-952d-f45d5e68fc43 tempest-ProjectReaderTests-144208897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3c990c7-baa6-4460-bfa0-5c6982d1ce89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:56 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-9a7bdec2-2c70-41ac-952d-f45d5e68fc43 tempest-ProjectReaderTests-144208897 None] Volume d1961ace-c544-489a-b6d0-cc124985b3a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1961ace-c544-489a-b6d0-cc124985b3a3', 'volume_size': 1} Sep 04 22:58:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-9a7bdec2-2c70-41ac-952d-f45d5e68fc43 tempest-ProjectReaderTests-144208897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:58:56 devstack sudo[106945]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0eab9f9b-acdc-48ba-949a-e772bbd5d82d tempest-CreateVolumesFromSnapshotTest-298673937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-eb27191b-a675-494c-baa4-244fe1f61a92" returned: 0 in 0.263s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:56 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-0eab9f9b-acdc-48ba-949a-e772bbd5d82d tempest-CreateVolumesFromSnapshotTest-298673937 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:58:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-0eab9f9b-acdc-48ba-949a-e772bbd5d82d tempest-CreateVolumesFromSnapshotTest-298673937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:58:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-11596572-9728-440d-9051-2ecb0c35d0b7 tempest-CreateVolumesFromSnapshotTest-298673937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.831s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:58:56 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-11596572-9728-440d-9051-2ecb0c35d0b7 tempest-CreateVolumesFromSnapshotTest-298673937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:58:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-296179459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c98f50e7-ddc0-4522-b6a4-e8d46a34e37e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e903096c1764673b95099778fb4e663',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:58:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:58:54Z,use_quota=True,user_id='cf5b01a88d494cbba6ba4fedaa7a4651',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:58:56 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-11596572-9728-440d-9051-2ecb0c35d0b7 tempest-CreateVolumesFromSnapshotTest-298673937 None] Creating volume c98f50e7-ddc0-4522-b6a4-e8d46a34e37e {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:58:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-11596572-9728-440d-9051-2ecb0c35d0b7 tempest-CreateVolumesFromSnapshotTest-298673937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:58:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-11596572-9728-440d-9051-2ecb0c35d0b7 tempest-CreateVolumesFromSnapshotTest-298673937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:58:56 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-11596572-9728-440d-9051-2ecb0c35d0b7 tempest-CreateVolumesFromSnapshotTest-298673937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:58:56 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-11596572-9728-440d-9051-2ecb0c35d0b7 tempest-CreateVolumesFromSnapshotTest-298673937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:58:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-11596572-9728-440d-9051-2ecb0c35d0b7 tempest-CreateVolumesFromSnapshotTest-298673937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:58:56 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-11596572-9728-440d-9051-2ecb0c35d0b7 tempest-CreateVolumesFromSnapshotTest-298673937 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:58:56 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-11596572-9728-440d-9051-2ecb0c35d0b7 tempest-CreateVolumesFromSnapshotTest-298673937 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:58:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-11596572-9728-440d-9051-2ecb0c35d0b7 tempest-CreateVolumesFromSnapshotTest-298673937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c98f50e7-ddc0-4522-b6a4-e8d46a34e37e 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:56 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0eab9f9b-acdc-48ba-949a-e772bbd5d82d tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67e65db7-2cda-4c75-8b6b-6d07648c5846) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb27191b-a675-494c-baa4-244fe1f61a92', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:56 devstack sudo[106948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c98f50e7-ddc0-4522-b6a4-e8d46a34e37e 1073741824 Sep 04 22:58:56 devstack sudo[106948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:56 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0eab9f9b-acdc-48ba-949a-e772bbd5d82d tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddf9515a-61c2-48e1-8560-abdaace8cbb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:56 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-0eab9f9b-acdc-48ba-949a-e772bbd5d82d tempest-CreateVolumesFromSnapshotTest-298673937 None] Volume volume-eb27191b-a675-494c-baa4-244fe1f61a92 (eb27191b-a675-494c-baa4-244fe1f61a92): created successfully Sep 04 22:58:56 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0eab9f9b-acdc-48ba-949a-e772bbd5d82d tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddf9515a-61c2-48e1-8560-abdaace8cbb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:56 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0eab9f9b-acdc-48ba-949a-e772bbd5d82d tempest-CreateVolumesFromSnapshotTest-298673937 None] Flow 'volume_create_manager' (48ad8e18-56c9-4afe-b3e0-8ba350b8b012) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:58:56 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-0eab9f9b-acdc-48ba-949a-e772bbd5d82d tempest-CreateVolumesFromSnapshotTest-298673937 None] Created volume successfully. Sep 04 22:58:56 devstack sudo[106948]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-11596572-9728-440d-9051-2ecb0c35d0b7 tempest-CreateVolumesFromSnapshotTest-298673937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c98f50e7-ddc0-4522-b6a4-e8d46a34e37e 1073741824" returned: 0 in 0.489s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-11596572-9728-440d-9051-2ecb0c35d0b7 tempest-CreateVolumesFromSnapshotTest-298673937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c98f50e7-ddc0-4522-b6a4-e8d46a34e37e {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:56 devstack sudo[106954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c98f50e7-ddc0-4522-b6a4-e8d46a34e37e Sep 04 22:58:56 devstack sudo[106954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:57 devstack sudo[106954]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-11596572-9728-440d-9051-2ecb0c35d0b7 tempest-CreateVolumesFromSnapshotTest-298673937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c98f50e7-ddc0-4522-b6a4-e8d46a34e37e" returned: 0 in 0.259s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:57 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-11596572-9728-440d-9051-2ecb0c35d0b7 tempest-CreateVolumesFromSnapshotTest-298673937 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:58:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-11596572-9728-440d-9051-2ecb0c35d0b7 tempest-CreateVolumesFromSnapshotTest-298673937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:58:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-3216104a-02d3-4978-b58b-c7b20616a376 tempest-VolumeDependencyTests-217794804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.880s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:58:57 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-3216104a-02d3-4978-b58b-c7b20616a376 tempest-VolumeDependencyTests-217794804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:58:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1007297516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94642597-f21c-480d-85ff-29d708879b6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='612e70eb0fd74d4e8df3c3ab2c7c819a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:58:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:58:55Z,use_quota=True,user_id='057f24a5b27e47028f9032dfae8586f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:58:57 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-3216104a-02d3-4978-b58b-c7b20616a376 tempest-VolumeDependencyTests-217794804 None] Creating volume 94642597-f21c-480d-85ff-29d708879b6f {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:58:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-3216104a-02d3-4978-b58b-c7b20616a376 tempest-VolumeDependencyTests-217794804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:58:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-3216104a-02d3-4978-b58b-c7b20616a376 tempest-VolumeDependencyTests-217794804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:58:57 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-3216104a-02d3-4978-b58b-c7b20616a376 tempest-VolumeDependencyTests-217794804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:58:57 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-3216104a-02d3-4978-b58b-c7b20616a376 tempest-VolumeDependencyTests-217794804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:58:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-3216104a-02d3-4978-b58b-c7b20616a376 tempest-VolumeDependencyTests-217794804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:58:57 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-3216104a-02d3-4978-b58b-c7b20616a376 tempest-VolumeDependencyTests-217794804 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:58:57 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-3216104a-02d3-4978-b58b-c7b20616a376 tempest-VolumeDependencyTests-217794804 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:58:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3216104a-02d3-4978-b58b-c7b20616a376 tempest-VolumeDependencyTests-217794804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94642597-f21c-480d-85ff-29d708879b6f 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:57 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-11596572-9728-440d-9051-2ecb0c35d0b7 tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (892bb810-e70e-4272-aac5-75151a688310) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c98f50e7-ddc0-4522-b6a4-e8d46a34e37e', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:57 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-11596572-9728-440d-9051-2ecb0c35d0b7 tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c5c9f26-273e-4614-9c49-12045066bb94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:57 devstack sudo[106957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94642597-f21c-480d-85ff-29d708879b6f 1073741824 Sep 04 22:58:57 devstack sudo[106957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:57 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-11596572-9728-440d-9051-2ecb0c35d0b7 tempest-CreateVolumesFromSnapshotTest-298673937 None] Volume volume-c98f50e7-ddc0-4522-b6a4-e8d46a34e37e (c98f50e7-ddc0-4522-b6a4-e8d46a34e37e): created successfully Sep 04 22:58:57 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-11596572-9728-440d-9051-2ecb0c35d0b7 tempest-CreateVolumesFromSnapshotTest-298673937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c5c9f26-273e-4614-9c49-12045066bb94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:57 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-11596572-9728-440d-9051-2ecb0c35d0b7 tempest-CreateVolumesFromSnapshotTest-298673937 None] Flow 'volume_create_manager' (7dabc2d1-4ebf-47b0-b0ac-09ca33224705) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:58:57 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-11596572-9728-440d-9051-2ecb0c35d0b7 tempest-CreateVolumesFromSnapshotTest-298673937 None] Created volume successfully. Sep 04 22:58:57 devstack sudo[106957]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3216104a-02d3-4978-b58b-c7b20616a376 tempest-VolumeDependencyTests-217794804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94642597-f21c-480d-85ff-29d708879b6f 1073741824" returned: 0 in 0.480s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3216104a-02d3-4978-b58b-c7b20616a376 tempest-VolumeDependencyTests-217794804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94642597-f21c-480d-85ff-29d708879b6f {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:57 devstack sudo[106963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94642597-f21c-480d-85ff-29d708879b6f Sep 04 22:58:57 devstack sudo[106963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:57 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-e425a621-4285-4964-abd4-e387492326c5 tempest-CreateVolumesFromSnapshotTest-298673937 None] Acquiring lock "cinder-c98f50e7-ddc0-4522-b6a4-e8d46a34e37e-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:58:57 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-e425a621-4285-4964-abd4-e387492326c5 tempest-CreateVolumesFromSnapshotTest-298673937 None] Lock "cinder-c98f50e7-ddc0-4522-b6a4-e8d46a34e37e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:58:57 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-e425a621-4285-4964-abd4-e387492326c5 tempest-CreateVolumesFromSnapshotTest-298673937 None] Acquiring lock "cinder-quobyte-c98f50e7-ddc0-4522-b6a4-e8d46a34e37e" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:58:57 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-e425a621-4285-4964-abd4-e387492326c5 tempest-CreateVolumesFromSnapshotTest-298673937 None] Lock "cinder-quobyte-c98f50e7-ddc0-4522-b6a4-e8d46a34e37e" acquired by "delete_volume" :: waited 0.018s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:58:57 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cbd6153-abee-418d-b95c-2cb3f3444871]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:58:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e425a621-4285-4964-abd4-e387492326c5 tempest-CreateVolumesFromSnapshotTest-298673937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c98f50e7-ddc0-4522-b6a4-e8d46a34e37e {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:58 devstack sudo[106963]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3216104a-02d3-4978-b58b-c7b20616a376 tempest-VolumeDependencyTests-217794804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94642597-f21c-480d-85ff-29d708879b6f" returned: 0 in 0.305s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:58 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-3216104a-02d3-4978-b58b-c7b20616a376 tempest-VolumeDependencyTests-217794804 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:58:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-3216104a-02d3-4978-b58b-c7b20616a376 tempest-VolumeDependencyTests-217794804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:58:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-9a7bdec2-2c70-41ac-952d-f45d5e68fc43 tempest-ProjectReaderTests-144208897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.679s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:58:58 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-9a7bdec2-2c70-41ac-952d-f45d5e68fc43 tempest-ProjectReaderTests-144208897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:58:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1221191544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1961ace-c544-489a-b6d0-cc124985b3a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63e43a45529e4d3cbc3f4c88d615f0db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:58:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:58:56Z,use_quota=True,user_id='5bbdd8019f1644f99a01e156b80c6dbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:58:58 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-9a7bdec2-2c70-41ac-952d-f45d5e68fc43 tempest-ProjectReaderTests-144208897 None] Creating volume d1961ace-c544-489a-b6d0-cc124985b3a3 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:58:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-9a7bdec2-2c70-41ac-952d-f45d5e68fc43 tempest-ProjectReaderTests-144208897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:58:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-9a7bdec2-2c70-41ac-952d-f45d5e68fc43 tempest-ProjectReaderTests-144208897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:58:58 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-9a7bdec2-2c70-41ac-952d-f45d5e68fc43 tempest-ProjectReaderTests-144208897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:58:58 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-9a7bdec2-2c70-41ac-952d-f45d5e68fc43 tempest-ProjectReaderTests-144208897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:58:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-9a7bdec2-2c70-41ac-952d-f45d5e68fc43 tempest-ProjectReaderTests-144208897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:58:58 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-9a7bdec2-2c70-41ac-952d-f45d5e68fc43 tempest-ProjectReaderTests-144208897 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:58:58 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-9a7bdec2-2c70-41ac-952d-f45d5e68fc43 tempest-ProjectReaderTests-144208897 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:58:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-9a7bdec2-2c70-41ac-952d-f45d5e68fc43 tempest-ProjectReaderTests-144208897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d1961ace-c544-489a-b6d0-cc124985b3a3 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:58 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3216104a-02d3-4978-b58b-c7b20616a376 tempest-VolumeDependencyTests-217794804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0af83fca-9e13-4ca5-8dd8-e5027f35875e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94642597-f21c-480d-85ff-29d708879b6f', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:58 devstack sudo[106967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d1961ace-c544-489a-b6d0-cc124985b3a3 1073741824 Sep 04 22:58:58 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:58 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3216104a-02d3-4978-b58b-c7b20616a376 tempest-VolumeDependencyTests-217794804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f91478bc-b8c6-4713-818d-5e1d15d72f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:58 devstack sudo[106965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c98f50e7-ddc0-4522-b6a4-e8d46a34e37e Sep 04 22:58:58 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-3216104a-02d3-4978-b58b-c7b20616a376 tempest-VolumeDependencyTests-217794804 None] Volume volume-94642597-f21c-480d-85ff-29d708879b6f (94642597-f21c-480d-85ff-29d708879b6f): created successfully Sep 04 22:58:58 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:58 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3216104a-02d3-4978-b58b-c7b20616a376 tempest-VolumeDependencyTests-217794804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f91478bc-b8c6-4713-818d-5e1d15d72f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:58 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3216104a-02d3-4978-b58b-c7b20616a376 tempest-VolumeDependencyTests-217794804 None] Flow 'volume_create_manager' (8df28606-23bb-4487-9d55-d7f01aaab25a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:58:58 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-3216104a-02d3-4978-b58b-c7b20616a376 tempest-VolumeDependencyTests-217794804 None] Created volume successfully. Sep 04 22:58:58 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e425a621-4285-4964-abd4-e387492326c5 tempest-CreateVolumesFromSnapshotTest-298673937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c98f50e7-ddc0-4522-b6a4-e8d46a34e37e" returned: 0 in 0.464s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e425a621-4285-4964-abd4-e387492326c5 tempest-CreateVolumesFromSnapshotTest-298673937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c98f50e7-ddc0-4522-b6a4-e8d46a34e37e {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:58 devstack sudo[106976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c98f50e7-ddc0-4522-b6a4-e8d46a34e37e Sep 04 22:58:58 devstack sudo[106976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-c46cd996-a7ea-43d9-9b52-08224ea30355 tempest-VolumeDependencyTests-217794804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:58:58 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-9a7bdec2-2c70-41ac-952d-f45d5e68fc43 tempest-ProjectReaderTests-144208897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d1961ace-c544-489a-b6d0-cc124985b3a3 1073741824" returned: 0 in 0.599s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-9a7bdec2-2c70-41ac-952d-f45d5e68fc43 tempest-ProjectReaderTests-144208897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d1961ace-c544-489a-b6d0-cc124985b3a3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:58 devstack sudo[106979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d1961ace-c544-489a-b6d0-cc124985b3a3 Sep 04 22:58:58 devstack sudo[106979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:58 devstack sudo[106976]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e425a621-4285-4964-abd4-e387492326c5 tempest-CreateVolumesFromSnapshotTest-298673937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c98f50e7-ddc0-4522-b6a4-e8d46a34e37e" returned: 0 in 0.319s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:58 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-e425a621-4285-4964-abd4-e387492326c5 tempest-CreateVolumesFromSnapshotTest-298673937 None] Lock "cinder-quobyte-c98f50e7-ddc0-4522-b6a4-e8d46a34e37e" released by "delete_volume" :: held 0.829s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:58:58 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-e425a621-4285-4964-abd4-e387492326c5 tempest-CreateVolumesFromSnapshotTest-298673937 None] Created reservations ['fd4812f0-48d6-4d6d-ad40-a39bc0cc3cc3', '48458c05-cb3d-460f-a222-fdb6db1af9e6', '5cf0dfb0-c53a-4e5a-94bb-80017a57a8f3', '0856a08c-2815-4795-a562-73985f412718'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:58:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-e425a621-4285-4964-abd4-e387492326c5 tempest-CreateVolumesFromSnapshotTest-298673937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:58:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-e425a621-4285-4964-abd4-e387492326c5 tempest-CreateVolumesFromSnapshotTest-298673937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:58:58 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-e425a621-4285-4964-abd4-e387492326c5 tempest-CreateVolumesFromSnapshotTest-298673937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:58:58 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-e425a621-4285-4964-abd4-e387492326c5 tempest-CreateVolumesFromSnapshotTest-298673937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:58:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-e425a621-4285-4964-abd4-e387492326c5 tempest-CreateVolumesFromSnapshotTest-298673937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:58:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e425a621-4285-4964-abd4-e387492326c5 tempest-CreateVolumesFromSnapshotTest-298673937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:58 devstack sudo[106982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:58:58 devstack sudo[106982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:58 devstack sudo[106979]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-9a7bdec2-2c70-41ac-952d-f45d5e68fc43 tempest-ProjectReaderTests-144208897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d1961ace-c544-489a-b6d0-cc124985b3a3" returned: 0 in 0.302s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:58 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-9a7bdec2-2c70-41ac-952d-f45d5e68fc43 tempest-ProjectReaderTests-144208897 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:58:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-9a7bdec2-2c70-41ac-952d-f45d5e68fc43 tempest-ProjectReaderTests-144208897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:58:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-c46cd996-a7ea-43d9-9b52-08224ea30355 tempest-VolumeDependencyTests-217794804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.450s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:58:59 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9a7bdec2-2c70-41ac-952d-f45d5e68fc43 tempest-ProjectReaderTests-144208897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3c990c7-baa6-4460-bfa0-5c6982d1ce89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1961ace-c544-489a-b6d0-cc124985b3a3', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:59 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9a7bdec2-2c70-41ac-952d-f45d5e68fc43 tempest-ProjectReaderTests-144208897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55a948eb-5812-4e68-ac4d-6a26e1bdc8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:58:59 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-01cc6561-7eac-4aed-a28c-1d78053bdc2e tempest-CreateVolumesFromSnapshotTest-298673937 None] Acquiring lock "cinder-eb27191b-a675-494c-baa4-244fe1f61a92-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:58:59 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-c46cd996-a7ea-43d9-9b52-08224ea30355 tempest-VolumeDependencyTests-217794804 None] Creating offline snapshot f61e7976-0d53-4fce-8dfb-6a3225a73679 of volume 94642597-f21c-480d-85ff-29d708879b6f {{(pid=87576) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 22:58:59 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-9a7bdec2-2c70-41ac-952d-f45d5e68fc43 tempest-ProjectReaderTests-144208897 None] Volume volume-d1961ace-c544-489a-b6d0-cc124985b3a3 (d1961ace-c544-489a-b6d0-cc124985b3a3): created successfully Sep 04 22:58:59 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9a7bdec2-2c70-41ac-952d-f45d5e68fc43 tempest-ProjectReaderTests-144208897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55a948eb-5812-4e68-ac4d-6a26e1bdc8ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:58:59 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9a7bdec2-2c70-41ac-952d-f45d5e68fc43 tempest-ProjectReaderTests-144208897 None] Flow 'volume_create_manager' (e58309a0-2875-4827-a079-f53d9775b5eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:58:59 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93f7893-2400-41b6-a5b7-76a990d01c8f]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:58:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c46cd996-a7ea-43d9-9b52-08224ea30355 tempest-VolumeDependencyTests-217794804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94642597-f21c-480d-85ff-29d708879b6f {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:59 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-01cc6561-7eac-4aed-a28c-1d78053bdc2e tempest-CreateVolumesFromSnapshotTest-298673937 None] Lock "cinder-eb27191b-a675-494c-baa4-244fe1f61a92-delete_volume" acquired by "delete_volume" :: waited 0.103s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:58:59 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-9a7bdec2-2c70-41ac-952d-f45d5e68fc43 tempest-ProjectReaderTests-144208897 None] Created volume successfully. Sep 04 22:58:59 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-01cc6561-7eac-4aed-a28c-1d78053bdc2e tempest-CreateVolumesFromSnapshotTest-298673937 None] Acquiring lock "cinder-quobyte-eb27191b-a675-494c-baa4-244fe1f61a92" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:58:59 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-01cc6561-7eac-4aed-a28c-1d78053bdc2e tempest-CreateVolumesFromSnapshotTest-298673937 None] Lock "cinder-quobyte-eb27191b-a675-494c-baa4-244fe1f61a92" acquired by "delete_volume" :: waited 0.021s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:58:59 devstack sudo[106985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94642597-f21c-480d-85ff-29d708879b6f Sep 04 22:58:59 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[243ad1db-a999-4466-b1e0-1b526fcb8961]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:58:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-01cc6561-7eac-4aed-a28c-1d78053bdc2e tempest-CreateVolumesFromSnapshotTest-298673937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-eb27191b-a675-494c-baa4-244fe1f61a92 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:59 devstack sudo[106985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:59 devstack sudo[106982]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e425a621-4285-4964-abd4-e387492326c5 tempest-CreateVolumesFromSnapshotTest-298673937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.361s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:59 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-e425a621-4285-4964-abd4-e387492326c5 tempest-CreateVolumesFromSnapshotTest-298673937 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:58:59 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-e425a621-4285-4964-abd4-e387492326c5 tempest-CreateVolumesFromSnapshotTest-298673937 None] Deleted volume successfully. Sep 04 22:58:59 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-e425a621-4285-4964-abd4-e387492326c5 tempest-CreateVolumesFromSnapshotTest-298673937 None] Lock "cinder-c98f50e7-ddc0-4522-b6a4-e8d46a34e37e-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:58:59 devstack sudo[106988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-eb27191b-a675-494c-baa4-244fe1f61a92 Sep 04 22:58:59 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:59 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-1c16cffa-3d59-4de3-9c61-956be9c4773a tempest-ProjectReaderTests-144208897 None] Acquiring lock "cinder-d1961ace-c544-489a-b6d0-cc124985b3a3-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:58:59 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-1c16cffa-3d59-4de3-9c61-956be9c4773a tempest-ProjectReaderTests-144208897 None] Lock "cinder-d1961ace-c544-489a-b6d0-cc124985b3a3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:58:59 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-1c16cffa-3d59-4de3-9c61-956be9c4773a tempest-ProjectReaderTests-144208897 None] Acquiring lock "cinder-quobyte-d1961ace-c544-489a-b6d0-cc124985b3a3" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:58:59 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-1c16cffa-3d59-4de3-9c61-956be9c4773a tempest-ProjectReaderTests-144208897 None] Lock "cinder-quobyte-d1961ace-c544-489a-b6d0-cc124985b3a3" acquired by "delete_volume" :: waited 0.035s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:58:59 devstack sudo[106985]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c46cd996-a7ea-43d9-9b52-08224ea30355 tempest-VolumeDependencyTests-217794804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94642597-f21c-480d-85ff-29d708879b6f" returned: 0 in 0.559s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c46cd996-a7ea-43d9-9b52-08224ea30355 tempest-VolumeDependencyTests-217794804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94642597-f21c-480d-85ff-29d708879b6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94642597-f21c-480d-85ff-29d708879b6f.f61e7976-0d53-4fce-8dfb-6a3225a73679 1G {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:59 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa3f0ea-bca8-4782-ac99-0762d6f9e0ae]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:58:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-1c16cffa-3d59-4de3-9c61-956be9c4773a tempest-ProjectReaderTests-144208897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d1961ace-c544-489a-b6d0-cc124985b3a3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:59 devstack sudo[106995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94642597-f21c-480d-85ff-29d708879b6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94642597-f21c-480d-85ff-29d708879b6f.f61e7976-0d53-4fce-8dfb-6a3225a73679 1G Sep 04 22:58:59 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:59 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root Sep 04 22:58:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-01cc6561-7eac-4aed-a28c-1d78053bdc2e tempest-CreateVolumesFromSnapshotTest-298673937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-eb27191b-a675-494c-baa4-244fe1f61a92" returned: 0 in 0.537s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:58:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-01cc6561-7eac-4aed-a28c-1d78053bdc2e tempest-CreateVolumesFromSnapshotTest-298673937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-eb27191b-a675-494c-baa4-244fe1f61a92 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:58:59 devstack sudo[106997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d1961ace-c544-489a-b6d0-cc124985b3a3 Sep 04 22:58:59 devstack sudo[106997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:58:59 devstack sudo[107000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-eb27191b-a675-494c-baa4-244fe1f61a92 Sep 04 22:58:59 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:00 devstack sudo[106997]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-1c16cffa-3d59-4de3-9c61-956be9c4773a tempest-ProjectReaderTests-144208897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d1961ace-c544-489a-b6d0-cc124985b3a3" returned: 0 in 0.430s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-1c16cffa-3d59-4de3-9c61-956be9c4773a tempest-ProjectReaderTests-144208897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d1961ace-c544-489a-b6d0-cc124985b3a3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:00 devstack sudo[107011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d1961ace-c544-489a-b6d0-cc124985b3a3 Sep 04 22:59:00 devstack sudo[107011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:00 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-01cc6561-7eac-4aed-a28c-1d78053bdc2e tempest-CreateVolumesFromSnapshotTest-298673937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-eb27191b-a675-494c-baa4-244fe1f61a92" returned: 0 in 0.375s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:00 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-01cc6561-7eac-4aed-a28c-1d78053bdc2e tempest-CreateVolumesFromSnapshotTest-298673937 None] Lock "cinder-quobyte-eb27191b-a675-494c-baa4-244fe1f61a92" released by "delete_volume" :: held 0.996s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:59:00 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-6af2f63c-12cf-4283-b8b9-169cb9de9ff3 tempest-ProjectMemberTests-1763329861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:59:00 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:00 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6af2f63c-12cf-4283-b8b9-169cb9de9ff3 tempest-ProjectMemberTests-1763329861 None] Flow 'volume_create_manager' (18569701-b41c-47ee-878c-1a2c246dbe33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:59:00 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6af2f63c-12cf-4283-b8b9-169cb9de9ff3 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a05e2b34-8144-4ac3-a5a2-155a1e60e221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c46cd996-a7ea-43d9-9b52-08224ea30355 tempest-VolumeDependencyTests-217794804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94642597-f21c-480d-85ff-29d708879b6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94642597-f21c-480d-85ff-29d708879b6f.f61e7976-0d53-4fce-8dfb-6a3225a73679 1G" returned: 0 in 0.611s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c46cd996-a7ea-43d9-9b52-08224ea30355 tempest-VolumeDependencyTests-217794804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94642597-f21c-480d-85ff-29d708879b6f -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94642597-f21c-480d-85ff-29d708879b6f.f61e7976-0d53-4fce-8dfb-6a3225a73679 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:00 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6af2f63c-12cf-4283-b8b9-169cb9de9ff3 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a05e2b34-8144-4ac3-a5a2-155a1e60e221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:59:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-173330024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=683726c4-871c-47f5-9618-cdec0c89a171,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea67d0db23b2432187cdb39da7ed0530',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:59:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:59:00Z,use_quota=True,user_id='f2beadaff952455f8e8d8ab5cdc33aa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:00 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6af2f63c-12cf-4283-b8b9-169cb9de9ff3 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f8f1290-0b77-46e6-a875-971dc1d25f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:00 devstack sudo[107013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94642597-f21c-480d-85ff-29d708879b6f -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94642597-f21c-480d-85ff-29d708879b6f.f61e7976-0d53-4fce-8dfb-6a3225a73679 Sep 04 22:59:00 devstack sudo[107013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:00 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6af2f63c-12cf-4283-b8b9-169cb9de9ff3 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f8f1290-0b77-46e6-a875-971dc1d25f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:00 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6af2f63c-12cf-4283-b8b9-169cb9de9ff3 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3563c0ee-1e08-402e-8be1-6b4779e6f0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:00 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6af2f63c-12cf-4283-b8b9-169cb9de9ff3 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3563c0ee-1e08-402e-8be1-6b4779e6f0b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '683726c4-871c-47f5-9618-cdec0c89a171', 'volume_name': 'volume-683726c4-871c-47f5-9618-cdec0c89a171', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:00 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6af2f63c-12cf-4283-b8b9-169cb9de9ff3 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6a123b3-b5b7-4ac2-82b3-f2047d20d655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:00 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6af2f63c-12cf-4283-b8b9-169cb9de9ff3 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6a123b3-b5b7-4ac2-82b3-f2047d20d655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:00 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6af2f63c-12cf-4283-b8b9-169cb9de9ff3 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ad572e3-d224-4342-8c70-321a441e0f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:00 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-6af2f63c-12cf-4283-b8b9-169cb9de9ff3 tempest-ProjectMemberTests-1763329861 None] Volume 683726c4-871c-47f5-9618-cdec0c89a171: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-683726c4-871c-47f5-9618-cdec0c89a171', 'volume_size': 1} Sep 04 22:59:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-6af2f63c-12cf-4283-b8b9-169cb9de9ff3 tempest-ProjectMemberTests-1763329861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:59:00 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-01cc6561-7eac-4aed-a28c-1d78053bdc2e tempest-CreateVolumesFromSnapshotTest-298673937 None] Created reservations ['1d575a14-3ab8-41aa-9582-d192de510d5a', '6ac4597e-c350-4d0b-9037-15071c171749', 'ede834e0-bd6b-41ac-b283-e4156ef92e4d', 'ca10c842-32fc-4833-806d-3f785e99cff9'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:59:00 devstack sudo[107011]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-1c16cffa-3d59-4de3-9c61-956be9c4773a tempest-ProjectReaderTests-144208897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d1961ace-c544-489a-b6d0-cc124985b3a3" returned: 0 in 0.309s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:00 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-1c16cffa-3d59-4de3-9c61-956be9c4773a tempest-ProjectReaderTests-144208897 None] Lock "cinder-quobyte-d1961ace-c544-489a-b6d0-cc124985b3a3" released by "delete_volume" :: held 0.803s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:59:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-01cc6561-7eac-4aed-a28c-1d78053bdc2e tempest-CreateVolumesFromSnapshotTest-298673937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:59:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-01cc6561-7eac-4aed-a28c-1d78053bdc2e tempest-CreateVolumesFromSnapshotTest-298673937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:59:00 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-01cc6561-7eac-4aed-a28c-1d78053bdc2e tempest-CreateVolumesFromSnapshotTest-298673937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:59:00 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-01cc6561-7eac-4aed-a28c-1d78053bdc2e tempest-CreateVolumesFromSnapshotTest-298673937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:59:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-01cc6561-7eac-4aed-a28c-1d78053bdc2e tempest-CreateVolumesFromSnapshotTest-298673937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:59:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-01cc6561-7eac-4aed-a28c-1d78053bdc2e tempest-CreateVolumesFromSnapshotTest-298673937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:00 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-1c16cffa-3d59-4de3-9c61-956be9c4773a tempest-ProjectReaderTests-144208897 None] Created reservations ['bc8a8b36-eae9-4c4d-baf0-89576033a14f', '9421e0d4-d893-4aef-b082-c4277e80f93a', 'e41784bf-f955-481c-b49a-8ab0b7bb68d3', 'c6f9963b-6f09-4c17-975e-1e73b005786e'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:59:00 devstack sudo[107016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:59:00 devstack sudo[107016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-1c16cffa-3d59-4de3-9c61-956be9c4773a tempest-ProjectReaderTests-144208897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:59:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-1c16cffa-3d59-4de3-9c61-956be9c4773a tempest-ProjectReaderTests-144208897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:59:00 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-1c16cffa-3d59-4de3-9c61-956be9c4773a tempest-ProjectReaderTests-144208897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:59:00 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-1c16cffa-3d59-4de3-9c61-956be9c4773a tempest-ProjectReaderTests-144208897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:59:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-1c16cffa-3d59-4de3-9c61-956be9c4773a tempest-ProjectReaderTests-144208897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:59:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-1c16cffa-3d59-4de3-9c61-956be9c4773a tempest-ProjectReaderTests-144208897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:00 devstack sudo[107013]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c46cd996-a7ea-43d9-9b52-08224ea30355 tempest-VolumeDependencyTests-217794804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94642597-f21c-480d-85ff-29d708879b6f -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94642597-f21c-480d-85ff-29d708879b6f.f61e7976-0d53-4fce-8dfb-6a3225a73679" returned: 0 in 0.349s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:00 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-c46cd996-a7ea-43d9-9b52-08224ea30355 tempest-VolumeDependencyTests-217794804 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94642597-f21c-480d-85ff-29d708879b6f.f61e7976-0d53-4fce-8dfb-6a3225a73679 is being set with open permissions: ugo+rw Sep 04 22:59:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c46cd996-a7ea-43d9-9b52-08224ea30355 tempest-VolumeDependencyTests-217794804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94642597-f21c-480d-85ff-29d708879b6f.f61e7976-0d53-4fce-8dfb-6a3225a73679 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:00 devstack sudo[107021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:59:00 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:00 devstack sudo[107023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94642597-f21c-480d-85ff-29d708879b6f.f61e7976-0d53-4fce-8dfb-6a3225a73679 Sep 04 22:59:00 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:00 devstack sudo[107016]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-01cc6561-7eac-4aed-a28c-1d78053bdc2e tempest-CreateVolumesFromSnapshotTest-298673937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.267s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:00 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-01cc6561-7eac-4aed-a28c-1d78053bdc2e tempest-CreateVolumesFromSnapshotTest-298673937 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:59:00 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-01cc6561-7eac-4aed-a28c-1d78053bdc2e tempest-CreateVolumesFromSnapshotTest-298673937 None] Deleted volume successfully. Sep 04 22:59:00 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-01cc6561-7eac-4aed-a28c-1d78053bdc2e tempest-CreateVolumesFromSnapshotTest-298673937 None] Lock "cinder-eb27191b-a675-494c-baa4-244fe1f61a92-delete_volume" released by "delete_volume" :: held 1.696s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:59:00 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-1c16cffa-3d59-4de3-9c61-956be9c4773a tempest-ProjectReaderTests-144208897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.295s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:00 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-1c16cffa-3d59-4de3-9c61-956be9c4773a tempest-ProjectReaderTests-144208897 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:59:00 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-1c16cffa-3d59-4de3-9c61-956be9c4773a tempest-ProjectReaderTests-144208897 None] Deleted volume successfully. Sep 04 22:59:00 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c46cd996-a7ea-43d9-9b52-08224ea30355 tempest-VolumeDependencyTests-217794804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94642597-f21c-480d-85ff-29d708879b6f.f61e7976-0d53-4fce-8dfb-6a3225a73679" returned: 0 in 0.292s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:00 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-1c16cffa-3d59-4de3-9c61-956be9c4773a tempest-ProjectReaderTests-144208897 None] Lock "cinder-d1961ace-c544-489a-b6d0-cc124985b3a3-delete_volume" released by "delete_volume" :: held 1.385s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:59:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c46cd996-a7ea-43d9-9b52-08224ea30355 tempest-VolumeDependencyTests-217794804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94642597-f21c-480d-85ff-29d708879b6f.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:00 devstack sudo[107028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94642597-f21c-480d-85ff-29d708879b6f.info Sep 04 22:59:00 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:01 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c46cd996-a7ea-43d9-9b52-08224ea30355 tempest-VolumeDependencyTests-217794804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94642597-f21c-480d-85ff-29d708879b6f.info" returned: 0 in 0.305s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:01 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-c46cd996-a7ea-43d9-9b52-08224ea30355 tempest-VolumeDependencyTests-217794804 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94642597-f21c-480d-85ff-29d708879b6f.info is being set with open permissions: ugo+rw Sep 04 22:59:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c46cd996-a7ea-43d9-9b52-08224ea30355 tempest-VolumeDependencyTests-217794804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94642597-f21c-480d-85ff-29d708879b6f.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:01 devstack sudo[107031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94642597-f21c-480d-85ff-29d708879b6f.info Sep 04 22:59:01 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:01 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f9d3870-2126-4d76-8601-15929c19f6a2 tempest-ProjectReaderTests-144208897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:59:01 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9f9d3870-2126-4d76-8601-15929c19f6a2 tempest-ProjectReaderTests-144208897 None] Flow 'volume_create_manager' (7d3bd384-b998-4882-b005-1ef00caf49be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:59:01 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9f9d3870-2126-4d76-8601-15929c19f6a2 tempest-ProjectReaderTests-144208897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b543d573-7dcd-406d-88d0-590d609cce05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:01 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-0748f5c5-926a-480f-8db3-347e9628a1bd tempest-CreateVolumesFromSnapshotTest-298673937 None] Acquiring lock "cinder-68d841eb-05eb-4869-a346-1d295d4f2cff-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:59:01 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9f9d3870-2126-4d76-8601-15929c19f6a2 tempest-ProjectReaderTests-144208897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b543d573-7dcd-406d-88d0-590d609cce05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:59:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-824057745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c2abfa7-2e7d-4771-bf55-760c275ac1c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63e43a45529e4d3cbc3f4c88d615f0db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:59:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:59:01Z,use_quota=True,user_id='5bbdd8019f1644f99a01e156b80c6dbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:01 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9f9d3870-2126-4d76-8601-15929c19f6a2 tempest-ProjectReaderTests-144208897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57b67c85-71a4-4ac6-9d5c-1358bb28f145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:01 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9f9d3870-2126-4d76-8601-15929c19f6a2 tempest-ProjectReaderTests-144208897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57b67c85-71a4-4ac6-9d5c-1358bb28f145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:01 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9f9d3870-2126-4d76-8601-15929c19f6a2 tempest-ProjectReaderTests-144208897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67963067-f493-4dc3-9f24-d0c55874e6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:01 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9f9d3870-2126-4d76-8601-15929c19f6a2 tempest-ProjectReaderTests-144208897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67963067-f493-4dc3-9f24-d0c55874e6cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c2abfa7-2e7d-4771-bf55-760c275ac1c6', 'volume_name': 'volume-8c2abfa7-2e7d-4771-bf55-760c275ac1c6', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:01 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9f9d3870-2126-4d76-8601-15929c19f6a2 tempest-ProjectReaderTests-144208897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84658b1c-cd19-4f9b-b31d-2d3aa54da7a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:01 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9f9d3870-2126-4d76-8601-15929c19f6a2 tempest-ProjectReaderTests-144208897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84658b1c-cd19-4f9b-b31d-2d3aa54da7a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:01 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9f9d3870-2126-4d76-8601-15929c19f6a2 tempest-ProjectReaderTests-144208897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be61e933-2f5b-43d8-8375-81b480a21c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:01 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-9f9d3870-2126-4d76-8601-15929c19f6a2 tempest-ProjectReaderTests-144208897 None] Volume 8c2abfa7-2e7d-4771-bf55-760c275ac1c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c2abfa7-2e7d-4771-bf55-760c275ac1c6', 'volume_size': 1} Sep 04 22:59:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-9f9d3870-2126-4d76-8601-15929c19f6a2 tempest-ProjectReaderTests-144208897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:59:01 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-0748f5c5-926a-480f-8db3-347e9628a1bd tempest-CreateVolumesFromSnapshotTest-298673937 None] Lock "cinder-68d841eb-05eb-4869-a346-1d295d4f2cff-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:59:01 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-0748f5c5-926a-480f-8db3-347e9628a1bd tempest-CreateVolumesFromSnapshotTest-298673937 None] Acquiring lock "cinder-quobyte-68d841eb-05eb-4869-a346-1d295d4f2cff" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:59:01 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-0748f5c5-926a-480f-8db3-347e9628a1bd tempest-CreateVolumesFromSnapshotTest-298673937 None] Lock "cinder-quobyte-68d841eb-05eb-4869-a346-1d295d4f2cff" acquired by "delete_volume" :: waited 0.011s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:59:01 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[26fa8d58-4e68-4568-bca9-c1f7367f42e1]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:59:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0748f5c5-926a-480f-8db3-347e9628a1bd tempest-CreateVolumesFromSnapshotTest-298673937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-68d841eb-05eb-4869-a346-1d295d4f2cff {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:01 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c46cd996-a7ea-43d9-9b52-08224ea30355 tempest-VolumeDependencyTests-217794804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94642597-f21c-480d-85ff-29d708879b6f.info" returned: 0 in 0.292s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-c46cd996-a7ea-43d9-9b52-08224ea30355 tempest-VolumeDependencyTests-217794804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.575s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:59:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-6af2f63c-12cf-4283-b8b9-169cb9de9ff3 tempest-ProjectMemberTests-1763329861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.230s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:59:01 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-6af2f63c-12cf-4283-b8b9-169cb9de9ff3 tempest-ProjectMemberTests-1763329861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:59:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-173330024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=683726c4-871c-47f5-9618-cdec0c89a171,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea67d0db23b2432187cdb39da7ed0530',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:59:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:59:00Z,use_quota=True,user_id='f2beadaff952455f8e8d8ab5cdc33aa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:59:01 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-6af2f63c-12cf-4283-b8b9-169cb9de9ff3 tempest-ProjectMemberTests-1763329861 None] Creating volume 683726c4-871c-47f5-9618-cdec0c89a171 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:59:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-6af2f63c-12cf-4283-b8b9-169cb9de9ff3 tempest-ProjectMemberTests-1763329861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:59:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-6af2f63c-12cf-4283-b8b9-169cb9de9ff3 tempest-ProjectMemberTests-1763329861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:59:01 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-6af2f63c-12cf-4283-b8b9-169cb9de9ff3 tempest-ProjectMemberTests-1763329861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:59:01 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-6af2f63c-12cf-4283-b8b9-169cb9de9ff3 tempest-ProjectMemberTests-1763329861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:59:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-6af2f63c-12cf-4283-b8b9-169cb9de9ff3 tempest-ProjectMemberTests-1763329861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:59:01 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-6af2f63c-12cf-4283-b8b9-169cb9de9ff3 tempest-ProjectMemberTests-1763329861 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:59:01 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-6af2f63c-12cf-4283-b8b9-169cb9de9ff3 tempest-ProjectMemberTests-1763329861 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:59:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-6af2f63c-12cf-4283-b8b9-169cb9de9ff3 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-683726c4-871c-47f5-9618-cdec0c89a171 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:01 devstack sudo[107033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-68d841eb-05eb-4869-a346-1d295d4f2cff Sep 04 22:59:01 devstack sudo[107033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:01 devstack sudo[107035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-683726c4-871c-47f5-9618-cdec0c89a171 1073741824 Sep 04 22:59:01 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:01 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-c46cd996-a7ea-43d9-9b52-08224ea30355 tempest-VolumeDependencyTests-217794804 None] Create snapshot completed successfully Sep 04 22:59:01 devstack sudo[107033]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0748f5c5-926a-480f-8db3-347e9628a1bd tempest-CreateVolumesFromSnapshotTest-298673937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-68d841eb-05eb-4869-a346-1d295d4f2cff" returned: 0 in 0.379s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0748f5c5-926a-480f-8db3-347e9628a1bd tempest-CreateVolumesFromSnapshotTest-298673937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-68d841eb-05eb-4869-a346-1d295d4f2cff {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:01 devstack sudo[107044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-68d841eb-05eb-4869-a346-1d295d4f2cff Sep 04 22:59:01 devstack sudo[107044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:02 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:02 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-6af2f63c-12cf-4283-b8b9-169cb9de9ff3 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-683726c4-871c-47f5-9618-cdec0c89a171 1073741824" returned: 0 in 0.469s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:02 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-6af2f63c-12cf-4283-b8b9-169cb9de9ff3 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-683726c4-871c-47f5-9618-cdec0c89a171 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:02 devstack sudo[107048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-683726c4-871c-47f5-9618-cdec0c89a171 Sep 04 22:59:02 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:02 devstack sudo[107044]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:02 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0748f5c5-926a-480f-8db3-347e9628a1bd tempest-CreateVolumesFromSnapshotTest-298673937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-68d841eb-05eb-4869-a346-1d295d4f2cff" returned: 0 in 0.291s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:02 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-0748f5c5-926a-480f-8db3-347e9628a1bd tempest-CreateVolumesFromSnapshotTest-298673937 None] Lock "cinder-quobyte-68d841eb-05eb-4869-a346-1d295d4f2cff" released by "delete_volume" :: held 0.716s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:59:02 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-0748f5c5-926a-480f-8db3-347e9628a1bd tempest-CreateVolumesFromSnapshotTest-298673937 None] Created reservations ['51ab6725-1610-4643-908c-5ad6c5d9099a', '9daf070b-79c9-4b92-9f6c-c62ee2bdb8d0', '922a391d-a0de-4403-801a-d8b694563650', '2e9db497-db3f-403b-b44e-e170c61eec84'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:59:02 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-0748f5c5-926a-480f-8db3-347e9628a1bd tempest-CreateVolumesFromSnapshotTest-298673937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:59:02 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-0748f5c5-926a-480f-8db3-347e9628a1bd tempest-CreateVolumesFromSnapshotTest-298673937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:59:02 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-0748f5c5-926a-480f-8db3-347e9628a1bd tempest-CreateVolumesFromSnapshotTest-298673937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:59:02 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-0748f5c5-926a-480f-8db3-347e9628a1bd tempest-CreateVolumesFromSnapshotTest-298673937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:59:02 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-0748f5c5-926a-480f-8db3-347e9628a1bd tempest-CreateVolumesFromSnapshotTest-298673937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:59:02 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0748f5c5-926a-480f-8db3-347e9628a1bd tempest-CreateVolumesFromSnapshotTest-298673937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:02 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:02 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-6af2f63c-12cf-4283-b8b9-169cb9de9ff3 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-683726c4-871c-47f5-9618-cdec0c89a171" returned: 0 in 0.326s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:02 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-6af2f63c-12cf-4283-b8b9-169cb9de9ff3 tempest-ProjectMemberTests-1763329861 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:59:02 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-6af2f63c-12cf-4283-b8b9-169cb9de9ff3 tempest-ProjectMemberTests-1763329861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:59:02 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-9f9d3870-2126-4d76-8601-15929c19f6a2 tempest-ProjectReaderTests-144208897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.009s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:59:02 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-9f9d3870-2126-4d76-8601-15929c19f6a2 tempest-ProjectReaderTests-144208897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:59:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-824057745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c2abfa7-2e7d-4771-bf55-760c275ac1c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63e43a45529e4d3cbc3f4c88d615f0db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:59:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:59:01Z,use_quota=True,user_id='5bbdd8019f1644f99a01e156b80c6dbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:59:02 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-9f9d3870-2126-4d76-8601-15929c19f6a2 tempest-ProjectReaderTests-144208897 None] Creating volume 8c2abfa7-2e7d-4771-bf55-760c275ac1c6 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:59:02 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-9f9d3870-2126-4d76-8601-15929c19f6a2 tempest-ProjectReaderTests-144208897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:59:02 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-9f9d3870-2126-4d76-8601-15929c19f6a2 tempest-ProjectReaderTests-144208897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:59:02 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-9f9d3870-2126-4d76-8601-15929c19f6a2 tempest-ProjectReaderTests-144208897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:59:02 devstack sudo[107051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:59:02 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:02 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-9f9d3870-2126-4d76-8601-15929c19f6a2 tempest-ProjectReaderTests-144208897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:59:02 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-9f9d3870-2126-4d76-8601-15929c19f6a2 tempest-ProjectReaderTests-144208897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:59:02 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-9f9d3870-2126-4d76-8601-15929c19f6a2 tempest-ProjectReaderTests-144208897 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:59:02 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-9f9d3870-2126-4d76-8601-15929c19f6a2 tempest-ProjectReaderTests-144208897 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:59:02 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-9f9d3870-2126-4d76-8601-15929c19f6a2 tempest-ProjectReaderTests-144208897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-8c2abfa7-2e7d-4771-bf55-760c275ac1c6 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:02 devstack sudo[107053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-8c2abfa7-2e7d-4771-bf55-760c275ac1c6 1073741824 Sep 04 22:59:02 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:02 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6af2f63c-12cf-4283-b8b9-169cb9de9ff3 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ad572e3-d224-4342-8c70-321a441e0f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-683726c4-871c-47f5-9618-cdec0c89a171', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:02 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6af2f63c-12cf-4283-b8b9-169cb9de9ff3 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f45f453-247b-4e3a-b038-b74ed9f540eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:02 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-6af2f63c-12cf-4283-b8b9-169cb9de9ff3 tempest-ProjectMemberTests-1763329861 None] Volume volume-683726c4-871c-47f5-9618-cdec0c89a171 (683726c4-871c-47f5-9618-cdec0c89a171): created successfully Sep 04 22:59:02 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6af2f63c-12cf-4283-b8b9-169cb9de9ff3 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f45f453-247b-4e3a-b038-b74ed9f540eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:02 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6af2f63c-12cf-4283-b8b9-169cb9de9ff3 tempest-ProjectMemberTests-1763329861 None] Flow 'volume_create_manager' (18569701-b41c-47ee-878c-1a2c246dbe33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:59:02 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-40a93603-e977-4be0-89ad-b4f372f9e018 tempest-CreateVolumesFromSnapshotTest-298673937 None] Acquiring lock "cinder-38de4868-7350-48b1-81e2-667b45a17e4c-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:59:02 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-400010a0-c20b-41f8-9bad-015714a567c5 tempest-VolumeDependencyTests-217794804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:59:02 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-6af2f63c-12cf-4283-b8b9-169cb9de9ff3 tempest-ProjectMemberTests-1763329861 None] Created volume successfully. Sep 04 22:59:02 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-40a93603-e977-4be0-89ad-b4f372f9e018 tempest-CreateVolumesFromSnapshotTest-298673937 None] Lock "cinder-38de4868-7350-48b1-81e2-667b45a17e4c-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:59:02 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-400010a0-c20b-41f8-9bad-015714a567c5 tempest-VolumeDependencyTests-217794804 None] Flow 'volume_create_manager' (474a0965-5df7-4de7-8e61-db1876ec073d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:59:02 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-400010a0-c20b-41f8-9bad-015714a567c5 tempest-VolumeDependencyTests-217794804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1c3d3a6-dce6-4974-a316-57a13cc77a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:02 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-400010a0-c20b-41f8-9bad-015714a567c5 tempest-VolumeDependencyTests-217794804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1c3d3a6-dce6-4974-a316-57a13cc77a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-250411310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c842c2cc-9c95-4a94-b0a8-3acb35ff9435,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='612e70eb0fd74d4e8df3c3ab2c7c819a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f61e7976-0d53-4fce-8dfb-6a3225a73679,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:59:02Z,use_quota=True,user_id='057f24a5b27e47028f9032dfae8586f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:02 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-400010a0-c20b-41f8-9bad-015714a567c5 tempest-VolumeDependencyTests-217794804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8c44df3-0e15-475d-ac7d-58b896358600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:02 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-400010a0-c20b-41f8-9bad-015714a567c5 tempest-VolumeDependencyTests-217794804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8c44df3-0e15-475d-ac7d-58b896358600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:02 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-400010a0-c20b-41f8-9bad-015714a567c5 tempest-VolumeDependencyTests-217794804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (104381d8-3384-4ea0-a124-16e8ab900726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:02 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-400010a0-c20b-41f8-9bad-015714a567c5 tempest-VolumeDependencyTests-217794804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (104381d8-3384-4ea0-a124-16e8ab900726) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c842c2cc-9c95-4a94-b0a8-3acb35ff9435', 'volume_name': 'volume-c842c2cc-9c95-4a94-b0a8-3acb35ff9435', 'volume_size': 1, 'snapshot_id': 'f61e7976-0d53-4fce-8dfb-6a3225a73679'}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:02 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-400010a0-c20b-41f8-9bad-015714a567c5 tempest-VolumeDependencyTests-217794804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8f48947-58c4-47cd-bebb-c76ce9d11b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:02 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-400010a0-c20b-41f8-9bad-015714a567c5 tempest-VolumeDependencyTests-217794804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8f48947-58c4-47cd-bebb-c76ce9d11b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:02 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-400010a0-c20b-41f8-9bad-015714a567c5 tempest-VolumeDependencyTests-217794804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5afb28a-50ef-4642-994e-0474361e054a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:02 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-400010a0-c20b-41f8-9bad-015714a567c5 tempest-VolumeDependencyTests-217794804 None] Volume c842c2cc-9c95-4a94-b0a8-3acb35ff9435: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c842c2cc-9c95-4a94-b0a8-3acb35ff9435', 'volume_size': 1, 'snapshot_id': 'f61e7976-0d53-4fce-8dfb-6a3225a73679'} Sep 04 22:59:02 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:02 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0748f5c5-926a-480f-8db3-347e9628a1bd tempest-CreateVolumesFromSnapshotTest-298673937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.304s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:02 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-0748f5c5-926a-480f-8db3-347e9628a1bd tempest-CreateVolumesFromSnapshotTest-298673937 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:59:02 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-400010a0-c20b-41f8-9bad-015714a567c5 tempest-VolumeDependencyTests-217794804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:59:02 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-0748f5c5-926a-480f-8db3-347e9628a1bd tempest-CreateVolumesFromSnapshotTest-298673937 None] Deleted volume successfully. Sep 04 22:59:02 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-40a93603-e977-4be0-89ad-b4f372f9e018 tempest-CreateVolumesFromSnapshotTest-298673937 None] Acquiring lock "cinder-quobyte-38de4868-7350-48b1-81e2-667b45a17e4c" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:59:02 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-0748f5c5-926a-480f-8db3-347e9628a1bd tempest-CreateVolumesFromSnapshotTest-298673937 None] Lock "cinder-68d841eb-05eb-4869-a346-1d295d4f2cff-delete_volume" released by "delete_volume" :: held 1.324s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:59:02 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-40a93603-e977-4be0-89ad-b4f372f9e018 tempest-CreateVolumesFromSnapshotTest-298673937 None] Lock "cinder-quobyte-38de4868-7350-48b1-81e2-667b45a17e4c" acquired by "delete_volume" :: waited 0.022s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:59:02 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[e371f5d2-a37f-4523-8154-ba45d340b5b2]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:59:02 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-40a93603-e977-4be0-89ad-b4f372f9e018 tempest-CreateVolumesFromSnapshotTest-298673937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-38de4868-7350-48b1-81e2-667b45a17e4c {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:02 devstack sudo[107059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-38de4868-7350-48b1-81e2-667b45a17e4c Sep 04 22:59:02 devstack sudo[107059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:02 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:02 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-9f9d3870-2126-4d76-8601-15929c19f6a2 tempest-ProjectReaderTests-144208897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-8c2abfa7-2e7d-4771-bf55-760c275ac1c6 1073741824" returned: 0 in 0.492s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:02 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-9f9d3870-2126-4d76-8601-15929c19f6a2 tempest-ProjectReaderTests-144208897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-8c2abfa7-2e7d-4771-bf55-760c275ac1c6 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:03 devstack sudo[107062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-8c2abfa7-2e7d-4771-bf55-760c275ac1c6 Sep 04 22:59:03 devstack sudo[107062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:03 devstack sudo[107059]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-40a93603-e977-4be0-89ad-b4f372f9e018 tempest-CreateVolumesFromSnapshotTest-298673937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-38de4868-7350-48b1-81e2-667b45a17e4c" returned: 0 in 0.366s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-40a93603-e977-4be0-89ad-b4f372f9e018 tempest-CreateVolumesFromSnapshotTest-298673937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-38de4868-7350-48b1-81e2-667b45a17e4c {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:03 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-38de4868-7350-48b1-81e2-667b45a17e4c Sep 04 22:59:03 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:03 devstack sudo[107062]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-9f9d3870-2126-4d76-8601-15929c19f6a2 tempest-ProjectReaderTests-144208897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-8c2abfa7-2e7d-4771-bf55-760c275ac1c6" returned: 0 in 0.259s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:03 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-9f9d3870-2126-4d76-8601-15929c19f6a2 tempest-ProjectReaderTests-144208897 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:59:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-9f9d3870-2126-4d76-8601-15929c19f6a2 tempest-ProjectReaderTests-144208897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:59:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-400010a0-c20b-41f8-9bad-015714a567c5 tempest-VolumeDependencyTests-217794804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.529s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:59:03 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-400010a0-c20b-41f8-9bad-015714a567c5 tempest-VolumeDependencyTests-217794804 None] Acquiring lock "cinder-quobyte-f61e7976-0d53-4fce-8dfb-6a3225a73679-c842c2cc-9c95-4a94-b0a8-3acb35ff9435" by "_create_volume_from_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:59:03 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9f9d3870-2126-4d76-8601-15929c19f6a2 tempest-ProjectReaderTests-144208897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be61e933-2f5b-43d8-8375-81b480a21c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c2abfa7-2e7d-4771-bf55-760c275ac1c6', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:03 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9f9d3870-2126-4d76-8601-15929c19f6a2 tempest-ProjectReaderTests-144208897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eedec5eb-490b-4d24-8efe-49e59d1ad94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:03 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-400010a0-c20b-41f8-9bad-015714a567c5 tempest-VolumeDependencyTests-217794804 None] Lock "cinder-quobyte-f61e7976-0d53-4fce-8dfb-6a3225a73679-c842c2cc-9c95-4a94-b0a8-3acb35ff9435" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:59:03 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-400010a0-c20b-41f8-9bad-015714a567c5 tempest-VolumeDependencyTests-217794804 None] Creating volume c842c2cc-9c95-4a94-b0a8-3acb35ff9435 from snapshot f61e7976-0d53-4fce-8dfb-6a3225a73679 {{(pid=87576) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 04 22:59:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-400010a0-c20b-41f8-9bad-015714a567c5 tempest-VolumeDependencyTests-217794804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:59:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-400010a0-c20b-41f8-9bad-015714a567c5 tempest-VolumeDependencyTests-217794804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:59:03 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-400010a0-c20b-41f8-9bad-015714a567c5 tempest-VolumeDependencyTests-217794804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:59:03 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-400010a0-c20b-41f8-9bad-015714a567c5 tempest-VolumeDependencyTests-217794804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:59:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-400010a0-c20b-41f8-9bad-015714a567c5 tempest-VolumeDependencyTests-217794804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:59:03 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-400010a0-c20b-41f8-9bad-015714a567c5 tempest-VolumeDependencyTests-217794804 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:59:03 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-400010a0-c20b-41f8-9bad-015714a567c5 tempest-VolumeDependencyTests-217794804 None] Acquiring lock "cinder-quobyte-c842c2cc-9c95-4a94-b0a8-3acb35ff9435" by "_copy_volume_from_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:59:03 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-9f9d3870-2126-4d76-8601-15929c19f6a2 tempest-ProjectReaderTests-144208897 None] Volume volume-8c2abfa7-2e7d-4771-bf55-760c275ac1c6 (8c2abfa7-2e7d-4771-bf55-760c275ac1c6): created successfully Sep 04 22:59:03 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9f9d3870-2126-4d76-8601-15929c19f6a2 tempest-ProjectReaderTests-144208897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eedec5eb-490b-4d24-8efe-49e59d1ad94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:03 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-9f9d3870-2126-4d76-8601-15929c19f6a2 tempest-ProjectReaderTests-144208897 None] Flow 'volume_create_manager' (7d3bd384-b998-4882-b005-1ef00caf49be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:59:03 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-400010a0-c20b-41f8-9bad-015714a567c5 tempest-VolumeDependencyTests-217794804 None] Lock "cinder-quobyte-c842c2cc-9c95-4a94-b0a8-3acb35ff9435" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:59:03 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-400010a0-c20b-41f8-9bad-015714a567c5 tempest-VolumeDependencyTests-217794804 None] snapshot: f61e7976-0d53-4fce-8dfb-6a3225a73679, volume: c842c2cc-9c95-4a94-b0a8-3acb35ff9435, {{(pid=87576) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 04 22:59:03 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-9f9d3870-2126-4d76-8601-15929c19f6a2 tempest-ProjectReaderTests-144208897 None] Created volume successfully. Sep 04 22:59:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-400010a0-c20b-41f8-9bad-015714a567c5 tempest-VolumeDependencyTests-217794804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:59:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-400010a0-c20b-41f8-9bad-015714a567c5 tempest-VolumeDependencyTests-217794804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:59:03 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-400010a0-c20b-41f8-9bad-015714a567c5 tempest-VolumeDependencyTests-217794804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:59:03 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-400010a0-c20b-41f8-9bad-015714a567c5 tempest-VolumeDependencyTests-217794804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:59:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-400010a0-c20b-41f8-9bad-015714a567c5 tempest-VolumeDependencyTests-217794804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:59:03 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad6ec81-eac8-4537-852f-7798ed3c285d]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:59:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-400010a0-c20b-41f8-9bad-015714a567c5 tempest-VolumeDependencyTests-217794804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94642597-f21c-480d-85ff-29d708879b6f.f61e7976-0d53-4fce-8dfb-6a3225a73679 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:03 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-40a93603-e977-4be0-89ad-b4f372f9e018 tempest-CreateVolumesFromSnapshotTest-298673937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-38de4868-7350-48b1-81e2-667b45a17e4c" returned: 0 in 0.298s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:03 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-40a93603-e977-4be0-89ad-b4f372f9e018 tempest-CreateVolumesFromSnapshotTest-298673937 None] Lock "cinder-quobyte-38de4868-7350-48b1-81e2-667b45a17e4c" released by "delete_volume" :: held 0.717s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:59:03 devstack sudo[107072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94642597-f21c-480d-85ff-29d708879b6f.f61e7976-0d53-4fce-8dfb-6a3225a73679 Sep 04 22:59:03 devstack sudo[107072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:03 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-40a93603-e977-4be0-89ad-b4f372f9e018 tempest-CreateVolumesFromSnapshotTest-298673937 None] Created reservations ['966de2d2-b0ea-4698-95cc-9bea804a006a', 'e68495b5-5d0d-4812-9274-f6db4d25201d', '56e04e08-5daa-47f5-8e3f-4e5a6da1cb93', 'd0a440c8-996e-4f66-ab44-c937c113e851'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:59:03 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-69eea222-3dc5-4528-be66-f18d28fac07d tempest-ProjectReaderTests-144208897 None] Acquiring lock "cinder-8c2abfa7-2e7d-4771-bf55-760c275ac1c6-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:59:03 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-69eea222-3dc5-4528-be66-f18d28fac07d tempest-ProjectReaderTests-144208897 None] Lock "cinder-8c2abfa7-2e7d-4771-bf55-760c275ac1c6-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:59:03 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-69eea222-3dc5-4528-be66-f18d28fac07d tempest-ProjectReaderTests-144208897 None] Acquiring lock "cinder-quobyte-8c2abfa7-2e7d-4771-bf55-760c275ac1c6" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:59:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-40a93603-e977-4be0-89ad-b4f372f9e018 tempest-CreateVolumesFromSnapshotTest-298673937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:59:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-40a93603-e977-4be0-89ad-b4f372f9e018 tempest-CreateVolumesFromSnapshotTest-298673937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:59:03 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-40a93603-e977-4be0-89ad-b4f372f9e018 tempest-CreateVolumesFromSnapshotTest-298673937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:59:03 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-40a93603-e977-4be0-89ad-b4f372f9e018 tempest-CreateVolumesFromSnapshotTest-298673937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:59:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-40a93603-e977-4be0-89ad-b4f372f9e018 tempest-CreateVolumesFromSnapshotTest-298673937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:59:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-40a93603-e977-4be0-89ad-b4f372f9e018 tempest-CreateVolumesFromSnapshotTest-298673937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:03 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-a78823b7-e23e-4b0d-9c0c-e0483aac8845 tempest-CreateVolumesFromSnapshotTest-298673937 None] Acquiring lock "cinder-b67c8389-386b-4932-b1dd-874c96cd0b82-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:59:03 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-69eea222-3dc5-4528-be66-f18d28fac07d tempest-ProjectReaderTests-144208897 None] Lock "cinder-quobyte-8c2abfa7-2e7d-4771-bf55-760c275ac1c6" acquired by "delete_volume" :: waited 0.077s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:59:03 devstack sudo[107074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:59:03 devstack sudo[107074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:03 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-a78823b7-e23e-4b0d-9c0c-e0483aac8845 tempest-CreateVolumesFromSnapshotTest-298673937 None] Lock "cinder-b67c8389-386b-4932-b1dd-874c96cd0b82-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:59:03 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[49dbba0b-3cf4-4835-a85e-841457f4b679]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:59:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-69eea222-3dc5-4528-be66-f18d28fac07d tempest-ProjectReaderTests-144208897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-8c2abfa7-2e7d-4771-bf55-760c275ac1c6 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:03 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-a78823b7-e23e-4b0d-9c0c-e0483aac8845 tempest-CreateVolumesFromSnapshotTest-298673937 None] Acquiring lock "cinder-quobyte-b67c8389-386b-4932-b1dd-874c96cd0b82" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:59:03 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-a78823b7-e23e-4b0d-9c0c-e0483aac8845 tempest-CreateVolumesFromSnapshotTest-298673937 None] Lock "cinder-quobyte-b67c8389-386b-4932-b1dd-874c96cd0b82" acquired by "delete_volume" :: waited 0.037s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:59:03 devstack sudo[107072]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-400010a0-c20b-41f8-9bad-015714a567c5 tempest-VolumeDependencyTests-217794804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94642597-f21c-480d-85ff-29d708879b6f.f61e7976-0d53-4fce-8dfb-6a3225a73679" returned: 0 in 0.554s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:03 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-400010a0-c20b-41f8-9bad-015714a567c5 tempest-VolumeDependencyTests-217794804 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94642597-f21c-480d-85ff-29d708879b6f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 22:59:03 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13d5dba-64cc-4ed6-ae47-637b10788af6]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:59:03 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d86814-6540-4222-a46f-d21530039393]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:59:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a78823b7-e23e-4b0d-9c0c-e0483aac8845 tempest-CreateVolumesFromSnapshotTest-298673937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b67c8389-386b-4932-b1dd-874c96cd0b82 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:03 devstack sudo[107078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-8c2abfa7-2e7d-4771-bf55-760c275ac1c6 Sep 04 22:59:03 devstack sudo[107078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-400010a0-c20b-41f8-9bad-015714a567c5 tempest-VolumeDependencyTests-217794804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94642597-f21c-480d-85ff-29d708879b6f {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:04 devstack sudo[107081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b67c8389-386b-4932-b1dd-874c96cd0b82 Sep 04 22:59:04 devstack sudo[107074]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:04 devstack sudo[107081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-40a93603-e977-4be0-89ad-b4f372f9e018 tempest-CreateVolumesFromSnapshotTest-298673937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.407s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:04 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-40a93603-e977-4be0-89ad-b4f372f9e018 tempest-CreateVolumesFromSnapshotTest-298673937 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:59:04 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-40a93603-e977-4be0-89ad-b4f372f9e018 tempest-CreateVolumesFromSnapshotTest-298673937 None] Deleted volume successfully. Sep 04 22:59:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-71da10ff-82ac-42a1-aad4-6176b19eb7ed tempest-ProjectMemberTests-1763329861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:59:04 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-40a93603-e977-4be0-89ad-b4f372f9e018 tempest-CreateVolumesFromSnapshotTest-298673937 None] Lock "cinder-38de4868-7350-48b1-81e2-667b45a17e4c-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:59:04 devstack sudo[107083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94642597-f21c-480d-85ff-29d708879b6f Sep 04 22:59:04 devstack sudo[107083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:04 devstack sudo[107078]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-69eea222-3dc5-4528-be66-f18d28fac07d tempest-ProjectReaderTests-144208897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-8c2abfa7-2e7d-4771-bf55-760c275ac1c6" returned: 0 in 0.436s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-69eea222-3dc5-4528-be66-f18d28fac07d tempest-ProjectReaderTests-144208897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-8c2abfa7-2e7d-4771-bf55-760c275ac1c6 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:04 devstack sudo[107090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-8c2abfa7-2e7d-4771-bf55-760c275ac1c6 Sep 04 22:59:04 devstack sudo[107090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:04 devstack sudo[107081]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a78823b7-e23e-4b0d-9c0c-e0483aac8845 tempest-CreateVolumesFromSnapshotTest-298673937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b67c8389-386b-4932-b1dd-874c96cd0b82" returned: 0 in 0.399s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a78823b7-e23e-4b0d-9c0c-e0483aac8845 tempest-CreateVolumesFromSnapshotTest-298673937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b67c8389-386b-4932-b1dd-874c96cd0b82 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:04 devstack sudo[107097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b67c8389-386b-4932-b1dd-874c96cd0b82 Sep 04 22:59:04 devstack sudo[107097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:04 devstack sudo[107083]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-400010a0-c20b-41f8-9bad-015714a567c5 tempest-VolumeDependencyTests-217794804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94642597-f21c-480d-85ff-29d708879b6f" returned: 0 in 0.453s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:04 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-400010a0-c20b-41f8-9bad-015714a567c5 tempest-VolumeDependencyTests-217794804 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94642597-f21c-480d-85ff-29d708879b6f {{(pid=87576) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 04 22:59:04 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-400010a0-c20b-41f8-9bad-015714a567c5 tempest-VolumeDependencyTests-217794804 None] Creating direct copy from snapshot {{(pid=87576) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 04 22:59:04 devstack cinder-volume[87576]: DEBUG cinder.utils [None req-400010a0-c20b-41f8-9bad-015714a567c5 tempest-VolumeDependencyTests-217794804 None] Path /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c842c2cc-9c95-4a94-b0a8-3acb35ff9435 not found in is_blk_device check {{(pid=87576) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 04 22:59:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-400010a0-c20b-41f8-9bad-015714a567c5 tempest-VolumeDependencyTests-217794804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94642597-f21c-480d-85ff-29d708879b6f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c842c2cc-9c95-4a94-b0a8-3acb35ff9435 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:04 devstack sudo[107101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94642597-f21c-480d-85ff-29d708879b6f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c842c2cc-9c95-4a94-b0a8-3acb35ff9435 Sep 04 22:59:04 devstack sudo[107101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:04 devstack sudo[107090]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-69eea222-3dc5-4528-be66-f18d28fac07d tempest-ProjectReaderTests-144208897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-8c2abfa7-2e7d-4771-bf55-760c275ac1c6" returned: 0 in 0.284s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:04 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-69eea222-3dc5-4528-be66-f18d28fac07d tempest-ProjectReaderTests-144208897 None] Lock "cinder-quobyte-8c2abfa7-2e7d-4771-bf55-760c275ac1c6" released by "delete_volume" :: held 0.803s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:59:04 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-69eea222-3dc5-4528-be66-f18d28fac07d tempest-ProjectReaderTests-144208897 None] Created reservations ['43567409-c724-47e4-b254-bd9fe3e97227', 'a9f436a9-09b1-4a24-8415-a089d1ef0f0e', '14dbbc34-79cd-4ede-a7f3-7ae467ab90b1', '37ec186c-bb34-4bcb-8b12-01c700a652b3'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:59:04 devstack sudo[107097]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a78823b7-e23e-4b0d-9c0c-e0483aac8845 tempest-CreateVolumesFromSnapshotTest-298673937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-b67c8389-386b-4932-b1dd-874c96cd0b82" returned: 0 in 0.277s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:04 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-a78823b7-e23e-4b0d-9c0c-e0483aac8845 tempest-CreateVolumesFromSnapshotTest-298673937 None] Lock "cinder-quobyte-b67c8389-386b-4932-b1dd-874c96cd0b82" released by "delete_volume" :: held 0.746s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:59:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-69eea222-3dc5-4528-be66-f18d28fac07d tempest-ProjectReaderTests-144208897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:59:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-69eea222-3dc5-4528-be66-f18d28fac07d tempest-ProjectReaderTests-144208897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:59:04 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-69eea222-3dc5-4528-be66-f18d28fac07d tempest-ProjectReaderTests-144208897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:59:04 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-69eea222-3dc5-4528-be66-f18d28fac07d tempest-ProjectReaderTests-144208897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:59:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-69eea222-3dc5-4528-be66-f18d28fac07d tempest-ProjectReaderTests-144208897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:59:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-69eea222-3dc5-4528-be66-f18d28fac07d tempest-ProjectReaderTests-144208897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:04 devstack sudo[107106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:59:04 devstack sudo[107106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:04 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-a78823b7-e23e-4b0d-9c0c-e0483aac8845 tempest-CreateVolumesFromSnapshotTest-298673937 None] Created reservations ['47fb5eb6-c4a3-40ae-9ef6-0bea71872420', '71d45abf-f7e0-4360-b50b-53e82718837c', '1d823533-df8b-435e-a2eb-187b80b0edfb', 'b7d454e5-2bd8-43ed-800f-8130962a7798'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:59:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-a78823b7-e23e-4b0d-9c0c-e0483aac8845 tempest-CreateVolumesFromSnapshotTest-298673937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:59:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-a78823b7-e23e-4b0d-9c0c-e0483aac8845 tempest-CreateVolumesFromSnapshotTest-298673937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:59:04 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-a78823b7-e23e-4b0d-9c0c-e0483aac8845 tempest-CreateVolumesFromSnapshotTest-298673937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:59:04 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-a78823b7-e23e-4b0d-9c0c-e0483aac8845 tempest-CreateVolumesFromSnapshotTest-298673937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:59:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-a78823b7-e23e-4b0d-9c0c-e0483aac8845 tempest-CreateVolumesFromSnapshotTest-298673937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:59:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a78823b7-e23e-4b0d-9c0c-e0483aac8845 tempest-CreateVolumesFromSnapshotTest-298673937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:04 devstack sudo[107110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:59:04 devstack sudo[107110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:04 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f80328f2-2f12-42d5-80fc-340b995fe9c5 tempest-CreateVolumesFromSnapshotTest-298673937 None] Acquiring lock "cinder-4be91fcc-8671-4020-bf0e-f55e8b8bd97f-delete_snapshot" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:59:05 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f80328f2-2f12-42d5-80fc-340b995fe9c5 tempest-CreateVolumesFromSnapshotTest-298673937 None] Lock "cinder-4be91fcc-8671-4020-bf0e-f55e8b8bd97f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:59:05 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f80328f2-2f12-42d5-80fc-340b995fe9c5 tempest-CreateVolumesFromSnapshotTest-298673937 None] Acquiring lock "cinder-quobyte-70b22b3d-7f93-4490-89e3-0b8d1c1ae830" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:59:05 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f80328f2-2f12-42d5-80fc-340b995fe9c5 tempest-CreateVolumesFromSnapshotTest-298673937 None] Lock "cinder-quobyte-70b22b3d-7f93-4490-89e3-0b8d1c1ae830" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:59:05 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f80328f2-2f12-42d5-80fc-340b995fe9c5 tempest-CreateVolumesFromSnapshotTest-298673937 None] Acquiring lock "cinder-quobyte-4be91fcc-8671-4020-bf0e-f55e8b8bd97f" by "_delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:59:05 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f80328f2-2f12-42d5-80fc-340b995fe9c5 tempest-CreateVolumesFromSnapshotTest-298673937 None] Lock "cinder-quobyte-4be91fcc-8671-4020-bf0e-f55e8b8bd97f" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:59:05 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-f80328f2-2f12-42d5-80fc-340b995fe9c5 tempest-CreateVolumesFromSnapshotTest-298673937 None] Deleting offline snapshot 4be91fcc-8671-4020-bf0e-f55e8b8bd97f of volume 70b22b3d-7f93-4490-89e3-0b8d1c1ae830 {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 22:59:05 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-f80328f2-2f12-42d5-80fc-340b995fe9c5 tempest-CreateVolumesFromSnapshotTest-298673937 None] snapshot_file for this snap is: volume-70b22b3d-7f93-4490-89e3-0b8d1c1ae830.4be91fcc-8671-4020-bf0e-f55e8b8bd97f {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 22:59:05 devstack sudo[107106]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-69eea222-3dc5-4528-be66-f18d28fac07d tempest-ProjectReaderTests-144208897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.406s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:05 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-69eea222-3dc5-4528-be66-f18d28fac07d tempest-ProjectReaderTests-144208897 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:59:05 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-69eea222-3dc5-4528-be66-f18d28fac07d tempest-ProjectReaderTests-144208897 None] Deleted volume successfully. Sep 04 22:59:05 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[77fb027d-b35e-467e-8f3a-ed3ea8cf641d]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:59:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f80328f2-2f12-42d5-80fc-340b995fe9c5 tempest-CreateVolumesFromSnapshotTest-298673937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-70b22b3d-7f93-4490-89e3-0b8d1c1ae830.4be91fcc-8671-4020-bf0e-f55e8b8bd97f {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:05 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-69eea222-3dc5-4528-be66-f18d28fac07d tempest-ProjectReaderTests-144208897 None] Lock "cinder-8c2abfa7-2e7d-4771-bf55-760c275ac1c6-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:59:05 devstack sudo[107110]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a78823b7-e23e-4b0d-9c0c-e0483aac8845 tempest-CreateVolumesFromSnapshotTest-298673937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.650s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:05 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-a78823b7-e23e-4b0d-9c0c-e0483aac8845 tempest-CreateVolumesFromSnapshotTest-298673937 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:59:05 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-a78823b7-e23e-4b0d-9c0c-e0483aac8845 tempest-CreateVolumesFromSnapshotTest-298673937 None] Deleted volume successfully. Sep 04 22:59:05 devstack sudo[107120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-70b22b3d-7f93-4490-89e3-0b8d1c1ae830.4be91fcc-8671-4020-bf0e-f55e8b8bd97f Sep 04 22:59:05 devstack sudo[107120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:05 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-a78823b7-e23e-4b0d-9c0c-e0483aac8845 tempest-CreateVolumesFromSnapshotTest-298673937 None] Lock "cinder-b67c8389-386b-4932-b1dd-874c96cd0b82-delete_volume" released by "delete_volume" :: held 1.815s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:59:05 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-6076ac50-c868-4c32-b047-a4a25c3f0921 tempest-ProjectReaderTests-144208897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:59:05 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6076ac50-c868-4c32-b047-a4a25c3f0921 tempest-ProjectReaderTests-144208897 None] Flow 'volume_create_manager' (9c7f2c07-cc3d-4a92-9762-54ed9ce0fb5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:59:05 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6076ac50-c868-4c32-b047-a4a25c3f0921 tempest-ProjectReaderTests-144208897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d89934a-6271-4f4d-a103-9e444875766d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:05 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6076ac50-c868-4c32-b047-a4a25c3f0921 tempest-ProjectReaderTests-144208897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d89934a-6271-4f4d-a103-9e444875766d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:59:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-80446402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab036d0e-f59e-4c04-ac58-6e235b64b039,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63e43a45529e4d3cbc3f4c88d615f0db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:59:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:59:06Z,use_quota=True,user_id='5bbdd8019f1644f99a01e156b80c6dbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:06 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6076ac50-c868-4c32-b047-a4a25c3f0921 tempest-ProjectReaderTests-144208897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e476e78-e1ee-4798-9cfb-1ba09760f4e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:06 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6076ac50-c868-4c32-b047-a4a25c3f0921 tempest-ProjectReaderTests-144208897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e476e78-e1ee-4798-9cfb-1ba09760f4e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:06 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6076ac50-c868-4c32-b047-a4a25c3f0921 tempest-ProjectReaderTests-144208897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a1acb44-b9d6-47bd-9ecd-d0364ee151ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:06 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6076ac50-c868-4c32-b047-a4a25c3f0921 tempest-ProjectReaderTests-144208897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a1acb44-b9d6-47bd-9ecd-d0364ee151ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab036d0e-f59e-4c04-ac58-6e235b64b039', 'volume_name': 'volume-ab036d0e-f59e-4c04-ac58-6e235b64b039', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:06 devstack sudo[107120]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:06 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6076ac50-c868-4c32-b047-a4a25c3f0921 tempest-ProjectReaderTests-144208897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85309b6f-b2df-436f-b3b2-d481060b3c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:06 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6076ac50-c868-4c32-b047-a4a25c3f0921 tempest-ProjectReaderTests-144208897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85309b6f-b2df-436f-b3b2-d481060b3c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:06 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6076ac50-c868-4c32-b047-a4a25c3f0921 tempest-ProjectReaderTests-144208897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71c8377e-c9fe-42d2-9a08-aac0f289a43a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:06 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-6076ac50-c868-4c32-b047-a4a25c3f0921 tempest-ProjectReaderTests-144208897 None] Volume ab036d0e-f59e-4c04-ac58-6e235b64b039: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab036d0e-f59e-4c04-ac58-6e235b64b039', 'volume_size': 1} Sep 04 22:59:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-6076ac50-c868-4c32-b047-a4a25c3f0921 tempest-ProjectReaderTests-144208897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:59:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f80328f2-2f12-42d5-80fc-340b995fe9c5 tempest-CreateVolumesFromSnapshotTest-298673937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-70b22b3d-7f93-4490-89e3-0b8d1c1ae830.4be91fcc-8671-4020-bf0e-f55e8b8bd97f" returned: 0 in 0.922s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:06 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-f80328f2-2f12-42d5-80fc-340b995fe9c5 tempest-CreateVolumesFromSnapshotTest-298673937 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70b22b3d-7f93-4490-89e3-0b8d1c1ae830(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 22:59:06 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[2086e6b4-217b-4ed4-a20a-5ecf3bd459f5]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:59:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f80328f2-2f12-42d5-80fc-340b995fe9c5 tempest-CreateVolumesFromSnapshotTest-298673937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-70b22b3d-7f93-4490-89e3-0b8d1c1ae830 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:06 devstack sudo[107126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-70b22b3d-7f93-4490-89e3-0b8d1c1ae830 Sep 04 22:59:06 devstack sudo[107126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:07 devstack sudo[107126]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f80328f2-2f12-42d5-80fc-340b995fe9c5 tempest-CreateVolumesFromSnapshotTest-298673937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-70b22b3d-7f93-4490-89e3-0b8d1c1ae830" returned: 0 in 1.120s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f80328f2-2f12-42d5-80fc-340b995fe9c5 tempest-CreateVolumesFromSnapshotTest-298673937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-70b22b3d-7f93-4490-89e3-0b8d1c1ae830.4be91fcc-8671-4020-bf0e-f55e8b8bd97f {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:07 devstack sudo[107132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-70b22b3d-7f93-4490-89e3-0b8d1c1ae830.4be91fcc-8671-4020-bf0e-f55e8b8bd97f Sep 04 22:59:07 devstack sudo[107132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:08 devstack sudo[107132]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f80328f2-2f12-42d5-80fc-340b995fe9c5 tempest-CreateVolumesFromSnapshotTest-298673937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-70b22b3d-7f93-4490-89e3-0b8d1c1ae830.4be91fcc-8671-4020-bf0e-f55e8b8bd97f" returned: 0 in 0.904s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f80328f2-2f12-42d5-80fc-340b995fe9c5 tempest-CreateVolumesFromSnapshotTest-298673937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-70b22b3d-7f93-4490-89e3-0b8d1c1ae830.4be91fcc-8671-4020-bf0e-f55e8b8bd97f {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:08 devstack sudo[107139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-70b22b3d-7f93-4490-89e3-0b8d1c1ae830.4be91fcc-8671-4020-bf0e-f55e8b8bd97f Sep 04 22:59:08 devstack sudo[107139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:08 devstack sudo[107139]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f80328f2-2f12-42d5-80fc-340b995fe9c5 tempest-CreateVolumesFromSnapshotTest-298673937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-70b22b3d-7f93-4490-89e3-0b8d1c1ae830.4be91fcc-8671-4020-bf0e-f55e8b8bd97f" returned: 0 in 0.457s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:08 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f80328f2-2f12-42d5-80fc-340b995fe9c5 tempest-CreateVolumesFromSnapshotTest-298673937 None] Lock "cinder-quobyte-4be91fcc-8671-4020-bf0e-f55e8b8bd97f" released by "_delete_snapshot" :: held 3.682s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:59:08 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f80328f2-2f12-42d5-80fc-340b995fe9c5 tempest-CreateVolumesFromSnapshotTest-298673937 None] Lock "cinder-quobyte-70b22b3d-7f93-4490-89e3-0b8d1c1ae830" released by "delete_snapshot" :: held 3.725s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:59:08 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-f80328f2-2f12-42d5-80fc-340b995fe9c5 tempest-CreateVolumesFromSnapshotTest-298673937 None] Created reservations ['3fb8fbe5-b1ba-4585-8ad8-5629b951e4af', '2ec30998-6499-40a1-8eb6-c29e8d284c7e', '5f0e240f-8052-4d9d-92ab-4cc30f1613ec', 'efc64328-0b8d-4204-895d-98c5bcedfaf1'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:59:09 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-f80328f2-2f12-42d5-80fc-340b995fe9c5 tempest-CreateVolumesFromSnapshotTest-298673937 None] Delete snapshot completed successfully. Sep 04 22:59:09 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f80328f2-2f12-42d5-80fc-340b995fe9c5 tempest-CreateVolumesFromSnapshotTest-298673937 None] Lock "cinder-4be91fcc-8671-4020-bf0e-f55e8b8bd97f-delete_snapshot" released by "delete_snapshot" :: held 4.055s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:59:09 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-72c2852f-6360-4069-adc3-48d4cffdb993 tempest-CreateVolumesFromSnapshotTest-298673937 None] Acquiring lock "cinder-70b22b3d-7f93-4490-89e3-0b8d1c1ae830-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:59:09 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-72c2852f-6360-4069-adc3-48d4cffdb993 tempest-CreateVolumesFromSnapshotTest-298673937 None] Lock "cinder-70b22b3d-7f93-4490-89e3-0b8d1c1ae830-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:59:09 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-72c2852f-6360-4069-adc3-48d4cffdb993 tempest-CreateVolumesFromSnapshotTest-298673937 None] Acquiring lock "cinder-quobyte-70b22b3d-7f93-4490-89e3-0b8d1c1ae830" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:59:09 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-72c2852f-6360-4069-adc3-48d4cffdb993 tempest-CreateVolumesFromSnapshotTest-298673937 None] Lock "cinder-quobyte-70b22b3d-7f93-4490-89e3-0b8d1c1ae830" acquired by "delete_volume" :: waited 0.072s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:59:09 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a7c4d0-7a28-4b39-aaf6-814f2e6e7c74]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:59:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-72c2852f-6360-4069-adc3-48d4cffdb993 tempest-CreateVolumesFromSnapshotTest-298673937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-70b22b3d-7f93-4490-89e3-0b8d1c1ae830 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:09 devstack sudo[107101]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-400010a0-c20b-41f8-9bad-015714a567c5 tempest-VolumeDependencyTests-217794804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94642597-f21c-480d-85ff-29d708879b6f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c842c2cc-9c95-4a94-b0a8-3acb35ff9435" returned: 0 in 5.407s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:09 devstack cinder-volume[87576]: DEBUG cinder.image.image_utils [None req-400010a0-c20b-41f8-9bad-015714a567c5 tempest-VolumeDependencyTests-217794804 None] Image conversion details: src /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94642597-f21c-480d-85ff-29d708879b6f, size 1024.00 MB, duration 5.41 sec, destination /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c842c2cc-9c95-4a94-b0a8-3acb35ff9435 {{(pid=87576) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 22:59:09 devstack cinder-volume[87576]: INFO cinder.image.image_utils [None req-400010a0-c20b-41f8-9bad-015714a567c5 tempest-VolumeDependencyTests-217794804 None] Converted 1024.00 MB image at 189.33 MB/s Sep 04 22:59:09 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-400010a0-c20b-41f8-9bad-015714a567c5 tempest-VolumeDependencyTests-217794804 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c842c2cc-9c95-4a94-b0a8-3acb35ff9435 is being set with open permissions: ugo+rw Sep 04 22:59:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-400010a0-c20b-41f8-9bad-015714a567c5 tempest-VolumeDependencyTests-217794804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c842c2cc-9c95-4a94-b0a8-3acb35ff9435 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:09 devstack sudo[107143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c842c2cc-9c95-4a94-b0a8-3acb35ff9435 Sep 04 22:59:09 devstack sudo[107143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:09 devstack sudo[107142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-70b22b3d-7f93-4490-89e3-0b8d1c1ae830 Sep 04 22:59:09 devstack sudo[107142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:10 devstack sudo[107143]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-400010a0-c20b-41f8-9bad-015714a567c5 tempest-VolumeDependencyTests-217794804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c842c2cc-9c95-4a94-b0a8-3acb35ff9435" returned: 0 in 0.246s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:10 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-400010a0-c20b-41f8-9bad-015714a567c5 tempest-VolumeDependencyTests-217794804 None] Lock "cinder-quobyte-c842c2cc-9c95-4a94-b0a8-3acb35ff9435" released by "_copy_volume_from_snapshot" :: held 6.790s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:59:10 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-400010a0-c20b-41f8-9bad-015714a567c5 tempest-VolumeDependencyTests-217794804 None] Lock "cinder-quobyte-f61e7976-0d53-4fce-8dfb-6a3225a73679-c842c2cc-9c95-4a94-b0a8-3acb35ff9435" released by "_create_volume_from_snapshot" :: held 6.884s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:59:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-400010a0-c20b-41f8-9bad-015714a567c5 tempest-VolumeDependencyTests-217794804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.923s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:59:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-71da10ff-82ac-42a1-aad4-6176b19eb7ed tempest-ProjectMemberTests-1763329861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.016s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:59:10 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-71da10ff-82ac-42a1-aad4-6176b19eb7ed tempest-ProjectMemberTests-1763329861 None] Creating offline snapshot c1f3c9c1-f2aa-4420-a4e1-67d05210d8f3 of volume 683726c4-871c-47f5-9618-cdec0c89a171 {{(pid=87576) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 22:59:10 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-400010a0-c20b-41f8-9bad-015714a567c5 tempest-VolumeDependencyTests-217794804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5afb28a-50ef-4642-994e-0474361e054a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c842c2cc-9c95-4a94-b0a8-3acb35ff9435', 'volume_size': 1, 'snapshot_id': 'f61e7976-0d53-4fce-8dfb-6a3225a73679'}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:10 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-400010a0-c20b-41f8-9bad-015714a567c5 tempest-VolumeDependencyTests-217794804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2869355a-f1d0-403b-aa0a-ed9ab9b260db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:10 devstack sudo[107142]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:10 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[90315a9f-caee-447f-99d3-6ac696b2c712]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:59:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-71da10ff-82ac-42a1-aad4-6176b19eb7ed tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-683726c4-871c-47f5-9618-cdec0c89a171 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-72c2852f-6360-4069-adc3-48d4cffdb993 tempest-CreateVolumesFromSnapshotTest-298673937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-70b22b3d-7f93-4490-89e3-0b8d1c1ae830" returned: 0 in 0.462s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-72c2852f-6360-4069-adc3-48d4cffdb993 tempest-CreateVolumesFromSnapshotTest-298673937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-70b22b3d-7f93-4490-89e3-0b8d1c1ae830 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:10 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-400010a0-c20b-41f8-9bad-015714a567c5 tempest-VolumeDependencyTests-217794804 None] Volume volume-c842c2cc-9c95-4a94-b0a8-3acb35ff9435 (c842c2cc-9c95-4a94-b0a8-3acb35ff9435): created successfully Sep 04 22:59:10 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-400010a0-c20b-41f8-9bad-015714a567c5 tempest-VolumeDependencyTests-217794804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2869355a-f1d0-403b-aa0a-ed9ab9b260db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:10 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-400010a0-c20b-41f8-9bad-015714a567c5 tempest-VolumeDependencyTests-217794804 None] Flow 'volume_create_manager' (474a0965-5df7-4de7-8e61-db1876ec073d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:59:10 devstack sudo[107152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-70b22b3d-7f93-4490-89e3-0b8d1c1ae830 Sep 04 22:59:10 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:10 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-400010a0-c20b-41f8-9bad-015714a567c5 tempest-VolumeDependencyTests-217794804 None] Created volume successfully. Sep 04 22:59:10 devstack sudo[107151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-683726c4-871c-47f5-9618-cdec0c89a171 Sep 04 22:59:10 devstack sudo[107151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:10 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-72c2852f-6360-4069-adc3-48d4cffdb993 tempest-CreateVolumesFromSnapshotTest-298673937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-70b22b3d-7f93-4490-89e3-0b8d1c1ae830" returned: 0 in 0.265s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:10 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-72c2852f-6360-4069-adc3-48d4cffdb993 tempest-CreateVolumesFromSnapshotTest-298673937 None] Lock "cinder-quobyte-70b22b3d-7f93-4490-89e3-0b8d1c1ae830" released by "delete_volume" :: held 0.869s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:59:10 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-72c2852f-6360-4069-adc3-48d4cffdb993 tempest-CreateVolumesFromSnapshotTest-298673937 None] Created reservations ['04cf9f46-15f4-4346-b6d2-53460aa6ebd0', '0903d1dc-265b-49f4-bce4-8355622614fd', 'a84b3943-00f5-4bc7-bf75-696d7efee7d5', '7c8fb63f-a82a-4929-9154-4ad33aecc9a0'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:59:10 devstack sudo[107151]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-71da10ff-82ac-42a1-aad4-6176b19eb7ed tempest-ProjectMemberTests-1763329861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-683726c4-871c-47f5-9618-cdec0c89a171" returned: 0 in 0.371s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-71da10ff-82ac-42a1-aad4-6176b19eb7ed tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-683726c4-871c-47f5-9618-cdec0c89a171,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-683726c4-871c-47f5-9618-cdec0c89a171.c1f3c9c1-f2aa-4420-a4e1-67d05210d8f3 1G {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:10 devstack sudo[107159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-683726c4-871c-47f5-9618-cdec0c89a171,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-683726c4-871c-47f5-9618-cdec0c89a171.c1f3c9c1-f2aa-4420-a4e1-67d05210d8f3 1G Sep 04 22:59:10 devstack sudo[107159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-72c2852f-6360-4069-adc3-48d4cffdb993 tempest-CreateVolumesFromSnapshotTest-298673937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:59:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-72c2852f-6360-4069-adc3-48d4cffdb993 tempest-CreateVolumesFromSnapshotTest-298673937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:59:10 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-72c2852f-6360-4069-adc3-48d4cffdb993 tempest-CreateVolumesFromSnapshotTest-298673937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:59:10 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-72c2852f-6360-4069-adc3-48d4cffdb993 tempest-CreateVolumesFromSnapshotTest-298673937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:59:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-72c2852f-6360-4069-adc3-48d4cffdb993 tempest-CreateVolumesFromSnapshotTest-298673937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:59:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-72c2852f-6360-4069-adc3-48d4cffdb993 tempest-CreateVolumesFromSnapshotTest-298673937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:10 devstack sudo[107161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:59:10 devstack sudo[107161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:10 devstack sudo[107161]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-72c2852f-6360-4069-adc3-48d4cffdb993 tempest-CreateVolumesFromSnapshotTest-298673937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.289s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:10 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-72c2852f-6360-4069-adc3-48d4cffdb993 tempest-CreateVolumesFromSnapshotTest-298673937 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:59:10 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-72c2852f-6360-4069-adc3-48d4cffdb993 tempest-CreateVolumesFromSnapshotTest-298673937 None] Deleted volume successfully. Sep 04 22:59:10 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-72c2852f-6360-4069-adc3-48d4cffdb993 tempest-CreateVolumesFromSnapshotTest-298673937 None] Lock "cinder-70b22b3d-7f93-4490-89e3-0b8d1c1ae830-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:59:11 devstack sudo[107159]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-71da10ff-82ac-42a1-aad4-6176b19eb7ed tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-683726c4-871c-47f5-9618-cdec0c89a171,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-683726c4-871c-47f5-9618-cdec0c89a171.c1f3c9c1-f2aa-4420-a4e1-67d05210d8f3 1G" returned: 0 in 0.486s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-71da10ff-82ac-42a1-aad4-6176b19eb7ed tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-683726c4-871c-47f5-9618-cdec0c89a171 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-683726c4-871c-47f5-9618-cdec0c89a171.c1f3c9c1-f2aa-4420-a4e1-67d05210d8f3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:11 devstack sudo[107168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-683726c4-871c-47f5-9618-cdec0c89a171 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-683726c4-871c-47f5-9618-cdec0c89a171.c1f3c9c1-f2aa-4420-a4e1-67d05210d8f3 Sep 04 22:59:11 devstack sudo[107168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:11 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-0d04ff73-fb6f-4c95-b5da-c94d026973b1 tempest-VolumeDependencyTests-217794804 None] Acquiring lock "cinder-f61e7976-0d53-4fce-8dfb-6a3225a73679-delete_snapshot" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:59:11 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-0d04ff73-fb6f-4c95-b5da-c94d026973b1 tempest-VolumeDependencyTests-217794804 None] Lock "cinder-f61e7976-0d53-4fce-8dfb-6a3225a73679-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:59:11 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-0d04ff73-fb6f-4c95-b5da-c94d026973b1 tempest-VolumeDependencyTests-217794804 None] Acquiring lock "cinder-quobyte-94642597-f21c-480d-85ff-29d708879b6f" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:59:11 devstack sudo[107168]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-71da10ff-82ac-42a1-aad4-6176b19eb7ed tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-683726c4-871c-47f5-9618-cdec0c89a171 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-683726c4-871c-47f5-9618-cdec0c89a171.c1f3c9c1-f2aa-4420-a4e1-67d05210d8f3" returned: 0 in 0.322s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:11 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-71da10ff-82ac-42a1-aad4-6176b19eb7ed tempest-ProjectMemberTests-1763329861 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-683726c4-871c-47f5-9618-cdec0c89a171.c1f3c9c1-f2aa-4420-a4e1-67d05210d8f3 is being set with open permissions: ugo+rw Sep 04 22:59:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-71da10ff-82ac-42a1-aad4-6176b19eb7ed tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-683726c4-871c-47f5-9618-cdec0c89a171.c1f3c9c1-f2aa-4420-a4e1-67d05210d8f3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:11 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-0d04ff73-fb6f-4c95-b5da-c94d026973b1 tempest-VolumeDependencyTests-217794804 None] Lock "cinder-quobyte-94642597-f21c-480d-85ff-29d708879b6f" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:59:11 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-0d04ff73-fb6f-4c95-b5da-c94d026973b1 tempest-VolumeDependencyTests-217794804 None] Acquiring lock "cinder-quobyte-f61e7976-0d53-4fce-8dfb-6a3225a73679" by "_delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:59:11 devstack sudo[107173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-683726c4-871c-47f5-9618-cdec0c89a171.c1f3c9c1-f2aa-4420-a4e1-67d05210d8f3 Sep 04 22:59:11 devstack sudo[107173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:11 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-0d04ff73-fb6f-4c95-b5da-c94d026973b1 tempest-VolumeDependencyTests-217794804 None] Lock "cinder-quobyte-f61e7976-0d53-4fce-8dfb-6a3225a73679" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:59:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-0d04ff73-fb6f-4c95-b5da-c94d026973b1 tempest-VolumeDependencyTests-217794804 None] Deleting offline snapshot f61e7976-0d53-4fce-8dfb-6a3225a73679 of volume 94642597-f21c-480d-85ff-29d708879b6f {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 22:59:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-0d04ff73-fb6f-4c95-b5da-c94d026973b1 tempest-VolumeDependencyTests-217794804 None] snapshot_file for this snap is: volume-94642597-f21c-480d-85ff-29d708879b6f.f61e7976-0d53-4fce-8dfb-6a3225a73679 {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 22:59:11 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d300664-4dc2-466f-8b52-0bb2f5674d15]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:59:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0d04ff73-fb6f-4c95-b5da-c94d026973b1 tempest-VolumeDependencyTests-217794804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94642597-f21c-480d-85ff-29d708879b6f.f61e7976-0d53-4fce-8dfb-6a3225a73679 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:11 devstack sudo[107175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94642597-f21c-480d-85ff-29d708879b6f.f61e7976-0d53-4fce-8dfb-6a3225a73679 Sep 04 22:59:11 devstack sudo[107175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:11 devstack sudo[107173]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-71da10ff-82ac-42a1-aad4-6176b19eb7ed tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-683726c4-871c-47f5-9618-cdec0c89a171.c1f3c9c1-f2aa-4420-a4e1-67d05210d8f3" returned: 0 in 0.297s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-71da10ff-82ac-42a1-aad4-6176b19eb7ed tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-683726c4-871c-47f5-9618-cdec0c89a171.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:11 devstack sudo[107179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-683726c4-871c-47f5-9618-cdec0c89a171.info Sep 04 22:59:11 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:11 devstack cinder-volume[87576]: DEBUG oslo_service.periodic_task [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87576) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 22:59:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:59:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:59:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:59:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:59:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:59:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:11 devstack sudo[107183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:59:11 devstack sudo[107183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:11 devstack sudo[107175]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0d04ff73-fb6f-4c95-b5da-c94d026973b1 tempest-VolumeDependencyTests-217794804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94642597-f21c-480d-85ff-29d708879b6f.f61e7976-0d53-4fce-8dfb-6a3225a73679" returned: 0 in 0.436s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-0d04ff73-fb6f-4c95-b5da-c94d026973b1 tempest-VolumeDependencyTests-217794804 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94642597-f21c-480d-85ff-29d708879b6f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 22:59:11 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3c7fe9-04ee-4c4c-810c-419b8ede70f2]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:59:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0d04ff73-fb6f-4c95-b5da-c94d026973b1 tempest-VolumeDependencyTests-217794804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94642597-f21c-480d-85ff-29d708879b6f {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:12 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-71da10ff-82ac-42a1-aad4-6176b19eb7ed tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-683726c4-871c-47f5-9618-cdec0c89a171.info" returned: 0 in 0.292s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:12 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-71da10ff-82ac-42a1-aad4-6176b19eb7ed tempest-ProjectMemberTests-1763329861 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-683726c4-871c-47f5-9618-cdec0c89a171.info is being set with open permissions: ugo+rw Sep 04 22:59:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-71da10ff-82ac-42a1-aad4-6176b19eb7ed tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-683726c4-871c-47f5-9618-cdec0c89a171.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:12 devstack sudo[107188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-683726c4-871c-47f5-9618-cdec0c89a171.info Sep 04 22:59:12 devstack sudo[107188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:12 devstack sudo[107187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94642597-f21c-480d-85ff-29d708879b6f Sep 04 22:59:12 devstack sudo[107187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:12 devstack sudo[107183]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.331s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:12 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:59:12 devstack cinder-volume[87576]: DEBUG oslo_service.periodic_task [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Running periodic task VolumeManager._thread_info {{(pid=87576) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 22:59:12 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] thread count: 28 {{(pid=87576) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 22:59:12 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] thread info: [<_MainThread(MainThread, started 125730416963712)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87576) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 22:59:12 devstack sudo[107188]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-71da10ff-82ac-42a1-aad4-6176b19eb7ed tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-683726c4-871c-47f5-9618-cdec0c89a171.info" returned: 0 in 0.314s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-71da10ff-82ac-42a1-aad4-6176b19eb7ed tempest-ProjectMemberTests-1763329861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.194s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:59:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-6076ac50-c868-4c32-b047-a4a25c3f0921 tempest-ProjectReaderTests-144208897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.295s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:59:12 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-6076ac50-c868-4c32-b047-a4a25c3f0921 tempest-ProjectReaderTests-144208897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:59:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-80446402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab036d0e-f59e-4c04-ac58-6e235b64b039,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63e43a45529e4d3cbc3f4c88d615f0db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:59:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:59:06Z,use_quota=True,user_id='5bbdd8019f1644f99a01e156b80c6dbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:59:12 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-6076ac50-c868-4c32-b047-a4a25c3f0921 tempest-ProjectReaderTests-144208897 None] Creating volume ab036d0e-f59e-4c04-ac58-6e235b64b039 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:59:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-6076ac50-c868-4c32-b047-a4a25c3f0921 tempest-ProjectReaderTests-144208897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:59:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-6076ac50-c868-4c32-b047-a4a25c3f0921 tempest-ProjectReaderTests-144208897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:59:12 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-6076ac50-c868-4c32-b047-a4a25c3f0921 tempest-ProjectReaderTests-144208897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:59:12 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-6076ac50-c868-4c32-b047-a4a25c3f0921 tempest-ProjectReaderTests-144208897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:59:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-6076ac50-c868-4c32-b047-a4a25c3f0921 tempest-ProjectReaderTests-144208897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:59:12 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-6076ac50-c868-4c32-b047-a4a25c3f0921 tempest-ProjectReaderTests-144208897 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:59:12 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-6076ac50-c868-4c32-b047-a4a25c3f0921 tempest-ProjectReaderTests-144208897 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:59:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-6076ac50-c868-4c32-b047-a4a25c3f0921 tempest-ProjectReaderTests-144208897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-ab036d0e-f59e-4c04-ac58-6e235b64b039 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:12 devstack sudo[107195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-ab036d0e-f59e-4c04-ac58-6e235b64b039 1073741824 Sep 04 22:59:12 devstack sudo[107195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:12 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-71da10ff-82ac-42a1-aad4-6176b19eb7ed tempest-ProjectMemberTests-1763329861 None] Create snapshot completed successfully Sep 04 22:59:12 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-3b2cbfdb-07b1-49f4-88e5-f984725a3e09 tempest-ProjectMemberTests-1763329861 None] Acquiring lock "cinder-c1f3c9c1-f2aa-4420-a4e1-67d05210d8f3-delete_snapshot" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:59:12 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-3b2cbfdb-07b1-49f4-88e5-f984725a3e09 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-c1f3c9c1-f2aa-4420-a4e1-67d05210d8f3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:59:12 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-3b2cbfdb-07b1-49f4-88e5-f984725a3e09 tempest-ProjectMemberTests-1763329861 None] Acquiring lock "cinder-quobyte-683726c4-871c-47f5-9618-cdec0c89a171" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:59:12 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-3b2cbfdb-07b1-49f4-88e5-f984725a3e09 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-quobyte-683726c4-871c-47f5-9618-cdec0c89a171" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:59:12 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-3b2cbfdb-07b1-49f4-88e5-f984725a3e09 tempest-ProjectMemberTests-1763329861 None] Acquiring lock "cinder-quobyte-c1f3c9c1-f2aa-4420-a4e1-67d05210d8f3" by "_delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:59:12 devstack sudo[107187]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0d04ff73-fb6f-4c95-b5da-c94d026973b1 tempest-VolumeDependencyTests-217794804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94642597-f21c-480d-85ff-29d708879b6f" returned: 0 in 0.644s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0d04ff73-fb6f-4c95-b5da-c94d026973b1 tempest-VolumeDependencyTests-217794804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94642597-f21c-480d-85ff-29d708879b6f.f61e7976-0d53-4fce-8dfb-6a3225a73679 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:12 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-3b2cbfdb-07b1-49f4-88e5-f984725a3e09 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-quobyte-c1f3c9c1-f2aa-4420-a4e1-67d05210d8f3" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:59:12 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-3b2cbfdb-07b1-49f4-88e5-f984725a3e09 tempest-ProjectMemberTests-1763329861 None] Deleting offline snapshot c1f3c9c1-f2aa-4420-a4e1-67d05210d8f3 of volume 683726c4-871c-47f5-9618-cdec0c89a171 {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 22:59:12 devstack sudo[107199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94642597-f21c-480d-85ff-29d708879b6f.f61e7976-0d53-4fce-8dfb-6a3225a73679 Sep 04 22:59:12 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:12 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-3b2cbfdb-07b1-49f4-88e5-f984725a3e09 tempest-ProjectMemberTests-1763329861 None] snapshot_file for this snap is: volume-683726c4-871c-47f5-9618-cdec0c89a171.c1f3c9c1-f2aa-4420-a4e1-67d05210d8f3 {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 22:59:12 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5eba67-5299-44b5-a001-cd69019267f8]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:59:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3b2cbfdb-07b1-49f4-88e5-f984725a3e09 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-683726c4-871c-47f5-9618-cdec0c89a171.c1f3c9c1-f2aa-4420-a4e1-67d05210d8f3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:12 devstack sudo[107204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-683726c4-871c-47f5-9618-cdec0c89a171.c1f3c9c1-f2aa-4420-a4e1-67d05210d8f3 Sep 04 22:59:12 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:12 devstack sudo[107195]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-6076ac50-c868-4c32-b047-a4a25c3f0921 tempest-ProjectReaderTests-144208897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-ab036d0e-f59e-4c04-ac58-6e235b64b039 1073741824" returned: 0 in 0.568s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-6076ac50-c868-4c32-b047-a4a25c3f0921 tempest-ProjectReaderTests-144208897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-ab036d0e-f59e-4c04-ac58-6e235b64b039 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:13 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0d04ff73-fb6f-4c95-b5da-c94d026973b1 tempest-VolumeDependencyTests-217794804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94642597-f21c-480d-85ff-29d708879b6f.f61e7976-0d53-4fce-8dfb-6a3225a73679" returned: 0 in 0.410s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0d04ff73-fb6f-4c95-b5da-c94d026973b1 tempest-VolumeDependencyTests-217794804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94642597-f21c-480d-85ff-29d708879b6f.f61e7976-0d53-4fce-8dfb-6a3225a73679 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:13 devstack sudo[107212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-ab036d0e-f59e-4c04-ac58-6e235b64b039 Sep 04 22:59:13 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:13 devstack sudo[107214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94642597-f21c-480d-85ff-29d708879b6f.f61e7976-0d53-4fce-8dfb-6a3225a73679 Sep 04 22:59:13 devstack sudo[107214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:13 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3b2cbfdb-07b1-49f4-88e5-f984725a3e09 tempest-ProjectMemberTests-1763329861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-683726c4-871c-47f5-9618-cdec0c89a171.c1f3c9c1-f2aa-4420-a4e1-67d05210d8f3" returned: 0 in 0.485s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:13 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-3b2cbfdb-07b1-49f4-88e5-f984725a3e09 tempest-ProjectMemberTests-1763329861 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-683726c4-871c-47f5-9618-cdec0c89a171(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 22:59:13 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[992d5921-6c48-4095-bd81-5a1574b57d11]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:59:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3b2cbfdb-07b1-49f4-88e5-f984725a3e09 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-683726c4-871c-47f5-9618-cdec0c89a171 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:13 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-6076ac50-c868-4c32-b047-a4a25c3f0921 tempest-ProjectReaderTests-144208897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-ab036d0e-f59e-4c04-ac58-6e235b64b039" returned: 0 in 0.323s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:13 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-6076ac50-c868-4c32-b047-a4a25c3f0921 tempest-ProjectReaderTests-144208897 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:59:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-6076ac50-c868-4c32-b047-a4a25c3f0921 tempest-ProjectReaderTests-144208897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:59:13 devstack sudo[107214]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:13 devstack sudo[107219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-683726c4-871c-47f5-9618-cdec0c89a171 Sep 04 22:59:13 devstack sudo[107219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0d04ff73-fb6f-4c95-b5da-c94d026973b1 tempest-VolumeDependencyTests-217794804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94642597-f21c-480d-85ff-29d708879b6f.f61e7976-0d53-4fce-8dfb-6a3225a73679" returned: 0 in 0.304s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:13 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6076ac50-c868-4c32-b047-a4a25c3f0921 tempest-ProjectReaderTests-144208897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71c8377e-c9fe-42d2-9a08-aac0f289a43a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab036d0e-f59e-4c04-ac58-6e235b64b039', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:13 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6076ac50-c868-4c32-b047-a4a25c3f0921 tempest-ProjectReaderTests-144208897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa4cf5e9-51b3-47eb-9d4b-30a51efda433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:13 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-6076ac50-c868-4c32-b047-a4a25c3f0921 tempest-ProjectReaderTests-144208897 None] Volume volume-ab036d0e-f59e-4c04-ac58-6e235b64b039 (ab036d0e-f59e-4c04-ac58-6e235b64b039): created successfully Sep 04 22:59:13 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6076ac50-c868-4c32-b047-a4a25c3f0921 tempest-ProjectReaderTests-144208897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa4cf5e9-51b3-47eb-9d4b-30a51efda433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:13 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-6076ac50-c868-4c32-b047-a4a25c3f0921 tempest-ProjectReaderTests-144208897 None] Flow 'volume_create_manager' (9c7f2c07-cc3d-4a92-9762-54ed9ce0fb5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:59:13 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-0d04ff73-fb6f-4c95-b5da-c94d026973b1 tempest-VolumeDependencyTests-217794804 None] Lock "cinder-quobyte-f61e7976-0d53-4fce-8dfb-6a3225a73679" released by "_delete_snapshot" :: held 1.962s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:59:13 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-0d04ff73-fb6f-4c95-b5da-c94d026973b1 tempest-VolumeDependencyTests-217794804 None] Lock "cinder-quobyte-94642597-f21c-480d-85ff-29d708879b6f" released by "delete_snapshot" :: held 2.000s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:59:13 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-6076ac50-c868-4c32-b047-a4a25c3f0921 tempest-ProjectReaderTests-144208897 None] Created volume successfully. Sep 04 22:59:13 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-0d04ff73-fb6f-4c95-b5da-c94d026973b1 tempest-VolumeDependencyTests-217794804 None] Created reservations ['43e8a715-3a6c-4928-857a-e2a9a5d80889', '6c1c14d1-5a93-43a6-b354-f3a79d8d5c49', '0cc5220b-6a20-4a51-a0d0-79815f533628', 'fd4c62e7-ef68-4098-9ed9-9a7117ecef81'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:59:13 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-0d04ff73-fb6f-4c95-b5da-c94d026973b1 tempest-VolumeDependencyTests-217794804 None] Delete snapshot completed successfully. Sep 04 22:59:13 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-0d04ff73-fb6f-4c95-b5da-c94d026973b1 tempest-VolumeDependencyTests-217794804 None] Lock "cinder-f61e7976-0d53-4fce-8dfb-6a3225a73679-delete_snapshot" released by "delete_snapshot" :: held 2.208s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:59:13 devstack sudo[107219]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3b2cbfdb-07b1-49f4-88e5-f984725a3e09 tempest-ProjectMemberTests-1763329861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-683726c4-871c-47f5-9618-cdec0c89a171" returned: 0 in 0.447s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3b2cbfdb-07b1-49f4-88e5-f984725a3e09 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-683726c4-871c-47f5-9618-cdec0c89a171.c1f3c9c1-f2aa-4420-a4e1-67d05210d8f3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:13 devstack sudo[107227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-683726c4-871c-47f5-9618-cdec0c89a171.c1f3c9c1-f2aa-4420-a4e1-67d05210d8f3 Sep 04 22:59:13 devstack sudo[107227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:13 devstack sudo[107227]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3b2cbfdb-07b1-49f4-88e5-f984725a3e09 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-683726c4-871c-47f5-9618-cdec0c89a171.c1f3c9c1-f2aa-4420-a4e1-67d05210d8f3" returned: 0 in 0.343s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3b2cbfdb-07b1-49f4-88e5-f984725a3e09 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-683726c4-871c-47f5-9618-cdec0c89a171.c1f3c9c1-f2aa-4420-a4e1-67d05210d8f3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:14 devstack sudo[107233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-683726c4-871c-47f5-9618-cdec0c89a171.c1f3c9c1-f2aa-4420-a4e1-67d05210d8f3 Sep 04 22:59:14 devstack sudo[107233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:14 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-3184693f-4ccb-430e-9b16-e3a715ae82dc tempest-ProjectReaderTests-144208897 None] Acquiring lock "cinder-ab036d0e-f59e-4c04-ac58-6e235b64b039-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:59:14 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-3184693f-4ccb-430e-9b16-e3a715ae82dc tempest-ProjectReaderTests-144208897 None] Lock "cinder-ab036d0e-f59e-4c04-ac58-6e235b64b039-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:59:14 devstack sudo[107233]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3b2cbfdb-07b1-49f4-88e5-f984725a3e09 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-683726c4-871c-47f5-9618-cdec0c89a171.c1f3c9c1-f2aa-4420-a4e1-67d05210d8f3" returned: 0 in 0.320s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:14 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-3b2cbfdb-07b1-49f4-88e5-f984725a3e09 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-quobyte-c1f3c9c1-f2aa-4420-a4e1-67d05210d8f3" released by "_delete_snapshot" :: held 1.734s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:59:14 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-3b2cbfdb-07b1-49f4-88e5-f984725a3e09 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-quobyte-683726c4-871c-47f5-9618-cdec0c89a171" released by "delete_snapshot" :: held 1.780s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:59:14 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-3184693f-4ccb-430e-9b16-e3a715ae82dc tempest-ProjectReaderTests-144208897 None] Acquiring lock "cinder-quobyte-ab036d0e-f59e-4c04-ac58-6e235b64b039" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:59:14 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-3184693f-4ccb-430e-9b16-e3a715ae82dc tempest-ProjectReaderTests-144208897 None] Lock "cinder-quobyte-ab036d0e-f59e-4c04-ac58-6e235b64b039" acquired by "delete_volume" :: waited 0.036s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:59:14 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[2963e6af-27ed-4d11-90b1-eff4433d424a]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:59:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3184693f-4ccb-430e-9b16-e3a715ae82dc tempest-ProjectReaderTests-144208897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-ab036d0e-f59e-4c04-ac58-6e235b64b039 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:14 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-3b2cbfdb-07b1-49f4-88e5-f984725a3e09 tempest-ProjectMemberTests-1763329861 None] Created reservations ['754299c4-de80-435f-8970-c11000cb5cac', '8ef0065a-ac2c-477f-86d3-f1689436caf4', '75d9e296-1ffb-4482-8290-9d8830865aed', 'f7661095-acd8-4778-9927-ab48e35f180e'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:59:14 devstack sudo[107236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-ab036d0e-f59e-4c04-ac58-6e235b64b039 Sep 04 22:59:14 devstack sudo[107236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:14 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-058e62ae-c22e-48a0-ba7e-ceb30d094323 tempest-VolumeDependencyTests-217794804 None] Acquiring lock "cinder-94642597-f21c-480d-85ff-29d708879b6f-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:59:14 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-3b2cbfdb-07b1-49f4-88e5-f984725a3e09 tempest-ProjectMemberTests-1763329861 None] Delete snapshot completed successfully. Sep 04 22:59:14 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-3b2cbfdb-07b1-49f4-88e5-f984725a3e09 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-c1f3c9c1-f2aa-4420-a4e1-67d05210d8f3-delete_snapshot" released by "delete_snapshot" :: held 2.042s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:59:14 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-058e62ae-c22e-48a0-ba7e-ceb30d094323 tempest-VolumeDependencyTests-217794804 None] Lock "cinder-94642597-f21c-480d-85ff-29d708879b6f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:59:14 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-058e62ae-c22e-48a0-ba7e-ceb30d094323 tempest-VolumeDependencyTests-217794804 None] Acquiring lock "cinder-quobyte-94642597-f21c-480d-85ff-29d708879b6f" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:59:14 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-058e62ae-c22e-48a0-ba7e-ceb30d094323 tempest-VolumeDependencyTests-217794804 None] Lock "cinder-quobyte-94642597-f21c-480d-85ff-29d708879b6f" acquired by "delete_volume" :: waited 0.032s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:59:14 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8bdfd9d-3140-4426-ac61-3449422d0bc5]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:59:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-058e62ae-c22e-48a0-ba7e-ceb30d094323 tempest-VolumeDependencyTests-217794804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94642597-f21c-480d-85ff-29d708879b6f {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:14 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-671f03ff-f9ac-4972-bcee-6cc6cc8bbcce tempest-ProjectMemberTests-1763329861 None] Acquiring lock "cinder-683726c4-871c-47f5-9618-cdec0c89a171-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:59:14 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-671f03ff-f9ac-4972-bcee-6cc6cc8bbcce tempest-ProjectMemberTests-1763329861 None] Lock "cinder-683726c4-871c-47f5-9618-cdec0c89a171-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:59:14 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-671f03ff-f9ac-4972-bcee-6cc6cc8bbcce tempest-ProjectMemberTests-1763329861 None] Acquiring lock "cinder-quobyte-683726c4-871c-47f5-9618-cdec0c89a171" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:59:14 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-671f03ff-f9ac-4972-bcee-6cc6cc8bbcce tempest-ProjectMemberTests-1763329861 None] Lock "cinder-quobyte-683726c4-871c-47f5-9618-cdec0c89a171" acquired by "delete_volume" :: waited 0.020s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:59:14 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[396f4342-b994-46da-9870-118badf8664c]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:59:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-671f03ff-f9ac-4972-bcee-6cc6cc8bbcce tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-683726c4-871c-47f5-9618-cdec0c89a171 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:14 devstack sudo[107238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94642597-f21c-480d-85ff-29d708879b6f Sep 04 22:59:14 devstack sudo[107238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:14 devstack sudo[107236]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3184693f-4ccb-430e-9b16-e3a715ae82dc tempest-ProjectReaderTests-144208897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-ab036d0e-f59e-4c04-ac58-6e235b64b039" returned: 0 in 0.481s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3184693f-4ccb-430e-9b16-e3a715ae82dc tempest-ProjectReaderTests-144208897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-ab036d0e-f59e-4c04-ac58-6e235b64b039 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:14 devstack sudo[107244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-ab036d0e-f59e-4c04-ac58-6e235b64b039 Sep 04 22:59:14 devstack sudo[107244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:15 devstack sudo[107243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-683726c4-871c-47f5-9618-cdec0c89a171 Sep 04 22:59:15 devstack sudo[107243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:15 devstack sudo[107238]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-058e62ae-c22e-48a0-ba7e-ceb30d094323 tempest-VolumeDependencyTests-217794804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94642597-f21c-480d-85ff-29d708879b6f" returned: 0 in 0.435s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-058e62ae-c22e-48a0-ba7e-ceb30d094323 tempest-VolumeDependencyTests-217794804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94642597-f21c-480d-85ff-29d708879b6f {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:15 devstack sudo[107251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94642597-f21c-480d-85ff-29d708879b6f Sep 04 22:59:15 devstack sudo[107251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:15 devstack sudo[107244]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3184693f-4ccb-430e-9b16-e3a715ae82dc tempest-ProjectReaderTests-144208897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-ab036d0e-f59e-4c04-ac58-6e235b64b039" returned: 0 in 0.290s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:15 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-3184693f-4ccb-430e-9b16-e3a715ae82dc tempest-ProjectReaderTests-144208897 None] Lock "cinder-quobyte-ab036d0e-f59e-4c04-ac58-6e235b64b039" released by "delete_volume" :: held 0.835s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:59:15 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-3184693f-4ccb-430e-9b16-e3a715ae82dc tempest-ProjectReaderTests-144208897 None] Created reservations ['65da3a20-fb35-4c37-8bde-61e012d9d848', '7663e1cd-51ec-47c6-bb6e-3a0c2966ef31', '6462b1c1-bb2d-468a-93d9-dce5cb0ea658', '52099e28-c322-4ff5-8fc2-042136bb603f'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:59:15 devstack sudo[107243]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-671f03ff-f9ac-4972-bcee-6cc6cc8bbcce tempest-ProjectMemberTests-1763329861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-683726c4-871c-47f5-9618-cdec0c89a171" returned: 0 in 0.527s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-671f03ff-f9ac-4972-bcee-6cc6cc8bbcce tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-683726c4-871c-47f5-9618-cdec0c89a171 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-3184693f-4ccb-430e-9b16-e3a715ae82dc tempest-ProjectReaderTests-144208897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:59:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-3184693f-4ccb-430e-9b16-e3a715ae82dc tempest-ProjectReaderTests-144208897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:59:15 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-3184693f-4ccb-430e-9b16-e3a715ae82dc tempest-ProjectReaderTests-144208897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:59:15 devstack sudo[107256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-683726c4-871c-47f5-9618-cdec0c89a171 Sep 04 22:59:15 devstack sudo[107256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:15 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-3184693f-4ccb-430e-9b16-e3a715ae82dc tempest-ProjectReaderTests-144208897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:59:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-3184693f-4ccb-430e-9b16-e3a715ae82dc tempest-ProjectReaderTests-144208897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:59:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3184693f-4ccb-430e-9b16-e3a715ae82dc tempest-ProjectReaderTests-144208897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:15 devstack sudo[107258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:59:15 devstack sudo[107258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:15 devstack sudo[107251]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-058e62ae-c22e-48a0-ba7e-ceb30d094323 tempest-VolumeDependencyTests-217794804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94642597-f21c-480d-85ff-29d708879b6f" returned: 0 in 0.449s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:15 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-058e62ae-c22e-48a0-ba7e-ceb30d094323 tempest-VolumeDependencyTests-217794804 None] Lock "cinder-quobyte-94642597-f21c-480d-85ff-29d708879b6f" released by "delete_volume" :: held 0.975s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:59:15 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-058e62ae-c22e-48a0-ba7e-ceb30d094323 tempest-VolumeDependencyTests-217794804 None] Created reservations ['eb0d4689-b7bc-42b8-a327-1f289289ab24', '5ae4a690-f57a-4d76-9220-43d15edb56ff', '9385a452-ae1c-4bd6-adb5-d43f7b279454', 'ad50db18-6d53-4624-b47f-13e51db1ddfd'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:59:15 devstack sudo[107256]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-671f03ff-f9ac-4972-bcee-6cc6cc8bbcce tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-683726c4-871c-47f5-9618-cdec0c89a171" returned: 0 in 0.424s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:15 devstack sudo[107258]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:15 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-671f03ff-f9ac-4972-bcee-6cc6cc8bbcce tempest-ProjectMemberTests-1763329861 None] Lock "cinder-quobyte-683726c4-871c-47f5-9618-cdec0c89a171" released by "delete_volume" :: held 1.019s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:59:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3184693f-4ccb-430e-9b16-e3a715ae82dc tempest-ProjectReaderTests-144208897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.408s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:15 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-3184693f-4ccb-430e-9b16-e3a715ae82dc tempest-ProjectReaderTests-144208897 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:59:15 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-3184693f-4ccb-430e-9b16-e3a715ae82dc tempest-ProjectReaderTests-144208897 None] Deleted volume successfully. Sep 04 22:59:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-058e62ae-c22e-48a0-ba7e-ceb30d094323 tempest-VolumeDependencyTests-217794804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:59:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-058e62ae-c22e-48a0-ba7e-ceb30d094323 tempest-VolumeDependencyTests-217794804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:59:15 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-058e62ae-c22e-48a0-ba7e-ceb30d094323 tempest-VolumeDependencyTests-217794804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:59:15 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-058e62ae-c22e-48a0-ba7e-ceb30d094323 tempest-VolumeDependencyTests-217794804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:59:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-058e62ae-c22e-48a0-ba7e-ceb30d094323 tempest-VolumeDependencyTests-217794804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:59:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-058e62ae-c22e-48a0-ba7e-ceb30d094323 tempest-VolumeDependencyTests-217794804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:16 devstack sudo[107263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:59:16 devstack sudo[107263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:16 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-3184693f-4ccb-430e-9b16-e3a715ae82dc tempest-ProjectReaderTests-144208897 None] Lock "cinder-ab036d0e-f59e-4c04-ac58-6e235b64b039-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:59:16 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-671f03ff-f9ac-4972-bcee-6cc6cc8bbcce tempest-ProjectMemberTests-1763329861 None] Created reservations ['44e30a54-d473-45a4-a842-c7f9fd9e02d7', 'a7ddd8ec-5d25-4a9e-9149-6ebcf70fbea5', 'f955330e-7b6f-4e9e-b494-8024b8d8a5c6', 'ba9eed8c-aff0-4425-9263-2f91281c73bb'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:59:16 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-671f03ff-f9ac-4972-bcee-6cc6cc8bbcce tempest-ProjectMemberTests-1763329861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:59:16 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-671f03ff-f9ac-4972-bcee-6cc6cc8bbcce tempest-ProjectMemberTests-1763329861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:59:16 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-671f03ff-f9ac-4972-bcee-6cc6cc8bbcce tempest-ProjectMemberTests-1763329861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:59:16 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-671f03ff-f9ac-4972-bcee-6cc6cc8bbcce tempest-ProjectMemberTests-1763329861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:59:16 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-671f03ff-f9ac-4972-bcee-6cc6cc8bbcce tempest-ProjectMemberTests-1763329861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:59:16 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-671f03ff-f9ac-4972-bcee-6cc6cc8bbcce tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:16 devstack sudo[107265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:59:16 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:16 devstack sudo[107263]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:16 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-058e62ae-c22e-48a0-ba7e-ceb30d094323 tempest-VolumeDependencyTests-217794804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.424s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:16 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-058e62ae-c22e-48a0-ba7e-ceb30d094323 tempest-VolumeDependencyTests-217794804 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:59:16 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-058e62ae-c22e-48a0-ba7e-ceb30d094323 tempest-VolumeDependencyTests-217794804 None] Deleted volume successfully. Sep 04 22:59:16 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-058e62ae-c22e-48a0-ba7e-ceb30d094323 tempest-VolumeDependencyTests-217794804 None] Lock "cinder-94642597-f21c-480d-85ff-29d708879b6f-delete_volume" released by "delete_volume" :: held 1.816s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:59:16 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:16 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-671f03ff-f9ac-4972-bcee-6cc6cc8bbcce tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.297s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:16 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-671f03ff-f9ac-4972-bcee-6cc6cc8bbcce tempest-ProjectMemberTests-1763329861 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:59:16 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-671f03ff-f9ac-4972-bcee-6cc6cc8bbcce tempest-ProjectMemberTests-1763329861 None] Deleted volume successfully. Sep 04 22:59:16 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-671f03ff-f9ac-4972-bcee-6cc6cc8bbcce tempest-ProjectMemberTests-1763329861 None] Lock "cinder-683726c4-871c-47f5-9618-cdec0c89a171-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:59:16 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f069476c-cf88-4997-be75-3bec01ec0866 tempest-VolumeDependencyTests-217794804 None] Acquiring lock "cinder-c842c2cc-9c95-4a94-b0a8-3acb35ff9435-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:59:16 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f069476c-cf88-4997-be75-3bec01ec0866 tempest-VolumeDependencyTests-217794804 None] Lock "cinder-c842c2cc-9c95-4a94-b0a8-3acb35ff9435-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:59:17 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f069476c-cf88-4997-be75-3bec01ec0866 tempest-VolumeDependencyTests-217794804 None] Acquiring lock "cinder-quobyte-c842c2cc-9c95-4a94-b0a8-3acb35ff9435" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:59:17 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f069476c-cf88-4997-be75-3bec01ec0866 tempest-VolumeDependencyTests-217794804 None] Lock "cinder-quobyte-c842c2cc-9c95-4a94-b0a8-3acb35ff9435" acquired by "delete_volume" :: waited 0.031s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:59:17 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[9846f71c-5c11-4ea6-ba73-95d4c5bfc041]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:59:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f069476c-cf88-4997-be75-3bec01ec0866 tempest-VolumeDependencyTests-217794804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c842c2cc-9c95-4a94-b0a8-3acb35ff9435 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:17 devstack sudo[107271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c842c2cc-9c95-4a94-b0a8-3acb35ff9435 Sep 04 22:59:17 devstack sudo[107271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:17 devstack cinder-volume[87576]: DEBUG dbcounter [-] [87576] Writing DB stats cinder:UPDATE=321,cinder:SELECT=223,cinder:DELETE=36,cinder:INSERT=76 {{(pid=87576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 22:59:17 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:59:17 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] Flow 'volume_create_manager' (ad6a7351-395b-48df-853c-67b6a88197bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:59:17 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddb994d1-56e3-4015-b05f-be451eceba99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:17 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddb994d1-56e3-4015-b05f-be451eceba99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:59:17Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6407670d-7458-4f74-aa0b-e4a1a3cfcd67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='062cd4574d244b10a48d42d74df6c65f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:59:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:59:17Z,use_quota=True,user_id='15c7f83da2c84bffb88780cf9a001510',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:17 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8be92f66-100e-437d-9804-23ab7a0fe7af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:17 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8be92f66-100e-437d-9804-23ab7a0fe7af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:17 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba8b3cb2-e1ba-491a-916c-f68d55b47dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:17 devstack cinder-volume[87576]: DEBUG cinder.image.glance [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] Creating Keystone auth plugin from conf {{(pid=87576) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 04 22:59:17 devstack sudo[107271]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f069476c-cf88-4997-be75-3bec01ec0866 tempest-VolumeDependencyTests-217794804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c842c2cc-9c95-4a94-b0a8-3acb35ff9435" returned: 0 in 0.636s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f069476c-cf88-4997-be75-3bec01ec0866 tempest-VolumeDependencyTests-217794804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c842c2cc-9c95-4a94-b0a8-3acb35ff9435 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:17 devstack sudo[107278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c842c2cc-9c95-4a94-b0a8-3acb35ff9435 Sep 04 22:59:17 devstack sudo[107278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:17 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a398ddf-5455-4af6-a26b-83880047d562 tempest-ProjectMemberTests-1763329861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:59:17 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2a398ddf-5455-4af6-a26b-83880047d562 tempest-ProjectMemberTests-1763329861 None] Flow 'volume_create_manager' (b0ec79bd-455a-4a2b-b932-4b886019a9bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:59:17 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2a398ddf-5455-4af6-a26b-83880047d562 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d5d7e13-b00f-4882-b830-bd52b77d9172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:17 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2a398ddf-5455-4af6-a26b-83880047d562 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d5d7e13-b00f-4882-b830-bd52b77d9172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:59:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1972863237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d61bd269-ea6a-43d8-9f97-535329fb33b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea67d0db23b2432187cdb39da7ed0530',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:59:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:59:18Z,use_quota=True,user_id='f2beadaff952455f8e8d8ab5cdc33aa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:17 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2a398ddf-5455-4af6-a26b-83880047d562 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e800ff64-2047-46ac-bd7f-960783dd2df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:17 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2a398ddf-5455-4af6-a26b-83880047d562 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e800ff64-2047-46ac-bd7f-960783dd2df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:17 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2a398ddf-5455-4af6-a26b-83880047d562 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de2c818d-f26e-483d-847d-423df1b2cbf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:17 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2a398ddf-5455-4af6-a26b-83880047d562 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de2c818d-f26e-483d-847d-423df1b2cbf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd61bd269-ea6a-43d8-9f97-535329fb33b7', 'volume_name': 'volume-d61bd269-ea6a-43d8-9f97-535329fb33b7', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:17 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2a398ddf-5455-4af6-a26b-83880047d562 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1ffc2d8-ba3e-4099-8ebd-8ed917ab3a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:17 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2a398ddf-5455-4af6-a26b-83880047d562 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1ffc2d8-ba3e-4099-8ebd-8ed917ab3a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:17 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2a398ddf-5455-4af6-a26b-83880047d562 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55fab23f-8148-4342-a333-fc7ba26b170c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:17 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-2a398ddf-5455-4af6-a26b-83880047d562 tempest-ProjectMemberTests-1763329861 None] Volume d61bd269-ea6a-43d8-9f97-535329fb33b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d61bd269-ea6a-43d8-9f97-535329fb33b7', 'volume_size': 1} Sep 04 22:59:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-2a398ddf-5455-4af6-a26b-83880047d562 tempest-ProjectMemberTests-1763329861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:59:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-2a398ddf-5455-4af6-a26b-83880047d562 tempest-ProjectMemberTests-1763329861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:59:17 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-2a398ddf-5455-4af6-a26b-83880047d562 tempest-ProjectMemberTests-1763329861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:59:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1972863237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d61bd269-ea6a-43d8-9f97-535329fb33b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea67d0db23b2432187cdb39da7ed0530',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:59:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:59:18Z,use_quota=True,user_id='f2beadaff952455f8e8d8ab5cdc33aa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:59:17 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-2a398ddf-5455-4af6-a26b-83880047d562 tempest-ProjectMemberTests-1763329861 None] Creating volume d61bd269-ea6a-43d8-9f97-535329fb33b7 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:59:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-2a398ddf-5455-4af6-a26b-83880047d562 tempest-ProjectMemberTests-1763329861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:59:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-2a398ddf-5455-4af6-a26b-83880047d562 tempest-ProjectMemberTests-1763329861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:59:17 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-2a398ddf-5455-4af6-a26b-83880047d562 tempest-ProjectMemberTests-1763329861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:59:17 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-2a398ddf-5455-4af6-a26b-83880047d562 tempest-ProjectMemberTests-1763329861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:59:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-2a398ddf-5455-4af6-a26b-83880047d562 tempest-ProjectMemberTests-1763329861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:59:17 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-2a398ddf-5455-4af6-a26b-83880047d562 tempest-ProjectMemberTests-1763329861 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:59:17 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-2a398ddf-5455-4af6-a26b-83880047d562 tempest-ProjectMemberTests-1763329861 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:59:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2a398ddf-5455-4af6-a26b-83880047d562 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d61bd269-ea6a-43d8-9f97-535329fb33b7 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:17 devstack sudo[107280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d61bd269-ea6a-43d8-9f97-535329fb33b7 1073741824 Sep 04 22:59:17 devstack sudo[107280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:18 devstack sudo[107278]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f069476c-cf88-4997-be75-3bec01ec0866 tempest-VolumeDependencyTests-217794804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c842c2cc-9c95-4a94-b0a8-3acb35ff9435" returned: 0 in 0.288s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:18 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f069476c-cf88-4997-be75-3bec01ec0866 tempest-VolumeDependencyTests-217794804 None] Lock "cinder-quobyte-c842c2cc-9c95-4a94-b0a8-3acb35ff9435" released by "delete_volume" :: held 0.991s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:59:18 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-f069476c-cf88-4997-be75-3bec01ec0866 tempest-VolumeDependencyTests-217794804 None] Created reservations ['138c66dd-2382-4fd6-90eb-45fa8148299a', '0bc9e5a5-41e0-40f9-ac6d-64c7a90febee', '17a49c31-b9f7-4f38-a203-c65dc90943a3', 'bf2d6a65-ba11-406b-97ce-a3c3d9ec7086'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:59:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f069476c-cf88-4997-be75-3bec01ec0866 tempest-VolumeDependencyTests-217794804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:59:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f069476c-cf88-4997-be75-3bec01ec0866 tempest-VolumeDependencyTests-217794804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:59:18 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-f069476c-cf88-4997-be75-3bec01ec0866 tempest-VolumeDependencyTests-217794804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:59:18 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-f069476c-cf88-4997-be75-3bec01ec0866 tempest-VolumeDependencyTests-217794804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:59:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f069476c-cf88-4997-be75-3bec01ec0866 tempest-VolumeDependencyTests-217794804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:59:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f069476c-cf88-4997-be75-3bec01ec0866 tempest-VolumeDependencyTests-217794804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:18 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba8b3cb2-e1ba-491a-916c-f68d55b47dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6407670d-7458-4f74-aa0b-e4a1a3cfcd67', 'volume_name': 'volume-6407670d-7458-4f74-aa0b-e4a1a3cfcd67', 'volume_size': 1, 'image_id': 'e916e8ec-9a45-4598-855e-31add2a450e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e916e8ec-9a45-4598-855e-31add2a450e1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '06d3893e0f2e0c5363d6117f1ce66a65', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '062cd4574d244b10a48d42d74df6c65f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '124d2ec4578c66f135540580e81d279da42bd09156cf0f2a85dda41fea4533bfa8bfcaa33d7ba862529d00e6ae8677592ef091eeb307142dc75c21ae8f128674', 'id': 'e916e8ec-9a45-4598-855e-31add2a450e1', 'created_at': datetime.datetime(2026, 9, 4, 20, 59, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 20, 59, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e916e8ec-9a45-4598-855e-31add2a450e1/file', 'properties': {}}, 'image_service': }' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:18 devstack sudo[107286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:59:18 devstack sudo[107286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:18 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3004970-c2d5-4567-aac2-19344e1d43f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:18 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3004970-c2d5-4567-aac2-19344e1d43f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:18 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d90ee15-1135-45dd-bb5c-be2f3f1d6f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:18 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] Volume 6407670d-7458-4f74-aa0b-e4a1a3cfcd67: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6407670d-7458-4f74-aa0b-e4a1a3cfcd67', 'volume_size': 1, 'image_id': 'e916e8ec-9a45-4598-855e-31add2a450e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e916e8ec-9a45-4598-855e-31add2a450e1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '06d3893e0f2e0c5363d6117f1ce66a65', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '062cd4574d244b10a48d42d74df6c65f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '124d2ec4578c66f135540580e81d279da42bd09156cf0f2a85dda41fea4533bfa8bfcaa33d7ba862529d00e6ae8677592ef091eeb307142dc75c21ae8f128674', 'id': 'e916e8ec-9a45-4598-855e-31add2a450e1', 'created_at': datetime.datetime(2026, 9, 4, 20, 59, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 20, 59, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e916e8ec-9a45-4598-855e-31add2a450e1/file', 'properties': {}}, 'image_service': } Sep 04 22:59:18 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] Trying to clone 6407670d-7458-4f74-aa0b-e4a1a3cfcd67 from image e916e8ec-9a45-4598-855e-31add2a450e1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e916e8ec-9a45-4598-855e-31add2a450e1', 'metadata': {}}]). {{(pid=87576) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 04 22:59:18 devstack sudo[107280]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:18 devstack cinder-volume[87576]: DEBUG cinder.image.image_utils [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e916e8ec-9a45-4598-855e-31add2a450e1_7inzupnkdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87576) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 04 22:59:18 devstack cinder-volume[87576]: INFO cinder.image.image_utils [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] Image download 0.00 MB at 0.00 MB/s Sep 04 22:59:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2a398ddf-5455-4af6-a26b-83880047d562 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d61bd269-ea6a-43d8-9f97-535329fb33b7 1073741824" returned: 0 in 0.513s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2a398ddf-5455-4af6-a26b-83880047d562 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d61bd269-ea6a-43d8-9f97-535329fb33b7 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:18 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[417712c0-65cd-4feb-97c6-af2c4501edf7]: (4, 'raw') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:59:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e916e8ec-9a45-4598-855e-31add2a450e1_7inzupnkdevstack@QuobyteHD {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:18 devstack sudo[107289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d61bd269-ea6a-43d8-9f97-535329fb33b7 Sep 04 22:59:18 devstack sudo[107289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:18 devstack sudo[107286]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f069476c-cf88-4997-be75-3bec01ec0866 tempest-VolumeDependencyTests-217794804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.290s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:18 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-f069476c-cf88-4997-be75-3bec01ec0866 tempest-VolumeDependencyTests-217794804 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:59:18 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-f069476c-cf88-4997-be75-3bec01ec0866 tempest-VolumeDependencyTests-217794804 None] Deleted volume successfully. Sep 04 22:59:18 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f069476c-cf88-4997-be75-3bec01ec0866 tempest-VolumeDependencyTests-217794804 None] Lock "cinder-c842c2cc-9c95-4a94-b0a8-3acb35ff9435-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:59:18 devstack sudo[107291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e916e8ec-9a45-4598-855e-31add2a450e1_7inzupnkdevstack@QuobyteHD Sep 04 22:59:18 devstack sudo[107291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:18 devstack sudo[107289]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2a398ddf-5455-4af6-a26b-83880047d562 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d61bd269-ea6a-43d8-9f97-535329fb33b7" returned: 0 in 0.255s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:18 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-2a398ddf-5455-4af6-a26b-83880047d562 tempest-ProjectMemberTests-1763329861 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:59:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-2a398ddf-5455-4af6-a26b-83880047d562 tempest-ProjectMemberTests-1763329861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:59:18 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2a398ddf-5455-4af6-a26b-83880047d562 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55fab23f-8148-4342-a333-fc7ba26b170c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d61bd269-ea6a-43d8-9f97-535329fb33b7', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:18 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2a398ddf-5455-4af6-a26b-83880047d562 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3de7a549-d03b-4567-b86b-95c24c0f4c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:18 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-2a398ddf-5455-4af6-a26b-83880047d562 tempest-ProjectMemberTests-1763329861 None] Volume volume-d61bd269-ea6a-43d8-9f97-535329fb33b7 (d61bd269-ea6a-43d8-9f97-535329fb33b7): created successfully Sep 04 22:59:18 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2a398ddf-5455-4af6-a26b-83880047d562 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3de7a549-d03b-4567-b86b-95c24c0f4c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:18 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2a398ddf-5455-4af6-a26b-83880047d562 tempest-ProjectMemberTests-1763329861 None] Flow 'volume_create_manager' (b0ec79bd-455a-4a2b-b932-4b886019a9bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:59:18 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-2a398ddf-5455-4af6-a26b-83880047d562 tempest-ProjectMemberTests-1763329861 None] Created volume successfully. Sep 04 22:59:18 devstack sudo[107291]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e916e8ec-9a45-4598-855e-31add2a450e1_7inzupnkdevstack@QuobyteHD" returned: 0 in 0.335s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e916e8ec-9a45-4598-855e-31add2a450e1_7inzupnkdevstack@QuobyteHD {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:18 devstack sudo[107297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e916e8ec-9a45-4598-855e-31add2a450e1_7inzupnkdevstack@QuobyteHD Sep 04 22:59:18 devstack sudo[107297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:19 devstack sudo[107297]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:19 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e916e8ec-9a45-4598-855e-31add2a450e1_7inzupnkdevstack@QuobyteHD" returned: 1 in 0.312s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:19 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e916e8ec-9a45-4598-855e-31add2a450e1_7inzupnkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 22:59:19 devstack cinder-volume[87576]: DEBUG cinder.image.image_utils [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] Temporary image e916e8ec-9a45-4598-855e-31add2a450e1 is fetched for user 15c7f83da2c84bffb88780cf9a001510. {{(pid=87576) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 04 22:59:19 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[2126e26f-2000-443a-884d-d33be684d489]: (4, 'raw') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:59:19 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e916e8ec-9a45-4598-855e-31add2a450e1_7inzupnkdevstack@QuobyteHD {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:19 devstack sudo[107302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e916e8ec-9a45-4598-855e-31add2a450e1_7inzupnkdevstack@QuobyteHD Sep 04 22:59:19 devstack sudo[107302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:19 devstack sudo[107302]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:19 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e916e8ec-9a45-4598-855e-31add2a450e1_7inzupnkdevstack@QuobyteHD" returned: 0 in 0.341s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:19 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e916e8ec-9a45-4598-855e-31add2a450e1_7inzupnkdevstack@QuobyteHD {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:19 devstack sudo[107306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e916e8ec-9a45-4598-855e-31add2a450e1_7inzupnkdevstack@QuobyteHD Sep 04 22:59:19 devstack sudo[107306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:19 devstack sudo[107306]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:19 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e916e8ec-9a45-4598-855e-31add2a450e1_7inzupnkdevstack@QuobyteHD" returned: 1 in 0.344s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:19 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e916e8ec-9a45-4598-855e-31add2a450e1_7inzupnkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 22:59:19 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:59:19 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:59:19 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:59:17Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6407670d-7458-4f74-aa0b-e4a1a3cfcd67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='062cd4574d244b10a48d42d74df6c65f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:59:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:59:17Z,use_quota=True,user_id='15c7f83da2c84bffb88780cf9a001510',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:59:19 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] Creating volume 6407670d-7458-4f74-aa0b-e4a1a3cfcd67 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:59:19 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:59:19 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:59:19 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:59:19 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:59:19 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:59:19 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:59:19 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:59:19 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6407670d-7458-4f74-aa0b-e4a1a3cfcd67 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:19 devstack sudo[107311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6407670d-7458-4f74-aa0b-e4a1a3cfcd67 1073741824 Sep 04 22:59:19 devstack sudo[107311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:19 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-a165454d-16b3-45c6-bca0-f46d591e1685 tempest-ProjectMemberTests-1763329861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:59:20 devstack sudo[107311]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6407670d-7458-4f74-aa0b-e4a1a3cfcd67 1073741824" returned: 0 in 0.497s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6407670d-7458-4f74-aa0b-e4a1a3cfcd67 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:20 devstack sudo[107317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6407670d-7458-4f74-aa0b-e4a1a3cfcd67 Sep 04 22:59:20 devstack sudo[107317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:20 devstack sudo[107317]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6407670d-7458-4f74-aa0b-e4a1a3cfcd67" returned: 0 in 0.300s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:20 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:59:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:59:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-a165454d-16b3-45c6-bca0-f46d591e1685 tempest-ProjectMemberTests-1763329861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.769s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:59:20 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-a165454d-16b3-45c6-bca0-f46d591e1685 tempest-ProjectMemberTests-1763329861 None] Creating offline snapshot a0936cb5-5512-4ba8-ab2d-44470629bb15 of volume d61bd269-ea6a-43d8-9f97-535329fb33b7 {{(pid=87576) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 22:59:20 devstack cinder-volume[87576]: DEBUG cinder.volume.volume_utils [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] Attempting download of e916e8ec-9a45-4598-855e-31add2a450e1 ((None, [{'url': 'file:///opt/stack/data/glance/images/e916e8ec-9a45-4598-855e-31add2a450e1', 'metadata': {}}])) to volume 6407670d-7458-4f74-aa0b-e4a1a3cfcd67. {{(pid=87576) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 04 22:59:20 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae51e988-5760-4909-8f59-5488df7c1ad9]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:59:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a165454d-16b3-45c6-bca0-f46d591e1685 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d61bd269-ea6a-43d8-9f97-535329fb33b7 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:20 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[34940afc-c231-45fc-90af-50189fbb09b0]: (4, 'raw') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:59:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e916e8ec-9a45-4598-855e-31add2a450e1_cw85sebd {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:20 devstack sudo[107320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d61bd269-ea6a-43d8-9f97-535329fb33b7 Sep 04 22:59:20 devstack sudo[107320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:20 devstack sudo[107321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e916e8ec-9a45-4598-855e-31add2a450e1_cw85sebd Sep 04 22:59:20 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:21 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e916e8ec-9a45-4598-855e-31add2a450e1_cw85sebd" returned: 0 in 0.353s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e916e8ec-9a45-4598-855e-31add2a450e1_cw85sebd {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:21 devstack sudo[107320]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a165454d-16b3-45c6-bca0-f46d591e1685 tempest-ProjectMemberTests-1763329861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d61bd269-ea6a-43d8-9f97-535329fb33b7" returned: 0 in 0.423s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a165454d-16b3-45c6-bca0-f46d591e1685 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d61bd269-ea6a-43d8-9f97-535329fb33b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d61bd269-ea6a-43d8-9f97-535329fb33b7.a0936cb5-5512-4ba8-ab2d-44470629bb15 1G {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:21 devstack sudo[107330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d61bd269-ea6a-43d8-9f97-535329fb33b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d61bd269-ea6a-43d8-9f97-535329fb33b7.a0936cb5-5512-4ba8-ab2d-44470629bb15 1G Sep 04 22:59:21 devstack sudo[107330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:21 devstack sudo[107329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e916e8ec-9a45-4598-855e-31add2a450e1_cw85sebd Sep 04 22:59:21 devstack sudo[107329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:21 devstack sudo[107329]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e916e8ec-9a45-4598-855e-31add2a450e1_cw85sebd" returned: 1 in 0.341s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e916e8ec-9a45-4598-855e-31add2a450e1_cw85sebd' failed. Not Retrying. {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 22:59:21 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[904c1613-4e7b-439a-9fca-d5ab417dc42d]: (4, 'raw') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:59:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e916e8ec-9a45-4598-855e-31add2a450e1_7inzupnkdevstack@QuobyteHD {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:21 devstack sudo[107330]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a165454d-16b3-45c6-bca0-f46d591e1685 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d61bd269-ea6a-43d8-9f97-535329fb33b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d61bd269-ea6a-43d8-9f97-535329fb33b7.a0936cb5-5512-4ba8-ab2d-44470629bb15 1G" returned: 0 in 0.430s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a165454d-16b3-45c6-bca0-f46d591e1685 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d61bd269-ea6a-43d8-9f97-535329fb33b7 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d61bd269-ea6a-43d8-9f97-535329fb33b7.a0936cb5-5512-4ba8-ab2d-44470629bb15 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:21 devstack sudo[107339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e916e8ec-9a45-4598-855e-31add2a450e1_7inzupnkdevstack@QuobyteHD Sep 04 22:59:21 devstack sudo[107339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:21 devstack sudo[107341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d61bd269-ea6a-43d8-9f97-535329fb33b7 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d61bd269-ea6a-43d8-9f97-535329fb33b7.a0936cb5-5512-4ba8-ab2d-44470629bb15 Sep 04 22:59:21 devstack sudo[107341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:21 devstack sudo[107339]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e916e8ec-9a45-4598-855e-31add2a450e1_7inzupnkdevstack@QuobyteHD" returned: 0 in 0.347s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e916e8ec-9a45-4598-855e-31add2a450e1_7inzupnkdevstack@QuobyteHD {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:21 devstack sudo[107341]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a165454d-16b3-45c6-bca0-f46d591e1685 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d61bd269-ea6a-43d8-9f97-535329fb33b7 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d61bd269-ea6a-43d8-9f97-535329fb33b7.a0936cb5-5512-4ba8-ab2d-44470629bb15" returned: 0 in 0.315s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:21 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-a165454d-16b3-45c6-bca0-f46d591e1685 tempest-ProjectMemberTests-1763329861 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d61bd269-ea6a-43d8-9f97-535329fb33b7.a0936cb5-5512-4ba8-ab2d-44470629bb15 is being set with open permissions: ugo+rw Sep 04 22:59:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a165454d-16b3-45c6-bca0-f46d591e1685 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d61bd269-ea6a-43d8-9f97-535329fb33b7.a0936cb5-5512-4ba8-ab2d-44470629bb15 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:21 devstack sudo[107347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e916e8ec-9a45-4598-855e-31add2a450e1_7inzupnkdevstack@QuobyteHD Sep 04 22:59:21 devstack sudo[107347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:21 devstack sudo[107349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d61bd269-ea6a-43d8-9f97-535329fb33b7.a0936cb5-5512-4ba8-ab2d-44470629bb15 Sep 04 22:59:22 devstack sudo[107349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:22 devstack sudo[107349]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:22 devstack sudo[107347]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a165454d-16b3-45c6-bca0-f46d591e1685 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d61bd269-ea6a-43d8-9f97-535329fb33b7.a0936cb5-5512-4ba8-ab2d-44470629bb15" returned: 0 in 0.262s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e916e8ec-9a45-4598-855e-31add2a450e1_7inzupnkdevstack@QuobyteHD" returned: 1 in 0.351s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e916e8ec-9a45-4598-855e-31add2a450e1_7inzupnkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 22:59:22 devstack cinder-volume[87576]: DEBUG cinder.image.image_utils [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] e916e8ec-9a45-4598-855e-31add2a450e1 was raw, converting to qcow2 {{(pid=87576) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 04 22:59:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e916e8ec-9a45-4598-855e-31add2a450e1_7inzupnkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6407670d-7458-4f74-aa0b-e4a1a3cfcd67 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:22 devstack sudo[107356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e916e8ec-9a45-4598-855e-31add2a450e1_7inzupnkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6407670d-7458-4f74-aa0b-e4a1a3cfcd67 Sep 04 22:59:22 devstack sudo[107356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a165454d-16b3-45c6-bca0-f46d591e1685 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d61bd269-ea6a-43d8-9f97-535329fb33b7.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:22 devstack sudo[107358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d61bd269-ea6a-43d8-9f97-535329fb33b7.info Sep 04 22:59:22 devstack sudo[107358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:22 devstack sudo[107358]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a165454d-16b3-45c6-bca0-f46d591e1685 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d61bd269-ea6a-43d8-9f97-535329fb33b7.info" returned: 0 in 0.291s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:22 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-a165454d-16b3-45c6-bca0-f46d591e1685 tempest-ProjectMemberTests-1763329861 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d61bd269-ea6a-43d8-9f97-535329fb33b7.info is being set with open permissions: ugo+rw Sep 04 22:59:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a165454d-16b3-45c6-bca0-f46d591e1685 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d61bd269-ea6a-43d8-9f97-535329fb33b7.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:22 devstack sudo[107364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d61bd269-ea6a-43d8-9f97-535329fb33b7.info Sep 04 22:59:22 devstack sudo[107364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:22 devstack sudo[107356]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e916e8ec-9a45-4598-855e-31add2a450e1_7inzupnkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6407670d-7458-4f74-aa0b-e4a1a3cfcd67" returned: 0 in 0.500s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:22 devstack cinder-volume[87576]: DEBUG cinder.image.image_utils [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e916e8ec-9a45-4598-855e-31add2a450e1_7inzupnkdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6407670d-7458-4f74-aa0b-e4a1a3cfcd67 {{(pid=87576) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 22:59:22 devstack cinder-volume[87576]: INFO cinder.image.image_utils [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] Converted 0.00 MB image at 0.00 MB/s Sep 04 22:59:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6407670d-7458-4f74-aa0b-e4a1a3cfcd67 1G {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:22 devstack sudo[107367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6407670d-7458-4f74-aa0b-e4a1a3cfcd67 1G Sep 04 22:59:22 devstack sudo[107367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:22 devstack sudo[107364]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a165454d-16b3-45c6-bca0-f46d591e1685 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d61bd269-ea6a-43d8-9f97-535329fb33b7.info" returned: 0 in 0.280s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-a165454d-16b3-45c6-bca0-f46d591e1685 tempest-ProjectMemberTests-1763329861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.121s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:59:22 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-a165454d-16b3-45c6-bca0-f46d591e1685 tempest-ProjectMemberTests-1763329861 None] Create snapshot completed successfully Sep 04 22:59:23 devstack sudo[107367]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6407670d-7458-4f74-aa0b-e4a1a3cfcd67 1G" returned: 0 in 0.340s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:23 devstack cinder-volume[87576]: DEBUG cinder.volume.volume_utils [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] Downloaded image e916e8ec-9a45-4598-855e-31add2a450e1 ((None, [{'url': 'file:///opt/stack/data/glance/images/e916e8ec-9a45-4598-855e-31add2a450e1', 'metadata': {}}])) to volume 6407670d-7458-4f74-aa0b-e4a1a3cfcd67 successfully. {{(pid=87576) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 04 22:59:23 devstack cinder-volume[87576]: DEBUG cinder.image.image_utils [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] Temporary image e916e8ec-9a45-4598-855e-31add2a450e1 for user 15c7f83da2c84bffb88780cf9a001510 is deleted. {{(pid=87576) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 04 22:59:23 devstack cinder-volume[87576]: DEBUG cinder.volume.volume_utils [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] Marking volume 6407670d-7458-4f74-aa0b-e4a1a3cfcd67 as bootable. {{(pid=87576) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 04 22:59:23 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] Copying metadata from image e916e8ec-9a45-4598-855e-31add2a450e1 to 6407670d-7458-4f74-aa0b-e4a1a3cfcd67. {{(pid=87576) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 04 22:59:23 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] Creating volume glance metadata for volume 6407670d-7458-4f74-aa0b-e4a1a3cfcd67 backed by image e916e8ec-9a45-4598-855e-31add2a450e1 with: {'image_id': 'e916e8ec-9a45-4598-855e-31add2a450e1', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '06d3893e0f2e0c5363d6117f1ce66a65', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87576) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 04 22:59:23 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-1cd3c988-7b4d-4f0f-b999-3ef2bd734d65 tempest-ProjectMemberTests-1763329861 None] Acquiring lock "cinder-a0936cb5-5512-4ba8-ab2d-44470629bb15-delete_snapshot" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:59:23 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-1cd3c988-7b4d-4f0f-b999-3ef2bd734d65 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-a0936cb5-5512-4ba8-ab2d-44470629bb15-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:59:23 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-1cd3c988-7b4d-4f0f-b999-3ef2bd734d65 tempest-ProjectMemberTests-1763329861 None] Acquiring lock "cinder-quobyte-d61bd269-ea6a-43d8-9f97-535329fb33b7" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:59:23 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-1cd3c988-7b4d-4f0f-b999-3ef2bd734d65 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-quobyte-d61bd269-ea6a-43d8-9f97-535329fb33b7" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:59:23 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-1cd3c988-7b4d-4f0f-b999-3ef2bd734d65 tempest-ProjectMemberTests-1763329861 None] Acquiring lock "cinder-quobyte-a0936cb5-5512-4ba8-ab2d-44470629bb15" by "_delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:59:23 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d90ee15-1135-45dd-bb5c-be2f3f1d6f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6407670d-7458-4f74-aa0b-e4a1a3cfcd67', 'volume_size': 1, 'image_id': 'e916e8ec-9a45-4598-855e-31add2a450e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e916e8ec-9a45-4598-855e-31add2a450e1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '06d3893e0f2e0c5363d6117f1ce66a65', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '062cd4574d244b10a48d42d74df6c65f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '124d2ec4578c66f135540580e81d279da42bd09156cf0f2a85dda41fea4533bfa8bfcaa33d7ba862529d00e6ae8677592ef091eeb307142dc75c21ae8f128674', 'id': 'e916e8ec-9a45-4598-855e-31add2a450e1', 'created_at': datetime.datetime(2026, 9, 4, 20, 59, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 20, 59, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e916e8ec-9a45-4598-855e-31add2a450e1/file', 'properties': {}}, 'image_service': }' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:23 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b134889-f730-4a7d-8b34-0f2990af4ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:23 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-1cd3c988-7b4d-4f0f-b999-3ef2bd734d65 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-quobyte-a0936cb5-5512-4ba8-ab2d-44470629bb15" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:59:23 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-1cd3c988-7b4d-4f0f-b999-3ef2bd734d65 tempest-ProjectMemberTests-1763329861 None] Deleting offline snapshot a0936cb5-5512-4ba8-ab2d-44470629bb15 of volume d61bd269-ea6a-43d8-9f97-535329fb33b7 {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 22:59:23 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-1cd3c988-7b4d-4f0f-b999-3ef2bd734d65 tempest-ProjectMemberTests-1763329861 None] snapshot_file for this snap is: volume-d61bd269-ea6a-43d8-9f97-535329fb33b7.a0936cb5-5512-4ba8-ab2d-44470629bb15 {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 22:59:23 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] Volume volume-6407670d-7458-4f74-aa0b-e4a1a3cfcd67 (6407670d-7458-4f74-aa0b-e4a1a3cfcd67): created successfully Sep 04 22:59:23 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b134889-f730-4a7d-8b34-0f2990af4ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:23 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] Flow 'volume_create_manager' (ad6a7351-395b-48df-853c-67b6a88197bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:59:23 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad1aa96-1e13-420d-b74e-2339a7e45714]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:59:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-1cd3c988-7b4d-4f0f-b999-3ef2bd734d65 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d61bd269-ea6a-43d8-9f97-535329fb33b7.a0936cb5-5512-4ba8-ab2d-44470629bb15 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:23 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-3e5029dd-9838-4341-b418-464321fa32c5 tempest-VolumeImageDependencyTests-1306820959 None] Created volume successfully. Sep 04 22:59:23 devstack sudo[107375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d61bd269-ea6a-43d8-9f97-535329fb33b7.a0936cb5-5512-4ba8-ab2d-44470629bb15 Sep 04 22:59:23 devstack sudo[107375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:23 devstack sudo[107375]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-1cd3c988-7b4d-4f0f-b999-3ef2bd734d65 tempest-ProjectMemberTests-1763329861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d61bd269-ea6a-43d8-9f97-535329fb33b7.a0936cb5-5512-4ba8-ab2d-44470629bb15" returned: 0 in 0.373s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:23 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-1cd3c988-7b4d-4f0f-b999-3ef2bd734d65 tempest-ProjectMemberTests-1763329861 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d61bd269-ea6a-43d8-9f97-535329fb33b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 22:59:23 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3649013-2de5-4c6c-b65d-3dcdb41dcc8f]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:59:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-1cd3c988-7b4d-4f0f-b999-3ef2bd734d65 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d61bd269-ea6a-43d8-9f97-535329fb33b7 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:23 devstack sudo[107380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d61bd269-ea6a-43d8-9f97-535329fb33b7 Sep 04 22:59:23 devstack sudo[107380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:23 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-b628bb6b-e138-4df4-bf32-3a77da473dfc tempest-VolumeImageDependencyTests-1306820959 None] Acquiring lock "cinder-6407670d-7458-4f74-aa0b-e4a1a3cfcd67-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:59:23 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-b628bb6b-e138-4df4-bf32-3a77da473dfc tempest-VolumeImageDependencyTests-1306820959 None] Lock "cinder-6407670d-7458-4f74-aa0b-e4a1a3cfcd67-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:59:23 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-b628bb6b-e138-4df4-bf32-3a77da473dfc tempest-VolumeImageDependencyTests-1306820959 None] Acquiring lock "cinder-quobyte-6407670d-7458-4f74-aa0b-e4a1a3cfcd67" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:59:23 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-b628bb6b-e138-4df4-bf32-3a77da473dfc tempest-VolumeImageDependencyTests-1306820959 None] Lock "cinder-quobyte-6407670d-7458-4f74-aa0b-e4a1a3cfcd67" acquired by "delete_volume" :: waited 0.015s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:59:23 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bbc5f65-9a12-48a5-a7be-87f319d7e74f]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:59:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b628bb6b-e138-4df4-bf32-3a77da473dfc tempest-VolumeImageDependencyTests-1306820959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6407670d-7458-4f74-aa0b-e4a1a3cfcd67 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:24 devstack sudo[107382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6407670d-7458-4f74-aa0b-e4a1a3cfcd67 Sep 04 22:59:24 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:24 devstack sudo[107380]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-1cd3c988-7b4d-4f0f-b999-3ef2bd734d65 tempest-ProjectMemberTests-1763329861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d61bd269-ea6a-43d8-9f97-535329fb33b7" returned: 0 in 0.399s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-1cd3c988-7b4d-4f0f-b999-3ef2bd734d65 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d61bd269-ea6a-43d8-9f97-535329fb33b7.a0936cb5-5512-4ba8-ab2d-44470629bb15 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:24 devstack sudo[107387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d61bd269-ea6a-43d8-9f97-535329fb33b7.a0936cb5-5512-4ba8-ab2d-44470629bb15 Sep 04 22:59:24 devstack sudo[107387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:24 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b628bb6b-e138-4df4-bf32-3a77da473dfc tempest-VolumeImageDependencyTests-1306820959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6407670d-7458-4f74-aa0b-e4a1a3cfcd67" returned: 0 in 0.388s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b628bb6b-e138-4df4-bf32-3a77da473dfc tempest-VolumeImageDependencyTests-1306820959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6407670d-7458-4f74-aa0b-e4a1a3cfcd67 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:24 devstack sudo[107394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6407670d-7458-4f74-aa0b-e4a1a3cfcd67 Sep 04 22:59:24 devstack sudo[107394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:24 devstack sudo[107387]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-1cd3c988-7b4d-4f0f-b999-3ef2bd734d65 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d61bd269-ea6a-43d8-9f97-535329fb33b7.a0936cb5-5512-4ba8-ab2d-44470629bb15" returned: 0 in 0.378s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-1cd3c988-7b4d-4f0f-b999-3ef2bd734d65 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d61bd269-ea6a-43d8-9f97-535329fb33b7.a0936cb5-5512-4ba8-ab2d-44470629bb15 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:24 devstack sudo[107397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d61bd269-ea6a-43d8-9f97-535329fb33b7.a0936cb5-5512-4ba8-ab2d-44470629bb15 Sep 04 22:59:24 devstack sudo[107397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:24 devstack sudo[107394]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b628bb6b-e138-4df4-bf32-3a77da473dfc tempest-VolumeImageDependencyTests-1306820959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-6407670d-7458-4f74-aa0b-e4a1a3cfcd67" returned: 0 in 0.259s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:24 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-b628bb6b-e138-4df4-bf32-3a77da473dfc tempest-VolumeImageDependencyTests-1306820959 None] Lock "cinder-quobyte-6407670d-7458-4f74-aa0b-e4a1a3cfcd67" released by "delete_volume" :: held 0.707s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:59:24 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-b628bb6b-e138-4df4-bf32-3a77da473dfc tempest-VolumeImageDependencyTests-1306820959 None] Created reservations ['ce5d2092-d025-4ab9-8ebc-82c8e0a064f8', 'f0e5487d-fd6f-48cb-b7f2-80ba800c880b', 'ed44684c-fe43-4f50-b729-5b2794e11568', '50b77a1a-cbf4-48b6-b098-6eb1068b291b'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:59:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-b628bb6b-e138-4df4-bf32-3a77da473dfc tempest-VolumeImageDependencyTests-1306820959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:59:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-b628bb6b-e138-4df4-bf32-3a77da473dfc tempest-VolumeImageDependencyTests-1306820959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:59:24 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-b628bb6b-e138-4df4-bf32-3a77da473dfc tempest-VolumeImageDependencyTests-1306820959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:59:24 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-b628bb6b-e138-4df4-bf32-3a77da473dfc tempest-VolumeImageDependencyTests-1306820959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:59:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-b628bb6b-e138-4df4-bf32-3a77da473dfc tempest-VolumeImageDependencyTests-1306820959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:59:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b628bb6b-e138-4df4-bf32-3a77da473dfc tempest-VolumeImageDependencyTests-1306820959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:24 devstack sudo[107397]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-1cd3c988-7b4d-4f0f-b999-3ef2bd734d65 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d61bd269-ea6a-43d8-9f97-535329fb33b7.a0936cb5-5512-4ba8-ab2d-44470629bb15" returned: 0 in 0.328s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:24 devstack sudo[107401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:59:24 devstack sudo[107401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:24 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-1cd3c988-7b4d-4f0f-b999-3ef2bd734d65 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-quobyte-a0936cb5-5512-4ba8-ab2d-44470629bb15" released by "_delete_snapshot" :: held 1.616s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:59:24 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-1cd3c988-7b4d-4f0f-b999-3ef2bd734d65 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-quobyte-d61bd269-ea6a-43d8-9f97-535329fb33b7" released by "delete_snapshot" :: held 1.665s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:59:24 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-1cd3c988-7b4d-4f0f-b999-3ef2bd734d65 tempest-ProjectMemberTests-1763329861 None] Created reservations ['6f4741d6-d9c3-48ba-8202-8678a484884f', 'a36ce2f6-3ba4-4970-afa0-286b5559f611', 'f8d29518-00c7-4fc6-9cfa-9555a22ac216', 'a6bf6050-e07a-44d3-ab65-e6742b2b78e1'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:59:25 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-1cd3c988-7b4d-4f0f-b999-3ef2bd734d65 tempest-ProjectMemberTests-1763329861 None] Delete snapshot completed successfully. Sep 04 22:59:25 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-1cd3c988-7b4d-4f0f-b999-3ef2bd734d65 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-a0936cb5-5512-4ba8-ab2d-44470629bb15-delete_snapshot" released by "delete_snapshot" :: held 1.848s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:59:25 devstack sudo[107401]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b628bb6b-e138-4df4-bf32-3a77da473dfc tempest-VolumeImageDependencyTests-1306820959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.281s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:25 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-b628bb6b-e138-4df4-bf32-3a77da473dfc tempest-VolumeImageDependencyTests-1306820959 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:59:25 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-b628bb6b-e138-4df4-bf32-3a77da473dfc tempest-VolumeImageDependencyTests-1306820959 None] Deleted volume successfully. Sep 04 22:59:25 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-b628bb6b-e138-4df4-bf32-3a77da473dfc tempest-VolumeImageDependencyTests-1306820959 None] Lock "cinder-6407670d-7458-4f74-aa0b-e4a1a3cfcd67-delete_volume" released by "delete_volume" :: held 1.228s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:59:25 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-88940295-9b5a-4b06-816e-491cff65154f tempest-ProjectMemberTests-1763329861 None] Acquiring lock "cinder-d61bd269-ea6a-43d8-9f97-535329fb33b7-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:59:25 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-88940295-9b5a-4b06-816e-491cff65154f tempest-ProjectMemberTests-1763329861 None] Lock "cinder-d61bd269-ea6a-43d8-9f97-535329fb33b7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:59:25 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-88940295-9b5a-4b06-816e-491cff65154f tempest-ProjectMemberTests-1763329861 None] Acquiring lock "cinder-quobyte-d61bd269-ea6a-43d8-9f97-535329fb33b7" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:59:25 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-88940295-9b5a-4b06-816e-491cff65154f tempest-ProjectMemberTests-1763329861 None] Lock "cinder-quobyte-d61bd269-ea6a-43d8-9f97-535329fb33b7" acquired by "delete_volume" :: waited 0.022s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:59:25 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0b7fbc-37ca-4748-b8ed-8e746f2cfbec]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:59:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-88940295-9b5a-4b06-816e-491cff65154f tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d61bd269-ea6a-43d8-9f97-535329fb33b7 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:25 devstack sudo[107404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d61bd269-ea6a-43d8-9f97-535329fb33b7 Sep 04 22:59:25 devstack sudo[107404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:25 devstack sudo[107404]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-88940295-9b5a-4b06-816e-491cff65154f tempest-ProjectMemberTests-1763329861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d61bd269-ea6a-43d8-9f97-535329fb33b7" returned: 0 in 0.425s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-88940295-9b5a-4b06-816e-491cff65154f tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d61bd269-ea6a-43d8-9f97-535329fb33b7 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:26 devstack sudo[107409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d61bd269-ea6a-43d8-9f97-535329fb33b7 Sep 04 22:59:26 devstack sudo[107409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:26 devstack sudo[107409]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-88940295-9b5a-4b06-816e-491cff65154f tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-d61bd269-ea6a-43d8-9f97-535329fb33b7" returned: 0 in 0.296s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:26 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-88940295-9b5a-4b06-816e-491cff65154f tempest-ProjectMemberTests-1763329861 None] Lock "cinder-quobyte-d61bd269-ea6a-43d8-9f97-535329fb33b7" released by "delete_volume" :: held 0.792s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:59:26 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-88940295-9b5a-4b06-816e-491cff65154f tempest-ProjectMemberTests-1763329861 None] Created reservations ['a480c416-426f-49a8-b981-7f2c38aa2195', '7ffac40a-8770-47a3-809f-785ffd7b4f0f', '9dc17456-b5e0-48bc-a545-8451361af062', '820aac0b-7904-494e-adc4-0abacf79e3d1'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:59:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-88940295-9b5a-4b06-816e-491cff65154f tempest-ProjectMemberTests-1763329861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:59:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-88940295-9b5a-4b06-816e-491cff65154f tempest-ProjectMemberTests-1763329861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:59:26 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-88940295-9b5a-4b06-816e-491cff65154f tempest-ProjectMemberTests-1763329861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:59:26 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-88940295-9b5a-4b06-816e-491cff65154f tempest-ProjectMemberTests-1763329861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:59:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-88940295-9b5a-4b06-816e-491cff65154f tempest-ProjectMemberTests-1763329861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:59:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-88940295-9b5a-4b06-816e-491cff65154f tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:26 devstack sudo[107412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:59:26 devstack sudo[107412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:26 devstack sudo[107412]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-88940295-9b5a-4b06-816e-491cff65154f tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.371s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:26 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-88940295-9b5a-4b06-816e-491cff65154f tempest-ProjectMemberTests-1763329861 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:59:26 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-88940295-9b5a-4b06-816e-491cff65154f tempest-ProjectMemberTests-1763329861 None] Deleted volume successfully. Sep 04 22:59:26 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-88940295-9b5a-4b06-816e-491cff65154f tempest-ProjectMemberTests-1763329861 None] Lock "cinder-d61bd269-ea6a-43d8-9f97-535329fb33b7-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:59:27 devstack cinder-volume[87576]: DEBUG dbcounter [-] [87576] Writing DB stats cinder:SELECT=263,cinder:UPDATE=359,cinder:INSERT=99,cinder:DELETE=24 {{(pid=87576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 22:59:27 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b354414-86bc-49e5-a24e-d130b3c06067 tempest-ProjectMemberTests-1763329861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:59:27 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3b354414-86bc-49e5-a24e-d130b3c06067 tempest-ProjectMemberTests-1763329861 None] Flow 'volume_create_manager' (6750620c-c92d-4b62-8195-50368af09131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:59:27 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3b354414-86bc-49e5-a24e-d130b3c06067 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f1414a0-fae4-407c-a7ca-b15d0d5582c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:27 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3b354414-86bc-49e5-a24e-d130b3c06067 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f1414a0-fae4-407c-a7ca-b15d0d5582c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:59:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-242188025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4975b399-72b5-4315-a052-268208533249,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea67d0db23b2432187cdb39da7ed0530',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:59:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:59:27Z,use_quota=True,user_id='f2beadaff952455f8e8d8ab5cdc33aa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:27 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3b354414-86bc-49e5-a24e-d130b3c06067 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a988600d-9a42-423e-ad8a-01ce12c475cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:27 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3b354414-86bc-49e5-a24e-d130b3c06067 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a988600d-9a42-423e-ad8a-01ce12c475cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:27 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3b354414-86bc-49e5-a24e-d130b3c06067 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c80179c8-5a87-4ab0-bb12-09093cdb88b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:27 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3b354414-86bc-49e5-a24e-d130b3c06067 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c80179c8-5a87-4ab0-bb12-09093cdb88b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4975b399-72b5-4315-a052-268208533249', 'volume_name': 'volume-4975b399-72b5-4315-a052-268208533249', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:27 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3b354414-86bc-49e5-a24e-d130b3c06067 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a09b69b-9744-46e8-b157-74bd382365c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:27 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3b354414-86bc-49e5-a24e-d130b3c06067 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a09b69b-9744-46e8-b157-74bd382365c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:27 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3b354414-86bc-49e5-a24e-d130b3c06067 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d0fbf13-6cbe-44f6-99e6-5422cbfc2616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:27 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-3b354414-86bc-49e5-a24e-d130b3c06067 tempest-ProjectMemberTests-1763329861 None] Volume 4975b399-72b5-4315-a052-268208533249: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4975b399-72b5-4315-a052-268208533249', 'volume_size': 1} Sep 04 22:59:27 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-3b354414-86bc-49e5-a24e-d130b3c06067 tempest-ProjectMemberTests-1763329861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:59:27 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-3b354414-86bc-49e5-a24e-d130b3c06067 tempest-ProjectMemberTests-1763329861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:59:27 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-3b354414-86bc-49e5-a24e-d130b3c06067 tempest-ProjectMemberTests-1763329861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:59:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-242188025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4975b399-72b5-4315-a052-268208533249,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea67d0db23b2432187cdb39da7ed0530',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:59:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:59:27Z,use_quota=True,user_id='f2beadaff952455f8e8d8ab5cdc33aa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:59:27 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-3b354414-86bc-49e5-a24e-d130b3c06067 tempest-ProjectMemberTests-1763329861 None] Creating volume 4975b399-72b5-4315-a052-268208533249 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:59:27 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-3b354414-86bc-49e5-a24e-d130b3c06067 tempest-ProjectMemberTests-1763329861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:59:27 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-3b354414-86bc-49e5-a24e-d130b3c06067 tempest-ProjectMemberTests-1763329861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:59:27 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-3b354414-86bc-49e5-a24e-d130b3c06067 tempest-ProjectMemberTests-1763329861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:59:27 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-3b354414-86bc-49e5-a24e-d130b3c06067 tempest-ProjectMemberTests-1763329861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:59:27 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-3b354414-86bc-49e5-a24e-d130b3c06067 tempest-ProjectMemberTests-1763329861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:59:27 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-3b354414-86bc-49e5-a24e-d130b3c06067 tempest-ProjectMemberTests-1763329861 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:59:27 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-3b354414-86bc-49e5-a24e-d130b3c06067 tempest-ProjectMemberTests-1763329861 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:59:27 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3b354414-86bc-49e5-a24e-d130b3c06067 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4975b399-72b5-4315-a052-268208533249 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:27 devstack sudo[107415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4975b399-72b5-4315-a052-268208533249 1073741824 Sep 04 22:59:27 devstack sudo[107415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:27 devstack sudo[107415]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:27 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3b354414-86bc-49e5-a24e-d130b3c06067 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4975b399-72b5-4315-a052-268208533249 1073741824" returned: 0 in 0.497s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:27 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3b354414-86bc-49e5-a24e-d130b3c06067 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4975b399-72b5-4315-a052-268208533249 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:27 devstack sudo[107421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4975b399-72b5-4315-a052-268208533249 Sep 04 22:59:27 devstack sudo[107421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:28 devstack sudo[107421]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3b354414-86bc-49e5-a24e-d130b3c06067 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4975b399-72b5-4315-a052-268208533249" returned: 0 in 0.298s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:28 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-3b354414-86bc-49e5-a24e-d130b3c06067 tempest-ProjectMemberTests-1763329861 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:59:28 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-3b354414-86bc-49e5-a24e-d130b3c06067 tempest-ProjectMemberTests-1763329861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:59:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3b354414-86bc-49e5-a24e-d130b3c06067 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d0fbf13-6cbe-44f6-99e6-5422cbfc2616) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4975b399-72b5-4315-a052-268208533249', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3b354414-86bc-49e5-a24e-d130b3c06067 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b657824a-9ea2-4bc2-8d19-f35ce9e54054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:28 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-3b354414-86bc-49e5-a24e-d130b3c06067 tempest-ProjectMemberTests-1763329861 None] Volume volume-4975b399-72b5-4315-a052-268208533249 (4975b399-72b5-4315-a052-268208533249): created successfully Sep 04 22:59:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3b354414-86bc-49e5-a24e-d130b3c06067 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b657824a-9ea2-4bc2-8d19-f35ce9e54054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-3b354414-86bc-49e5-a24e-d130b3c06067 tempest-ProjectMemberTests-1763329861 None] Flow 'volume_create_manager' (6750620c-c92d-4b62-8195-50368af09131) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:59:28 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-3b354414-86bc-49e5-a24e-d130b3c06067 tempest-ProjectMemberTests-1763329861 None] Created volume successfully. Sep 04 22:59:28 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-869f65c1-3a55-4bb7-a662-73d2608992ee tempest-ProjectAdminTests-795482220 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7158851623535, 'free_capacity_gb': 1773.7158851623535, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87576) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 04 22:59:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-bfb305a9-f8c3-41e3-9579-45dda55b1145 tempest-ProjectMemberTests-1763329861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:59:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-bfb305a9-f8c3-41e3-9579-45dda55b1145 tempest-ProjectMemberTests-1763329861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:59:29 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-bfb305a9-f8c3-41e3-9579-45dda55b1145 tempest-ProjectMemberTests-1763329861 None] Creating offline snapshot ccad533a-9e86-445b-bcec-92fa2063e0ea of volume 4975b399-72b5-4315-a052-268208533249 {{(pid=87576) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 22:59:29 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[435da160-10d7-424d-a1c4-d22934d50994]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:59:29 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-bfb305a9-f8c3-41e3-9579-45dda55b1145 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4975b399-72b5-4315-a052-268208533249 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:29 devstack sudo[107424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4975b399-72b5-4315-a052-268208533249 Sep 04 22:59:29 devstack sudo[107424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:30 devstack sudo[107424]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-bfb305a9-f8c3-41e3-9579-45dda55b1145 tempest-ProjectMemberTests-1763329861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4975b399-72b5-4315-a052-268208533249" returned: 0 in 0.453s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-bfb305a9-f8c3-41e3-9579-45dda55b1145 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4975b399-72b5-4315-a052-268208533249,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4975b399-72b5-4315-a052-268208533249.ccad533a-9e86-445b-bcec-92fa2063e0ea 1G {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:30 devstack sudo[107429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4975b399-72b5-4315-a052-268208533249,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4975b399-72b5-4315-a052-268208533249.ccad533a-9e86-445b-bcec-92fa2063e0ea 1G Sep 04 22:59:30 devstack sudo[107429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:30 devstack sudo[107429]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-bfb305a9-f8c3-41e3-9579-45dda55b1145 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4975b399-72b5-4315-a052-268208533249,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4975b399-72b5-4315-a052-268208533249.ccad533a-9e86-445b-bcec-92fa2063e0ea 1G" returned: 0 in 0.522s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-bfb305a9-f8c3-41e3-9579-45dda55b1145 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4975b399-72b5-4315-a052-268208533249 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4975b399-72b5-4315-a052-268208533249.ccad533a-9e86-445b-bcec-92fa2063e0ea {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:30 devstack sudo[107435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4975b399-72b5-4315-a052-268208533249 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4975b399-72b5-4315-a052-268208533249.ccad533a-9e86-445b-bcec-92fa2063e0ea Sep 04 22:59:30 devstack sudo[107435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:30 devstack sudo[107435]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-bfb305a9-f8c3-41e3-9579-45dda55b1145 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4975b399-72b5-4315-a052-268208533249 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4975b399-72b5-4315-a052-268208533249.ccad533a-9e86-445b-bcec-92fa2063e0ea" returned: 0 in 0.308s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:30 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-bfb305a9-f8c3-41e3-9579-45dda55b1145 tempest-ProjectMemberTests-1763329861 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4975b399-72b5-4315-a052-268208533249.ccad533a-9e86-445b-bcec-92fa2063e0ea is being set with open permissions: ugo+rw Sep 04 22:59:30 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-bfb305a9-f8c3-41e3-9579-45dda55b1145 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4975b399-72b5-4315-a052-268208533249.ccad533a-9e86-445b-bcec-92fa2063e0ea {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:30 devstack sudo[107441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4975b399-72b5-4315-a052-268208533249.ccad533a-9e86-445b-bcec-92fa2063e0ea Sep 04 22:59:30 devstack sudo[107441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:31 devstack sudo[107441]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-bfb305a9-f8c3-41e3-9579-45dda55b1145 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4975b399-72b5-4315-a052-268208533249.ccad533a-9e86-445b-bcec-92fa2063e0ea" returned: 0 in 0.258s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-bfb305a9-f8c3-41e3-9579-45dda55b1145 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4975b399-72b5-4315-a052-268208533249.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:31 devstack sudo[107444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4975b399-72b5-4315-a052-268208533249.info Sep 04 22:59:31 devstack sudo[107444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:31 devstack sudo[107444]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-bfb305a9-f8c3-41e3-9579-45dda55b1145 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4975b399-72b5-4315-a052-268208533249.info" returned: 0 in 0.299s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:31 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-bfb305a9-f8c3-41e3-9579-45dda55b1145 tempest-ProjectMemberTests-1763329861 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4975b399-72b5-4315-a052-268208533249.info is being set with open permissions: ugo+rw Sep 04 22:59:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-bfb305a9-f8c3-41e3-9579-45dda55b1145 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4975b399-72b5-4315-a052-268208533249.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:31 devstack sudo[107447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4975b399-72b5-4315-a052-268208533249.info Sep 04 22:59:31 devstack sudo[107447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:31 devstack sudo[107447]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-bfb305a9-f8c3-41e3-9579-45dda55b1145 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4975b399-72b5-4315-a052-268208533249.info" returned: 0 in 0.283s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-bfb305a9-f8c3-41e3-9579-45dda55b1145 tempest-ProjectMemberTests-1763329861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.231s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:59:31 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-bfb305a9-f8c3-41e3-9579-45dda55b1145 tempest-ProjectMemberTests-1763329861 None] Create snapshot completed successfully Sep 04 22:59:32 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-37ff3255-6134-4250-9dba-26870fc714a5 tempest-ProjectMemberTests-1763329861 None] Acquiring lock "cinder-ccad533a-9e86-445b-bcec-92fa2063e0ea-delete_snapshot" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:59:32 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-37ff3255-6134-4250-9dba-26870fc714a5 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-ccad533a-9e86-445b-bcec-92fa2063e0ea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:59:32 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-37ff3255-6134-4250-9dba-26870fc714a5 tempest-ProjectMemberTests-1763329861 None] Acquiring lock "cinder-quobyte-4975b399-72b5-4315-a052-268208533249" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:59:32 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-37ff3255-6134-4250-9dba-26870fc714a5 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-quobyte-4975b399-72b5-4315-a052-268208533249" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:59:32 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-37ff3255-6134-4250-9dba-26870fc714a5 tempest-ProjectMemberTests-1763329861 None] Acquiring lock "cinder-quobyte-ccad533a-9e86-445b-bcec-92fa2063e0ea" by "_delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:59:32 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-37ff3255-6134-4250-9dba-26870fc714a5 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-quobyte-ccad533a-9e86-445b-bcec-92fa2063e0ea" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:59:32 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-37ff3255-6134-4250-9dba-26870fc714a5 tempest-ProjectMemberTests-1763329861 None] Deleting offline snapshot ccad533a-9e86-445b-bcec-92fa2063e0ea of volume 4975b399-72b5-4315-a052-268208533249 {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 22:59:32 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-37ff3255-6134-4250-9dba-26870fc714a5 tempest-ProjectMemberTests-1763329861 None] snapshot_file for this snap is: volume-4975b399-72b5-4315-a052-268208533249.ccad533a-9e86-445b-bcec-92fa2063e0ea {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 22:59:32 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[7128fd8d-0c32-42bc-95cf-9eacfb393665]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:59:32 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-37ff3255-6134-4250-9dba-26870fc714a5 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4975b399-72b5-4315-a052-268208533249.ccad533a-9e86-445b-bcec-92fa2063e0ea {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:32 devstack sudo[107450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4975b399-72b5-4315-a052-268208533249.ccad533a-9e86-445b-bcec-92fa2063e0ea Sep 04 22:59:32 devstack sudo[107450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:33 devstack sudo[107450]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-37ff3255-6134-4250-9dba-26870fc714a5 tempest-ProjectMemberTests-1763329861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4975b399-72b5-4315-a052-268208533249.ccad533a-9e86-445b-bcec-92fa2063e0ea" returned: 0 in 0.449s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:33 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-37ff3255-6134-4250-9dba-26870fc714a5 tempest-ProjectMemberTests-1763329861 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4975b399-72b5-4315-a052-268208533249(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 22:59:33 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[c920ac5b-9614-4dce-836b-00b37ff73d75]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:59:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-37ff3255-6134-4250-9dba-26870fc714a5 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4975b399-72b5-4315-a052-268208533249 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:33 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-34936b89-c61f-4fde-aef2-3d2c0ed30fa3 tempest-ProjectReaderTests-1498489724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:59:33 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-34936b89-c61f-4fde-aef2-3d2c0ed30fa3 tempest-ProjectReaderTests-1498489724 None] Flow 'volume_create_manager' (e3eafde4-cd12-467e-8897-44f8d084687a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:59:33 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-34936b89-c61f-4fde-aef2-3d2c0ed30fa3 tempest-ProjectReaderTests-1498489724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (927b4987-6d11-4086-a968-a7e1dd05ff69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:33 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-34936b89-c61f-4fde-aef2-3d2c0ed30fa3 tempest-ProjectReaderTests-1498489724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (927b4987-6d11-4086-a968-a7e1dd05ff69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:59:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-20962784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=558772ad-d25f-41b5-b565-851f6116d40a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7585397571d4467c940871ba04edaa79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:59:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:59:33Z,use_quota=True,user_id='7ce20a5cf92b4a7dae47527aa9513e2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:33 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-34936b89-c61f-4fde-aef2-3d2c0ed30fa3 tempest-ProjectReaderTests-1498489724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a046f079-6f67-4140-b9a6-d752da329919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:33 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-34936b89-c61f-4fde-aef2-3d2c0ed30fa3 tempest-ProjectReaderTests-1498489724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a046f079-6f67-4140-b9a6-d752da329919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:33 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-34936b89-c61f-4fde-aef2-3d2c0ed30fa3 tempest-ProjectReaderTests-1498489724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f6691a6-e9b2-4765-b470-a6d47dc0d7a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:33 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-34936b89-c61f-4fde-aef2-3d2c0ed30fa3 tempest-ProjectReaderTests-1498489724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f6691a6-e9b2-4765-b470-a6d47dc0d7a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '558772ad-d25f-41b5-b565-851f6116d40a', 'volume_name': 'volume-558772ad-d25f-41b5-b565-851f6116d40a', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:33 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-34936b89-c61f-4fde-aef2-3d2c0ed30fa3 tempest-ProjectReaderTests-1498489724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d7e12e7-409e-46cc-a8a0-605aab2e640b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:33 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-34936b89-c61f-4fde-aef2-3d2c0ed30fa3 tempest-ProjectReaderTests-1498489724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d7e12e7-409e-46cc-a8a0-605aab2e640b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:33 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-34936b89-c61f-4fde-aef2-3d2c0ed30fa3 tempest-ProjectReaderTests-1498489724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5714635f-430b-483f-aef2-d9b12e663c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:33 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-34936b89-c61f-4fde-aef2-3d2c0ed30fa3 tempest-ProjectReaderTests-1498489724 None] Volume 558772ad-d25f-41b5-b565-851f6116d40a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-558772ad-d25f-41b5-b565-851f6116d40a', 'volume_size': 1} Sep 04 22:59:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-34936b89-c61f-4fde-aef2-3d2c0ed30fa3 tempest-ProjectReaderTests-1498489724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:59:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-34936b89-c61f-4fde-aef2-3d2c0ed30fa3 tempest-ProjectReaderTests-1498489724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:59:33 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-34936b89-c61f-4fde-aef2-3d2c0ed30fa3 tempest-ProjectReaderTests-1498489724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:59:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-20962784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=558772ad-d25f-41b5-b565-851f6116d40a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7585397571d4467c940871ba04edaa79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:59:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:59:33Z,use_quota=True,user_id='7ce20a5cf92b4a7dae47527aa9513e2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:59:33 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-34936b89-c61f-4fde-aef2-3d2c0ed30fa3 tempest-ProjectReaderTests-1498489724 None] Creating volume 558772ad-d25f-41b5-b565-851f6116d40a {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:59:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-34936b89-c61f-4fde-aef2-3d2c0ed30fa3 tempest-ProjectReaderTests-1498489724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:59:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-34936b89-c61f-4fde-aef2-3d2c0ed30fa3 tempest-ProjectReaderTests-1498489724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:59:33 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-34936b89-c61f-4fde-aef2-3d2c0ed30fa3 tempest-ProjectReaderTests-1498489724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:59:33 devstack sudo[107456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4975b399-72b5-4315-a052-268208533249 Sep 04 22:59:33 devstack sudo[107456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:33 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-34936b89-c61f-4fde-aef2-3d2c0ed30fa3 tempest-ProjectReaderTests-1498489724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:59:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-34936b89-c61f-4fde-aef2-3d2c0ed30fa3 tempest-ProjectReaderTests-1498489724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:59:33 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-34936b89-c61f-4fde-aef2-3d2c0ed30fa3 tempest-ProjectReaderTests-1498489724 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:59:33 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-34936b89-c61f-4fde-aef2-3d2c0ed30fa3 tempest-ProjectReaderTests-1498489724 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:59:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-34936b89-c61f-4fde-aef2-3d2c0ed30fa3 tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-558772ad-d25f-41b5-b565-851f6116d40a 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:33 devstack sudo[107458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-558772ad-d25f-41b5-b565-851f6116d40a 1073741824 Sep 04 22:59:33 devstack sudo[107458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:33 devstack sudo[107456]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-37ff3255-6134-4250-9dba-26870fc714a5 tempest-ProjectMemberTests-1763329861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4975b399-72b5-4315-a052-268208533249" returned: 0 in 0.426s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-37ff3255-6134-4250-9dba-26870fc714a5 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4975b399-72b5-4315-a052-268208533249.ccad533a-9e86-445b-bcec-92fa2063e0ea {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:33 devstack sudo[107466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4975b399-72b5-4315-a052-268208533249.ccad533a-9e86-445b-bcec-92fa2063e0ea Sep 04 22:59:33 devstack sudo[107466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:33 devstack sudo[107458]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-34936b89-c61f-4fde-aef2-3d2c0ed30fa3 tempest-ProjectReaderTests-1498489724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-558772ad-d25f-41b5-b565-851f6116d40a 1073741824" returned: 0 in 0.482s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:34 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-34936b89-c61f-4fde-aef2-3d2c0ed30fa3 tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-558772ad-d25f-41b5-b565-851f6116d40a {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:34 devstack sudo[107470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-558772ad-d25f-41b5-b565-851f6116d40a Sep 04 22:59:34 devstack sudo[107470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:34 devstack sudo[107466]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:34 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-37ff3255-6134-4250-9dba-26870fc714a5 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4975b399-72b5-4315-a052-268208533249.ccad533a-9e86-445b-bcec-92fa2063e0ea" returned: 0 in 0.390s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:34 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-37ff3255-6134-4250-9dba-26870fc714a5 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4975b399-72b5-4315-a052-268208533249.ccad533a-9e86-445b-bcec-92fa2063e0ea {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:34 devstack sudo[107474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4975b399-72b5-4315-a052-268208533249.ccad533a-9e86-445b-bcec-92fa2063e0ea Sep 04 22:59:34 devstack sudo[107474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:34 devstack sudo[107470]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:34 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-34936b89-c61f-4fde-aef2-3d2c0ed30fa3 tempest-ProjectReaderTests-1498489724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-558772ad-d25f-41b5-b565-851f6116d40a" returned: 0 in 0.283s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:34 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-34936b89-c61f-4fde-aef2-3d2c0ed30fa3 tempest-ProjectReaderTests-1498489724 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:59:34 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-34936b89-c61f-4fde-aef2-3d2c0ed30fa3 tempest-ProjectReaderTests-1498489724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:59:34 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-34936b89-c61f-4fde-aef2-3d2c0ed30fa3 tempest-ProjectReaderTests-1498489724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5714635f-430b-483f-aef2-d9b12e663c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-558772ad-d25f-41b5-b565-851f6116d40a', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:34 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-34936b89-c61f-4fde-aef2-3d2c0ed30fa3 tempest-ProjectReaderTests-1498489724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (165e3193-d7ca-489d-a1ee-db9b3ebaf232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:34 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-34936b89-c61f-4fde-aef2-3d2c0ed30fa3 tempest-ProjectReaderTests-1498489724 None] Volume volume-558772ad-d25f-41b5-b565-851f6116d40a (558772ad-d25f-41b5-b565-851f6116d40a): created successfully Sep 04 22:59:34 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-34936b89-c61f-4fde-aef2-3d2c0ed30fa3 tempest-ProjectReaderTests-1498489724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (165e3193-d7ca-489d-a1ee-db9b3ebaf232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:34 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-34936b89-c61f-4fde-aef2-3d2c0ed30fa3 tempest-ProjectReaderTests-1498489724 None] Flow 'volume_create_manager' (e3eafde4-cd12-467e-8897-44f8d084687a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:59:34 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-34936b89-c61f-4fde-aef2-3d2c0ed30fa3 tempest-ProjectReaderTests-1498489724 None] Created volume successfully. Sep 04 22:59:34 devstack sudo[107474]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:34 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-37ff3255-6134-4250-9dba-26870fc714a5 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4975b399-72b5-4315-a052-268208533249.ccad533a-9e86-445b-bcec-92fa2063e0ea" returned: 0 in 0.272s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:34 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-37ff3255-6134-4250-9dba-26870fc714a5 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-quobyte-ccad533a-9e86-445b-bcec-92fa2063e0ea" released by "_delete_snapshot" :: held 1.662s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:59:34 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-37ff3255-6134-4250-9dba-26870fc714a5 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-quobyte-4975b399-72b5-4315-a052-268208533249" released by "delete_snapshot" :: held 1.686s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:59:34 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-37ff3255-6134-4250-9dba-26870fc714a5 tempest-ProjectMemberTests-1763329861 None] Created reservations ['eed3bc18-5f1f-44a8-a094-cb797245d147', 'c3145294-47c5-4ec7-b78d-1f86b1ccb9e4', 'be00f475-5108-4eb7-a713-763533529107', '6a5b6991-2d36-4c1d-95e4-98ceef0e1e1b'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:59:34 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-37ff3255-6134-4250-9dba-26870fc714a5 tempest-ProjectMemberTests-1763329861 None] Delete snapshot completed successfully. Sep 04 22:59:34 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-37ff3255-6134-4250-9dba-26870fc714a5 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-ccad533a-9e86-445b-bcec-92fa2063e0ea-delete_snapshot" released by "delete_snapshot" :: held 1.833s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:59:34 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-559be63c-2775-4073-9d5d-011306d4ca14 tempest-ProjectMemberTests-1763329861 None] Acquiring lock "cinder-4975b399-72b5-4315-a052-268208533249-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:59:34 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-559be63c-2775-4073-9d5d-011306d4ca14 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-4975b399-72b5-4315-a052-268208533249-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:59:34 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-559be63c-2775-4073-9d5d-011306d4ca14 tempest-ProjectMemberTests-1763329861 None] Acquiring lock "cinder-quobyte-4975b399-72b5-4315-a052-268208533249" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:59:35 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-559be63c-2775-4073-9d5d-011306d4ca14 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-quobyte-4975b399-72b5-4315-a052-268208533249" acquired by "delete_volume" :: waited 0.019s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:59:35 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd553d1-459a-4d8e-b8c0-cbb76addfaba]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:59:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-559be63c-2775-4073-9d5d-011306d4ca14 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4975b399-72b5-4315-a052-268208533249 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:35 devstack sudo[107478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4975b399-72b5-4315-a052-268208533249 Sep 04 22:59:35 devstack sudo[107478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:35 devstack sudo[107478]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-559be63c-2775-4073-9d5d-011306d4ca14 tempest-ProjectMemberTests-1763329861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4975b399-72b5-4315-a052-268208533249" returned: 0 in 0.444s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-559be63c-2775-4073-9d5d-011306d4ca14 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4975b399-72b5-4315-a052-268208533249 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:35 devstack sudo[107483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4975b399-72b5-4315-a052-268208533249 Sep 04 22:59:35 devstack sudo[107483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-9f11e4ed-bc6a-44ea-a3c5-2e2ed8735e40 tempest-ProjectReaderTests-1498489724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:59:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-9f11e4ed-bc6a-44ea-a3c5-2e2ed8735e40 tempest-ProjectReaderTests-1498489724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:59:35 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-9f11e4ed-bc6a-44ea-a3c5-2e2ed8735e40 tempest-ProjectReaderTests-1498489724 None] Creating offline snapshot c2b21814-e79d-485d-a5e2-ca3d3c364f6e of volume 558772ad-d25f-41b5-b565-851f6116d40a {{(pid=87576) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 22:59:35 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[6043890b-4ea0-4682-9662-cbfdf93294ae]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:59:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-9f11e4ed-bc6a-44ea-a3c5-2e2ed8735e40 tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-558772ad-d25f-41b5-b565-851f6116d40a {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:35 devstack sudo[107483]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-559be63c-2775-4073-9d5d-011306d4ca14 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-4975b399-72b5-4315-a052-268208533249" returned: 0 in 0.271s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:35 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-559be63c-2775-4073-9d5d-011306d4ca14 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-quobyte-4975b399-72b5-4315-a052-268208533249" released by "delete_volume" :: held 0.785s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:59:35 devstack sudo[107486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-558772ad-d25f-41b5-b565-851f6116d40a Sep 04 22:59:35 devstack sudo[107486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:35 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-559be63c-2775-4073-9d5d-011306d4ca14 tempest-ProjectMemberTests-1763329861 None] Created reservations ['3a90e097-325f-47b7-aaf2-7bfe0d98bc95', '77b2e043-0a15-459f-a1a4-785575931c21', '0509ce81-b306-4b20-9c54-dc0bf34986f7', '9f19a502-cebe-4de3-b0b2-af139b8b58d0'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:59:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-559be63c-2775-4073-9d5d-011306d4ca14 tempest-ProjectMemberTests-1763329861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:59:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-559be63c-2775-4073-9d5d-011306d4ca14 tempest-ProjectMemberTests-1763329861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:59:35 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-559be63c-2775-4073-9d5d-011306d4ca14 tempest-ProjectMemberTests-1763329861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:59:35 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-559be63c-2775-4073-9d5d-011306d4ca14 tempest-ProjectMemberTests-1763329861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:59:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-559be63c-2775-4073-9d5d-011306d4ca14 tempest-ProjectMemberTests-1763329861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:59:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-559be63c-2775-4073-9d5d-011306d4ca14 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:35 devstack sudo[107488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:59:35 devstack sudo[107488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:36 devstack sudo[107486]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-9f11e4ed-bc6a-44ea-a3c5-2e2ed8735e40 tempest-ProjectReaderTests-1498489724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-558772ad-d25f-41b5-b565-851f6116d40a" returned: 0 in 0.434s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-9f11e4ed-bc6a-44ea-a3c5-2e2ed8735e40 tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-558772ad-d25f-41b5-b565-851f6116d40a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-558772ad-d25f-41b5-b565-851f6116d40a.c2b21814-e79d-485d-a5e2-ca3d3c364f6e 1G {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:36 devstack sudo[107494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-558772ad-d25f-41b5-b565-851f6116d40a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-558772ad-d25f-41b5-b565-851f6116d40a.c2b21814-e79d-485d-a5e2-ca3d3c364f6e 1G Sep 04 22:59:36 devstack sudo[107494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:36 devstack sudo[107488]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-559be63c-2775-4073-9d5d-011306d4ca14 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.332s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:36 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-559be63c-2775-4073-9d5d-011306d4ca14 tempest-ProjectMemberTests-1763329861 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:59:36 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-559be63c-2775-4073-9d5d-011306d4ca14 tempest-ProjectMemberTests-1763329861 None] Deleted volume successfully. Sep 04 22:59:36 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-559be63c-2775-4073-9d5d-011306d4ca14 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-4975b399-72b5-4315-a052-268208533249-delete_volume" released by "delete_volume" :: held 1.392s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:59:36 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b18e189-614e-47a0-9413-53f93449a3ff tempest-ProjectMemberTests-1763329861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:59:36 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-5b18e189-614e-47a0-9413-53f93449a3ff tempest-ProjectMemberTests-1763329861 None] Flow 'volume_create_manager' (733c43fc-68cd-4911-ae8c-39644a520256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:59:36 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-5b18e189-614e-47a0-9413-53f93449a3ff tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (281fde6e-df33-4554-96be-8d92d2d5b958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:36 devstack sudo[107494]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:36 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-5b18e189-614e-47a0-9413-53f93449a3ff tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (281fde6e-df33-4554-96be-8d92d2d5b958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:59:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-944315927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5846c4a-a87c-4490-a449-829324fc67a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea67d0db23b2432187cdb39da7ed0530',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:59:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:59:37Z,use_quota=True,user_id='f2beadaff952455f8e8d8ab5cdc33aa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:36 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-5b18e189-614e-47a0-9413-53f93449a3ff tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9557106f-edcc-47f3-859a-2c96e31cc46a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:36 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-5b18e189-614e-47a0-9413-53f93449a3ff tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9557106f-edcc-47f3-859a-2c96e31cc46a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:36 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-5b18e189-614e-47a0-9413-53f93449a3ff tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf0cfb31-e70d-455e-8f7f-e29b91c0ac7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:36 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-5b18e189-614e-47a0-9413-53f93449a3ff tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf0cfb31-e70d-455e-8f7f-e29b91c0ac7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5846c4a-a87c-4490-a449-829324fc67a8', 'volume_name': 'volume-c5846c4a-a87c-4490-a449-829324fc67a8', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:36 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-5b18e189-614e-47a0-9413-53f93449a3ff tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (384e94c2-eabd-46bc-a586-7b4c9670d12e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:36 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-5b18e189-614e-47a0-9413-53f93449a3ff tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (384e94c2-eabd-46bc-a586-7b4c9670d12e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:36 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-5b18e189-614e-47a0-9413-53f93449a3ff tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efc490be-77dd-4231-8126-efa771a77112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:36 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-5b18e189-614e-47a0-9413-53f93449a3ff tempest-ProjectMemberTests-1763329861 None] Volume c5846c4a-a87c-4490-a449-829324fc67a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5846c4a-a87c-4490-a449-829324fc67a8', 'volume_size': 1} Sep 04 22:59:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-5b18e189-614e-47a0-9413-53f93449a3ff tempest-ProjectMemberTests-1763329861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:59:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-9f11e4ed-bc6a-44ea-a3c5-2e2ed8735e40 tempest-ProjectReaderTests-1498489724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-558772ad-d25f-41b5-b565-851f6116d40a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-558772ad-d25f-41b5-b565-851f6116d40a.c2b21814-e79d-485d-a5e2-ca3d3c364f6e 1G" returned: 0 in 0.606s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-9f11e4ed-bc6a-44ea-a3c5-2e2ed8735e40 tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-558772ad-d25f-41b5-b565-851f6116d40a -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-558772ad-d25f-41b5-b565-851f6116d40a.c2b21814-e79d-485d-a5e2-ca3d3c364f6e {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:36 devstack sudo[107501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-558772ad-d25f-41b5-b565-851f6116d40a -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-558772ad-d25f-41b5-b565-851f6116d40a.c2b21814-e79d-485d-a5e2-ca3d3c364f6e Sep 04 22:59:36 devstack sudo[107501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:37 devstack sudo[107501]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:37 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-9f11e4ed-bc6a-44ea-a3c5-2e2ed8735e40 tempest-ProjectReaderTests-1498489724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-558772ad-d25f-41b5-b565-851f6116d40a -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-558772ad-d25f-41b5-b565-851f6116d40a.c2b21814-e79d-485d-a5e2-ca3d3c364f6e" returned: 0 in 0.292s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:37 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-9f11e4ed-bc6a-44ea-a3c5-2e2ed8735e40 tempest-ProjectReaderTests-1498489724 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-558772ad-d25f-41b5-b565-851f6116d40a.c2b21814-e79d-485d-a5e2-ca3d3c364f6e is being set with open permissions: ugo+rw Sep 04 22:59:37 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-9f11e4ed-bc6a-44ea-a3c5-2e2ed8735e40 tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-558772ad-d25f-41b5-b565-851f6116d40a.c2b21814-e79d-485d-a5e2-ca3d3c364f6e {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:37 devstack sudo[107506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-558772ad-d25f-41b5-b565-851f6116d40a.c2b21814-e79d-485d-a5e2-ca3d3c364f6e Sep 04 22:59:37 devstack sudo[107506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:37 devstack sudo[107506]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:37 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-9f11e4ed-bc6a-44ea-a3c5-2e2ed8735e40 tempest-ProjectReaderTests-1498489724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-558772ad-d25f-41b5-b565-851f6116d40a.c2b21814-e79d-485d-a5e2-ca3d3c364f6e" returned: 0 in 0.250s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:37 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-9f11e4ed-bc6a-44ea-a3c5-2e2ed8735e40 tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-558772ad-d25f-41b5-b565-851f6116d40a.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:37 devstack sudo[107509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-558772ad-d25f-41b5-b565-851f6116d40a.info Sep 04 22:59:37 devstack sudo[107509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:37 devstack sudo[107509]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:37 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-9f11e4ed-bc6a-44ea-a3c5-2e2ed8735e40 tempest-ProjectReaderTests-1498489724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-558772ad-d25f-41b5-b565-851f6116d40a.info" returned: 0 in 0.275s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:37 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-9f11e4ed-bc6a-44ea-a3c5-2e2ed8735e40 tempest-ProjectReaderTests-1498489724 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-558772ad-d25f-41b5-b565-851f6116d40a.info is being set with open permissions: ugo+rw Sep 04 22:59:37 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-9f11e4ed-bc6a-44ea-a3c5-2e2ed8735e40 tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-558772ad-d25f-41b5-b565-851f6116d40a.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:37 devstack sudo[107512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-558772ad-d25f-41b5-b565-851f6116d40a.info Sep 04 22:59:37 devstack sudo[107512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:37 devstack sudo[107512]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:37 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-9f11e4ed-bc6a-44ea-a3c5-2e2ed8735e40 tempest-ProjectReaderTests-1498489724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-558772ad-d25f-41b5-b565-851f6116d40a.info" returned: 0 in 0.271s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:37 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-9f11e4ed-bc6a-44ea-a3c5-2e2ed8735e40 tempest-ProjectReaderTests-1498489724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.236s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:59:37 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-5b18e189-614e-47a0-9413-53f93449a3ff tempest-ProjectMemberTests-1763329861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.155s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:59:37 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-5b18e189-614e-47a0-9413-53f93449a3ff tempest-ProjectMemberTests-1763329861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:59:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-944315927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5846c4a-a87c-4490-a449-829324fc67a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea67d0db23b2432187cdb39da7ed0530',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:59:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:59:37Z,use_quota=True,user_id='f2beadaff952455f8e8d8ab5cdc33aa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:59:37 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-5b18e189-614e-47a0-9413-53f93449a3ff tempest-ProjectMemberTests-1763329861 None] Creating volume c5846c4a-a87c-4490-a449-829324fc67a8 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:59:37 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-5b18e189-614e-47a0-9413-53f93449a3ff tempest-ProjectMemberTests-1763329861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:59:37 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-5b18e189-614e-47a0-9413-53f93449a3ff tempest-ProjectMemberTests-1763329861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:59:37 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-5b18e189-614e-47a0-9413-53f93449a3ff tempest-ProjectMemberTests-1763329861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:59:37 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-5b18e189-614e-47a0-9413-53f93449a3ff tempest-ProjectMemberTests-1763329861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:59:37 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-5b18e189-614e-47a0-9413-53f93449a3ff tempest-ProjectMemberTests-1763329861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:59:37 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-5b18e189-614e-47a0-9413-53f93449a3ff tempest-ProjectMemberTests-1763329861 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:59:37 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-5b18e189-614e-47a0-9413-53f93449a3ff tempest-ProjectMemberTests-1763329861 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:59:37 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5b18e189-614e-47a0-9413-53f93449a3ff tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c5846c4a-a87c-4490-a449-829324fc67a8 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:37 devstack sudo[107515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c5846c4a-a87c-4490-a449-829324fc67a8 1073741824 Sep 04 22:59:37 devstack sudo[107515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:37 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-9f11e4ed-bc6a-44ea-a3c5-2e2ed8735e40 tempest-ProjectReaderTests-1498489724 None] Create snapshot completed successfully Sep 04 22:59:38 devstack sudo[107515]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:38 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5b18e189-614e-47a0-9413-53f93449a3ff tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c5846c4a-a87c-4490-a449-829324fc67a8 1073741824" returned: 0 in 0.435s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:38 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5b18e189-614e-47a0-9413-53f93449a3ff tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c5846c4a-a87c-4490-a449-829324fc67a8 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:38 devstack sudo[107555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c5846c4a-a87c-4490-a449-829324fc67a8 Sep 04 22:59:38 devstack sudo[107555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:38 devstack sudo[107555]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:38 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5b18e189-614e-47a0-9413-53f93449a3ff tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c5846c4a-a87c-4490-a449-829324fc67a8" returned: 0 in 0.267s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:38 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-5b18e189-614e-47a0-9413-53f93449a3ff tempest-ProjectMemberTests-1763329861 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:59:38 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-5b18e189-614e-47a0-9413-53f93449a3ff tempest-ProjectMemberTests-1763329861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:59:38 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-5b18e189-614e-47a0-9413-53f93449a3ff tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efc490be-77dd-4231-8126-efa771a77112) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5846c4a-a87c-4490-a449-829324fc67a8', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:38 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-5b18e189-614e-47a0-9413-53f93449a3ff tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (548c49ae-95c6-4d66-9bc4-a5652ae03d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:38 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-5b18e189-614e-47a0-9413-53f93449a3ff tempest-ProjectMemberTests-1763329861 None] Volume volume-c5846c4a-a87c-4490-a449-829324fc67a8 (c5846c4a-a87c-4490-a449-829324fc67a8): created successfully Sep 04 22:59:38 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-5b18e189-614e-47a0-9413-53f93449a3ff tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (548c49ae-95c6-4d66-9bc4-a5652ae03d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:38 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-5b18e189-614e-47a0-9413-53f93449a3ff tempest-ProjectMemberTests-1763329861 None] Flow 'volume_create_manager' (733c43fc-68cd-4911-ae8c-39644a520256) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:59:38 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-5b18e189-614e-47a0-9413-53f93449a3ff tempest-ProjectMemberTests-1763329861 None] Created volume successfully. Sep 04 22:59:39 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-00aaa652-0354-4737-abab-8b0b0f59ddd6 tempest-ProjectReaderTests-1498489724 None] Acquiring lock "cinder-c2b21814-e79d-485d-a5e2-ca3d3c364f6e-delete_snapshot" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:59:39 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-00aaa652-0354-4737-abab-8b0b0f59ddd6 tempest-ProjectReaderTests-1498489724 None] Lock "cinder-c2b21814-e79d-485d-a5e2-ca3d3c364f6e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:59:39 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-00aaa652-0354-4737-abab-8b0b0f59ddd6 tempest-ProjectReaderTests-1498489724 None] Acquiring lock "cinder-quobyte-558772ad-d25f-41b5-b565-851f6116d40a" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:59:39 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-00aaa652-0354-4737-abab-8b0b0f59ddd6 tempest-ProjectReaderTests-1498489724 None] Lock "cinder-quobyte-558772ad-d25f-41b5-b565-851f6116d40a" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:59:39 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-00aaa652-0354-4737-abab-8b0b0f59ddd6 tempest-ProjectReaderTests-1498489724 None] Acquiring lock "cinder-quobyte-c2b21814-e79d-485d-a5e2-ca3d3c364f6e" by "_delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:59:39 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-00aaa652-0354-4737-abab-8b0b0f59ddd6 tempest-ProjectReaderTests-1498489724 None] Lock "cinder-quobyte-c2b21814-e79d-485d-a5e2-ca3d3c364f6e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:59:39 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-00aaa652-0354-4737-abab-8b0b0f59ddd6 tempest-ProjectReaderTests-1498489724 None] Deleting offline snapshot c2b21814-e79d-485d-a5e2-ca3d3c364f6e of volume 558772ad-d25f-41b5-b565-851f6116d40a {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 22:59:39 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-00aaa652-0354-4737-abab-8b0b0f59ddd6 tempest-ProjectReaderTests-1498489724 None] snapshot_file for this snap is: volume-558772ad-d25f-41b5-b565-851f6116d40a.c2b21814-e79d-485d-a5e2-ca3d3c364f6e {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 22:59:39 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6040cf-75d7-4cac-8918-d79b5474b0ef]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:59:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-00aaa652-0354-4737-abab-8b0b0f59ddd6 tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-558772ad-d25f-41b5-b565-851f6116d40a.c2b21814-e79d-485d-a5e2-ca3d3c364f6e {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:39 devstack sudo[107560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-558772ad-d25f-41b5-b565-851f6116d40a.c2b21814-e79d-485d-a5e2-ca3d3c364f6e Sep 04 22:59:39 devstack sudo[107560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:39 devstack sudo[107560]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-00aaa652-0354-4737-abab-8b0b0f59ddd6 tempest-ProjectReaderTests-1498489724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-558772ad-d25f-41b5-b565-851f6116d40a.c2b21814-e79d-485d-a5e2-ca3d3c364f6e" returned: 0 in 0.384s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:39 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-00aaa652-0354-4737-abab-8b0b0f59ddd6 tempest-ProjectReaderTests-1498489724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-558772ad-d25f-41b5-b565-851f6116d40a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 22:59:39 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2b2da8-a5ac-4191-9b1a-e19fdb194172]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:59:39 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-00aaa652-0354-4737-abab-8b0b0f59ddd6 tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-558772ad-d25f-41b5-b565-851f6116d40a {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:39 devstack sudo[107565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-558772ad-d25f-41b5-b565-851f6116d40a Sep 04 22:59:39 devstack sudo[107565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-47e77cae-242a-4b47-87ac-e4b328be5907 tempest-ProjectMemberTests-1763329861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:59:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-47e77cae-242a-4b47-87ac-e4b328be5907 tempest-ProjectMemberTests-1763329861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:59:40 devstack sudo[107565]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-00aaa652-0354-4737-abab-8b0b0f59ddd6 tempest-ProjectReaderTests-1498489724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-558772ad-d25f-41b5-b565-851f6116d40a" returned: 0 in 0.442s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-00aaa652-0354-4737-abab-8b0b0f59ddd6 tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-558772ad-d25f-41b5-b565-851f6116d40a.c2b21814-e79d-485d-a5e2-ca3d3c364f6e {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:40 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-47e77cae-242a-4b47-87ac-e4b328be5907 tempest-ProjectMemberTests-1763329861 None] Creating offline snapshot 3e295cbf-6de6-4df3-b2ea-99d5633198e1 of volume c5846c4a-a87c-4490-a449-829324fc67a8 {{(pid=87576) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 22:59:40 devstack sudo[107570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-558772ad-d25f-41b5-b565-851f6116d40a.c2b21814-e79d-485d-a5e2-ca3d3c364f6e Sep 04 22:59:40 devstack sudo[107570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:40 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eedeb55-1604-4283-b01e-a61f49a60b4c]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:59:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-47e77cae-242a-4b47-87ac-e4b328be5907 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c5846c4a-a87c-4490-a449-829324fc67a8 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:40 devstack sudo[107572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c5846c4a-a87c-4490-a449-829324fc67a8 Sep 04 22:59:40 devstack sudo[107572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:40 devstack sudo[107570]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-00aaa652-0354-4737-abab-8b0b0f59ddd6 tempest-ProjectReaderTests-1498489724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-558772ad-d25f-41b5-b565-851f6116d40a.c2b21814-e79d-485d-a5e2-ca3d3c364f6e" returned: 0 in 0.427s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-00aaa652-0354-4737-abab-8b0b0f59ddd6 tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-558772ad-d25f-41b5-b565-851f6116d40a.c2b21814-e79d-485d-a5e2-ca3d3c364f6e {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:40 devstack sudo[107572]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-47e77cae-242a-4b47-87ac-e4b328be5907 tempest-ProjectMemberTests-1763329861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c5846c4a-a87c-4490-a449-829324fc67a8" returned: 0 in 0.403s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-47e77cae-242a-4b47-87ac-e4b328be5907 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c5846c4a-a87c-4490-a449-829324fc67a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c5846c4a-a87c-4490-a449-829324fc67a8.3e295cbf-6de6-4df3-b2ea-99d5633198e1 1G {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:40 devstack sudo[107581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-558772ad-d25f-41b5-b565-851f6116d40a.c2b21814-e79d-485d-a5e2-ca3d3c364f6e Sep 04 22:59:40 devstack sudo[107581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:40 devstack sudo[107582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c5846c4a-a87c-4490-a449-829324fc67a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c5846c4a-a87c-4490-a449-829324fc67a8.3e295cbf-6de6-4df3-b2ea-99d5633198e1 1G Sep 04 22:59:40 devstack sudo[107582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:40 devstack sudo[107581]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-00aaa652-0354-4737-abab-8b0b0f59ddd6 tempest-ProjectReaderTests-1498489724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-558772ad-d25f-41b5-b565-851f6116d40a.c2b21814-e79d-485d-a5e2-ca3d3c364f6e" returned: 0 in 0.265s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:40 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-00aaa652-0354-4737-abab-8b0b0f59ddd6 tempest-ProjectReaderTests-1498489724 None] Lock "cinder-quobyte-c2b21814-e79d-485d-a5e2-ca3d3c364f6e" released by "_delete_snapshot" :: held 1.624s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:59:40 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-00aaa652-0354-4737-abab-8b0b0f59ddd6 tempest-ProjectReaderTests-1498489724 None] Lock "cinder-quobyte-558772ad-d25f-41b5-b565-851f6116d40a" released by "delete_snapshot" :: held 1.648s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:59:40 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-00aaa652-0354-4737-abab-8b0b0f59ddd6 tempest-ProjectReaderTests-1498489724 None] Created reservations ['79812d97-d54a-4835-abf9-640bba833994', 'aa276944-08c7-4c08-8176-5c51577ff3c1', '8f0c9dec-e439-4c70-b9c8-05b5768a1997', '7c10d978-d0e5-400a-a36e-8695125be694'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:59:40 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-00aaa652-0354-4737-abab-8b0b0f59ddd6 tempest-ProjectReaderTests-1498489724 None] Delete snapshot completed successfully. Sep 04 22:59:40 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-00aaa652-0354-4737-abab-8b0b0f59ddd6 tempest-ProjectReaderTests-1498489724 None] Lock "cinder-c2b21814-e79d-485d-a5e2-ca3d3c364f6e-delete_snapshot" released by "delete_snapshot" :: held 1.824s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:59:40 devstack sudo[107582]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-47e77cae-242a-4b47-87ac-e4b328be5907 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c5846c4a-a87c-4490-a449-829324fc67a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c5846c4a-a87c-4490-a449-829324fc67a8.3e295cbf-6de6-4df3-b2ea-99d5633198e1 1G" returned: 0 in 0.491s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:40 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-47e77cae-242a-4b47-87ac-e4b328be5907 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5846c4a-a87c-4490-a449-829324fc67a8 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c5846c4a-a87c-4490-a449-829324fc67a8.3e295cbf-6de6-4df3-b2ea-99d5633198e1 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:40 devstack sudo[107590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5846c4a-a87c-4490-a449-829324fc67a8 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c5846c4a-a87c-4490-a449-829324fc67a8.3e295cbf-6de6-4df3-b2ea-99d5633198e1 Sep 04 22:59:40 devstack sudo[107590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:41 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-ec4adca6-bbb6-4ddd-a4fb-fdf0dd94784a tempest-ProjectReaderTests-1498489724 None] Acquiring lock "cinder-558772ad-d25f-41b5-b565-851f6116d40a-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:59:41 devstack sudo[107590]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:41 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-ec4adca6-bbb6-4ddd-a4fb-fdf0dd94784a tempest-ProjectReaderTests-1498489724 None] Lock "cinder-558772ad-d25f-41b5-b565-851f6116d40a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:59:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-47e77cae-242a-4b47-87ac-e4b328be5907 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5846c4a-a87c-4490-a449-829324fc67a8 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c5846c4a-a87c-4490-a449-829324fc67a8.3e295cbf-6de6-4df3-b2ea-99d5633198e1" returned: 0 in 0.337s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:41 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-47e77cae-242a-4b47-87ac-e4b328be5907 tempest-ProjectMemberTests-1763329861 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c5846c4a-a87c-4490-a449-829324fc67a8.3e295cbf-6de6-4df3-b2ea-99d5633198e1 is being set with open permissions: ugo+rw Sep 04 22:59:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-47e77cae-242a-4b47-87ac-e4b328be5907 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c5846c4a-a87c-4490-a449-829324fc67a8.3e295cbf-6de6-4df3-b2ea-99d5633198e1 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:41 devstack sudo[107595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c5846c4a-a87c-4490-a449-829324fc67a8.3e295cbf-6de6-4df3-b2ea-99d5633198e1 Sep 04 22:59:41 devstack sudo[107595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:41 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-ec4adca6-bbb6-4ddd-a4fb-fdf0dd94784a tempest-ProjectReaderTests-1498489724 None] Acquiring lock "cinder-quobyte-558772ad-d25f-41b5-b565-851f6116d40a" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:59:41 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-ec4adca6-bbb6-4ddd-a4fb-fdf0dd94784a tempest-ProjectReaderTests-1498489724 None] Lock "cinder-quobyte-558772ad-d25f-41b5-b565-851f6116d40a" acquired by "delete_volume" :: waited 0.017s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:59:41 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d6b18e-7451-436b-9928-fbad9d57b273]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:59:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ec4adca6-bbb6-4ddd-a4fb-fdf0dd94784a tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-558772ad-d25f-41b5-b565-851f6116d40a {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:41 devstack sudo[107597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-558772ad-d25f-41b5-b565-851f6116d40a Sep 04 22:59:41 devstack sudo[107597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:41 devstack sudo[107595]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-47e77cae-242a-4b47-87ac-e4b328be5907 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c5846c4a-a87c-4490-a449-829324fc67a8.3e295cbf-6de6-4df3-b2ea-99d5633198e1" returned: 0 in 0.276s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-47e77cae-242a-4b47-87ac-e4b328be5907 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c5846c4a-a87c-4490-a449-829324fc67a8.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:41 devstack sudo[107600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c5846c4a-a87c-4490-a449-829324fc67a8.info Sep 04 22:59:41 devstack sudo[107600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:41 devstack sudo[107597]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ec4adca6-bbb6-4ddd-a4fb-fdf0dd94784a tempest-ProjectReaderTests-1498489724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-558772ad-d25f-41b5-b565-851f6116d40a" returned: 0 in 0.407s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ec4adca6-bbb6-4ddd-a4fb-fdf0dd94784a tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-558772ad-d25f-41b5-b565-851f6116d40a {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:41 devstack sudo[107606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-558772ad-d25f-41b5-b565-851f6116d40a Sep 04 22:59:41 devstack sudo[107606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:41 devstack sudo[107600]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-47e77cae-242a-4b47-87ac-e4b328be5907 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c5846c4a-a87c-4490-a449-829324fc67a8.info" returned: 0 in 0.288s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:41 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-47e77cae-242a-4b47-87ac-e4b328be5907 tempest-ProjectMemberTests-1763329861 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c5846c4a-a87c-4490-a449-829324fc67a8.info is being set with open permissions: ugo+rw Sep 04 22:59:41 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-47e77cae-242a-4b47-87ac-e4b328be5907 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c5846c4a-a87c-4490-a449-829324fc67a8.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:41 devstack sudo[107608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c5846c4a-a87c-4490-a449-829324fc67a8.info Sep 04 22:59:41 devstack sudo[107608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:42 devstack sudo[107606]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ec4adca6-bbb6-4ddd-a4fb-fdf0dd94784a tempest-ProjectReaderTests-1498489724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-558772ad-d25f-41b5-b565-851f6116d40a" returned: 0 in 0.286s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:42 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-ec4adca6-bbb6-4ddd-a4fb-fdf0dd94784a tempest-ProjectReaderTests-1498489724 None] Lock "cinder-quobyte-558772ad-d25f-41b5-b565-851f6116d40a" released by "delete_volume" :: held 0.768s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:59:42 devstack sudo[107608]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-47e77cae-242a-4b47-87ac-e4b328be5907 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c5846c4a-a87c-4490-a449-829324fc67a8.info" returned: 0 in 0.291s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-47e77cae-242a-4b47-87ac-e4b328be5907 tempest-ProjectMemberTests-1763329861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.183s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:59:42 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-ec4adca6-bbb6-4ddd-a4fb-fdf0dd94784a tempest-ProjectReaderTests-1498489724 None] Created reservations ['383d615a-bd5c-4c56-af35-886f3ecfef09', 'e7e095d6-3507-4d1d-9a17-118408ea7b1b', '12c056d2-4f0c-4f20-bf23-7c686612498a', '51c644ac-a071-46c6-8cd0-893199b4c703'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:59:42 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-47e77cae-242a-4b47-87ac-e4b328be5907 tempest-ProjectMemberTests-1763329861 None] Create snapshot completed successfully Sep 04 22:59:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-ec4adca6-bbb6-4ddd-a4fb-fdf0dd94784a tempest-ProjectReaderTests-1498489724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:59:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-ec4adca6-bbb6-4ddd-a4fb-fdf0dd94784a tempest-ProjectReaderTests-1498489724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:59:42 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-ec4adca6-bbb6-4ddd-a4fb-fdf0dd94784a tempest-ProjectReaderTests-1498489724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:59:42 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-ec4adca6-bbb6-4ddd-a4fb-fdf0dd94784a tempest-ProjectReaderTests-1498489724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:59:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-ec4adca6-bbb6-4ddd-a4fb-fdf0dd94784a tempest-ProjectReaderTests-1498489724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:59:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ec4adca6-bbb6-4ddd-a4fb-fdf0dd94784a tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:42 devstack sudo[107612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:59:42 devstack sudo[107612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:42 devstack sudo[107612]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:42 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ec4adca6-bbb6-4ddd-a4fb-fdf0dd94784a tempest-ProjectReaderTests-1498489724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.313s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:42 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-ec4adca6-bbb6-4ddd-a4fb-fdf0dd94784a tempest-ProjectReaderTests-1498489724 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:59:42 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-ec4adca6-bbb6-4ddd-a4fb-fdf0dd94784a tempest-ProjectReaderTests-1498489724 None] Deleted volume successfully. Sep 04 22:59:42 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-ec4adca6-bbb6-4ddd-a4fb-fdf0dd94784a tempest-ProjectReaderTests-1498489724 None] Lock "cinder-558772ad-d25f-41b5-b565-851f6116d40a-delete_volume" released by "delete_volume" :: held 1.362s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:59:42 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-567c9cc6-d8f7-4316-a1bc-4b799ddc2631 tempest-ProjectReaderTests-1498489724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:59:43 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-567c9cc6-d8f7-4316-a1bc-4b799ddc2631 tempest-ProjectReaderTests-1498489724 None] Flow 'volume_create_manager' (250c6e8a-9838-4d8c-8f65-0500e713c35a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:59:43 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-567c9cc6-d8f7-4316-a1bc-4b799ddc2631 tempest-ProjectReaderTests-1498489724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdf67723-36e4-4f28-8e0d-2b1ce06eb1fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:43 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-567c9cc6-d8f7-4316-a1bc-4b799ddc2631 tempest-ProjectReaderTests-1498489724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdf67723-36e4-4f28-8e0d-2b1ce06eb1fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:59:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-713745265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79371d4e-3850-4e05-9c50-23b87c6f0faf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7585397571d4467c940871ba04edaa79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:59:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:59:43Z,use_quota=True,user_id='7ce20a5cf92b4a7dae47527aa9513e2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:43 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-567c9cc6-d8f7-4316-a1bc-4b799ddc2631 tempest-ProjectReaderTests-1498489724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b08e28c-d521-434b-81d6-29bfffbe72a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:43 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-567c9cc6-d8f7-4316-a1bc-4b799ddc2631 tempest-ProjectReaderTests-1498489724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b08e28c-d521-434b-81d6-29bfffbe72a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:43 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-567c9cc6-d8f7-4316-a1bc-4b799ddc2631 tempest-ProjectReaderTests-1498489724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a0c3be9-7b19-4d1f-b5d4-d2cbbf17c869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:43 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-567c9cc6-d8f7-4316-a1bc-4b799ddc2631 tempest-ProjectReaderTests-1498489724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a0c3be9-7b19-4d1f-b5d4-d2cbbf17c869) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79371d4e-3850-4e05-9c50-23b87c6f0faf', 'volume_name': 'volume-79371d4e-3850-4e05-9c50-23b87c6f0faf', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:43 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-567c9cc6-d8f7-4316-a1bc-4b799ddc2631 tempest-ProjectReaderTests-1498489724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e69eacd-986c-42e7-8887-7bb66305daad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:43 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-567c9cc6-d8f7-4316-a1bc-4b799ddc2631 tempest-ProjectReaderTests-1498489724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e69eacd-986c-42e7-8887-7bb66305daad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:43 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-567c9cc6-d8f7-4316-a1bc-4b799ddc2631 tempest-ProjectReaderTests-1498489724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c51e3f32-bdb1-4ec0-b5c4-959ff18fd55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:43 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-567c9cc6-d8f7-4316-a1bc-4b799ddc2631 tempest-ProjectReaderTests-1498489724 None] Volume 79371d4e-3850-4e05-9c50-23b87c6f0faf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79371d4e-3850-4e05-9c50-23b87c6f0faf', 'volume_size': 1} Sep 04 22:59:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-567c9cc6-d8f7-4316-a1bc-4b799ddc2631 tempest-ProjectReaderTests-1498489724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:59:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-567c9cc6-d8f7-4316-a1bc-4b799ddc2631 tempest-ProjectReaderTests-1498489724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:59:43 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-567c9cc6-d8f7-4316-a1bc-4b799ddc2631 tempest-ProjectReaderTests-1498489724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:59:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-713745265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79371d4e-3850-4e05-9c50-23b87c6f0faf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7585397571d4467c940871ba04edaa79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:59:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:59:43Z,use_quota=True,user_id='7ce20a5cf92b4a7dae47527aa9513e2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:59:43 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-567c9cc6-d8f7-4316-a1bc-4b799ddc2631 tempest-ProjectReaderTests-1498489724 None] Creating volume 79371d4e-3850-4e05-9c50-23b87c6f0faf {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:59:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-567c9cc6-d8f7-4316-a1bc-4b799ddc2631 tempest-ProjectReaderTests-1498489724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:59:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-567c9cc6-d8f7-4316-a1bc-4b799ddc2631 tempest-ProjectReaderTests-1498489724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:59:43 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-567c9cc6-d8f7-4316-a1bc-4b799ddc2631 tempest-ProjectReaderTests-1498489724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:59:43 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-567c9cc6-d8f7-4316-a1bc-4b799ddc2631 tempest-ProjectReaderTests-1498489724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:59:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-567c9cc6-d8f7-4316-a1bc-4b799ddc2631 tempest-ProjectReaderTests-1498489724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:59:43 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-567c9cc6-d8f7-4316-a1bc-4b799ddc2631 tempest-ProjectReaderTests-1498489724 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:59:43 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-567c9cc6-d8f7-4316-a1bc-4b799ddc2631 tempest-ProjectReaderTests-1498489724 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:59:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-567c9cc6-d8f7-4316-a1bc-4b799ddc2631 tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-79371d4e-3850-4e05-9c50-23b87c6f0faf 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:43 devstack sudo[107615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-79371d4e-3850-4e05-9c50-23b87c6f0faf 1073741824 Sep 04 22:59:43 devstack sudo[107615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:43 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-30dbd168-1edb-4794-a152-2da429deee02 tempest-ProjectMemberTests-1763329861 None] Acquiring lock "cinder-3e295cbf-6de6-4df3-b2ea-99d5633198e1-delete_snapshot" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:59:43 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-30dbd168-1edb-4794-a152-2da429deee02 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-3e295cbf-6de6-4df3-b2ea-99d5633198e1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:59:43 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-30dbd168-1edb-4794-a152-2da429deee02 tempest-ProjectMemberTests-1763329861 None] Acquiring lock "cinder-quobyte-c5846c4a-a87c-4490-a449-829324fc67a8" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:59:43 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-30dbd168-1edb-4794-a152-2da429deee02 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-quobyte-c5846c4a-a87c-4490-a449-829324fc67a8" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:59:43 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-30dbd168-1edb-4794-a152-2da429deee02 tempest-ProjectMemberTests-1763329861 None] Acquiring lock "cinder-quobyte-3e295cbf-6de6-4df3-b2ea-99d5633198e1" by "_delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:59:43 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-30dbd168-1edb-4794-a152-2da429deee02 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-quobyte-3e295cbf-6de6-4df3-b2ea-99d5633198e1" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:59:43 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-30dbd168-1edb-4794-a152-2da429deee02 tempest-ProjectMemberTests-1763329861 None] Deleting offline snapshot 3e295cbf-6de6-4df3-b2ea-99d5633198e1 of volume c5846c4a-a87c-4490-a449-829324fc67a8 {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 22:59:43 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-30dbd168-1edb-4794-a152-2da429deee02 tempest-ProjectMemberTests-1763329861 None] snapshot_file for this snap is: volume-c5846c4a-a87c-4490-a449-829324fc67a8.3e295cbf-6de6-4df3-b2ea-99d5633198e1 {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 22:59:43 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[524cd2e7-abc9-4e04-ac55-5d8ada5c0aa5]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:59:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-30dbd168-1edb-4794-a152-2da429deee02 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c5846c4a-a87c-4490-a449-829324fc67a8.3e295cbf-6de6-4df3-b2ea-99d5633198e1 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:43 devstack sudo[107618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c5846c4a-a87c-4490-a449-829324fc67a8.3e295cbf-6de6-4df3-b2ea-99d5633198e1 Sep 04 22:59:43 devstack sudo[107618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:43 devstack sudo[107615]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-567c9cc6-d8f7-4316-a1bc-4b799ddc2631 tempest-ProjectReaderTests-1498489724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-79371d4e-3850-4e05-9c50-23b87c6f0faf 1073741824" returned: 0 in 0.496s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-567c9cc6-d8f7-4316-a1bc-4b799ddc2631 tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-79371d4e-3850-4e05-9c50-23b87c6f0faf {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:43 devstack sudo[107626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-79371d4e-3850-4e05-9c50-23b87c6f0faf Sep 04 22:59:43 devstack sudo[107626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:43 devstack sudo[107618]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-30dbd168-1edb-4794-a152-2da429deee02 tempest-ProjectMemberTests-1763329861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c5846c4a-a87c-4490-a449-829324fc67a8.3e295cbf-6de6-4df3-b2ea-99d5633198e1" returned: 0 in 0.426s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:43 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-30dbd168-1edb-4794-a152-2da429deee02 tempest-ProjectMemberTests-1763329861 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5846c4a-a87c-4490-a449-829324fc67a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 22:59:43 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52f9728-7d8c-4e4b-a22e-3fbc9cf2e79f]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:59:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-30dbd168-1edb-4794-a152-2da429deee02 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c5846c4a-a87c-4490-a449-829324fc67a8 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:43 devstack sudo[107630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c5846c4a-a87c-4490-a449-829324fc67a8 Sep 04 22:59:43 devstack sudo[107630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:43 devstack sudo[107626]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-567c9cc6-d8f7-4316-a1bc-4b799ddc2631 tempest-ProjectReaderTests-1498489724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-79371d4e-3850-4e05-9c50-23b87c6f0faf" returned: 0 in 0.273s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:43 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-567c9cc6-d8f7-4316-a1bc-4b799ddc2631 tempest-ProjectReaderTests-1498489724 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:59:43 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-567c9cc6-d8f7-4316-a1bc-4b799ddc2631 tempest-ProjectReaderTests-1498489724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:59:43 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-567c9cc6-d8f7-4316-a1bc-4b799ddc2631 tempest-ProjectReaderTests-1498489724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c51e3f32-bdb1-4ec0-b5c4-959ff18fd55f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79371d4e-3850-4e05-9c50-23b87c6f0faf', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:43 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-567c9cc6-d8f7-4316-a1bc-4b799ddc2631 tempest-ProjectReaderTests-1498489724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26f681f3-e984-4c77-a0e3-b0c6d45d4c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:43 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-567c9cc6-d8f7-4316-a1bc-4b799ddc2631 tempest-ProjectReaderTests-1498489724 None] Volume volume-79371d4e-3850-4e05-9c50-23b87c6f0faf (79371d4e-3850-4e05-9c50-23b87c6f0faf): created successfully Sep 04 22:59:43 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-567c9cc6-d8f7-4316-a1bc-4b799ddc2631 tempest-ProjectReaderTests-1498489724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26f681f3-e984-4c77-a0e3-b0c6d45d4c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:43 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-567c9cc6-d8f7-4316-a1bc-4b799ddc2631 tempest-ProjectReaderTests-1498489724 None] Flow 'volume_create_manager' (250c6e8a-9838-4d8c-8f65-0500e713c35a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:59:43 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-567c9cc6-d8f7-4316-a1bc-4b799ddc2631 tempest-ProjectReaderTests-1498489724 None] Created volume successfully. Sep 04 22:59:44 devstack sudo[107630]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:44 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-30dbd168-1edb-4794-a152-2da429deee02 tempest-ProjectMemberTests-1763329861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c5846c4a-a87c-4490-a449-829324fc67a8" returned: 0 in 0.405s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:44 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-30dbd168-1edb-4794-a152-2da429deee02 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c5846c4a-a87c-4490-a449-829324fc67a8.3e295cbf-6de6-4df3-b2ea-99d5633198e1 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:44 devstack sudo[107636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c5846c4a-a87c-4490-a449-829324fc67a8.3e295cbf-6de6-4df3-b2ea-99d5633198e1 Sep 04 22:59:44 devstack sudo[107636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:44 devstack sudo[107636]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:44 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-30dbd168-1edb-4794-a152-2da429deee02 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c5846c4a-a87c-4490-a449-829324fc67a8.3e295cbf-6de6-4df3-b2ea-99d5633198e1" returned: 0 in 0.357s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:44 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-30dbd168-1edb-4794-a152-2da429deee02 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c5846c4a-a87c-4490-a449-829324fc67a8.3e295cbf-6de6-4df3-b2ea-99d5633198e1 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:44 devstack sudo[107642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c5846c4a-a87c-4490-a449-829324fc67a8.3e295cbf-6de6-4df3-b2ea-99d5633198e1 Sep 04 22:59:44 devstack sudo[107642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:44 devstack sudo[107642]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:44 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-30dbd168-1edb-4794-a152-2da429deee02 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c5846c4a-a87c-4490-a449-829324fc67a8.3e295cbf-6de6-4df3-b2ea-99d5633198e1" returned: 0 in 0.264s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:44 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-30dbd168-1edb-4794-a152-2da429deee02 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-quobyte-3e295cbf-6de6-4df3-b2ea-99d5633198e1" released by "_delete_snapshot" :: held 1.569s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:59:44 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-30dbd168-1edb-4794-a152-2da429deee02 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-quobyte-c5846c4a-a87c-4490-a449-829324fc67a8" released by "delete_snapshot" :: held 1.603s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:59:44 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-30dbd168-1edb-4794-a152-2da429deee02 tempest-ProjectMemberTests-1763329861 None] Created reservations ['a857c37d-4b9d-4fec-8642-86d3e7c77e08', '69c94146-81b6-49b8-bf07-374b5a0114f2', '55f3e3fa-d17f-42f0-bf97-fccb3b0a289a', '94eb82dc-de25-442c-967e-14d3b9120a0c'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:59:44 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-30dbd168-1edb-4794-a152-2da429deee02 tempest-ProjectMemberTests-1763329861 None] Delete snapshot completed successfully. Sep 04 22:59:44 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-30dbd168-1edb-4794-a152-2da429deee02 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-3e295cbf-6de6-4df3-b2ea-99d5633198e1-delete_snapshot" released by "delete_snapshot" :: held 1.754s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:59:45 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-ca49c874-77b7-404d-88c6-6a03ed61ec54 tempest-ProjectReaderTests-1498489724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:59:45 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-ca49c874-77b7-404d-88c6-6a03ed61ec54 tempest-ProjectReaderTests-1498489724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:59:45 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-ca49c874-77b7-404d-88c6-6a03ed61ec54 tempest-ProjectReaderTests-1498489724 None] Creating offline snapshot 36909e9e-9d87-4892-8161-ec17b5e8c53b of volume 79371d4e-3850-4e05-9c50-23b87c6f0faf {{(pid=87576) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 22:59:45 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e30c0c0-baad-493f-a49e-2d7d74574caa]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:59:45 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ca49c874-77b7-404d-88c6-6a03ed61ec54 tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-79371d4e-3850-4e05-9c50-23b87c6f0faf {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:45 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-41de809a-81b0-4812-8dba-a27e89574810 tempest-ProjectMemberTests-1763329861 None] Acquiring lock "cinder-c5846c4a-a87c-4490-a449-829324fc67a8-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:59:45 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-41de809a-81b0-4812-8dba-a27e89574810 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-c5846c4a-a87c-4490-a449-829324fc67a8-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:59:45 devstack sudo[107645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-79371d4e-3850-4e05-9c50-23b87c6f0faf Sep 04 22:59:45 devstack sudo[107645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:45 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-41de809a-81b0-4812-8dba-a27e89574810 tempest-ProjectMemberTests-1763329861 None] Acquiring lock "cinder-quobyte-c5846c4a-a87c-4490-a449-829324fc67a8" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:59:45 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-41de809a-81b0-4812-8dba-a27e89574810 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-quobyte-c5846c4a-a87c-4490-a449-829324fc67a8" acquired by "delete_volume" :: waited 0.020s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:59:45 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[16fcbb32-edec-4bd3-a8af-f1bb9816db60]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:59:45 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-41de809a-81b0-4812-8dba-a27e89574810 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c5846c4a-a87c-4490-a449-829324fc67a8 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:45 devstack sudo[107647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c5846c4a-a87c-4490-a449-829324fc67a8 Sep 04 22:59:45 devstack sudo[107647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:45 devstack sudo[107645]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:45 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ca49c874-77b7-404d-88c6-6a03ed61ec54 tempest-ProjectReaderTests-1498489724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-79371d4e-3850-4e05-9c50-23b87c6f0faf" returned: 0 in 0.414s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:45 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ca49c874-77b7-404d-88c6-6a03ed61ec54 tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-79371d4e-3850-4e05-9c50-23b87c6f0faf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-79371d4e-3850-4e05-9c50-23b87c6f0faf.36909e9e-9d87-4892-8161-ec17b5e8c53b 1G {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:45 devstack sudo[107652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-79371d4e-3850-4e05-9c50-23b87c6f0faf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-79371d4e-3850-4e05-9c50-23b87c6f0faf.36909e9e-9d87-4892-8161-ec17b5e8c53b 1G Sep 04 22:59:45 devstack sudo[107652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:45 devstack sudo[107647]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:45 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-41de809a-81b0-4812-8dba-a27e89574810 tempest-ProjectMemberTests-1763329861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c5846c4a-a87c-4490-a449-829324fc67a8" returned: 0 in 0.426s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:45 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-41de809a-81b0-4812-8dba-a27e89574810 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c5846c4a-a87c-4490-a449-829324fc67a8 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:46 devstack sudo[107658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c5846c4a-a87c-4490-a449-829324fc67a8 Sep 04 22:59:46 devstack sudo[107658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:46 devstack sudo[107652]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:46 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ca49c874-77b7-404d-88c6-6a03ed61ec54 tempest-ProjectReaderTests-1498489724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-79371d4e-3850-4e05-9c50-23b87c6f0faf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-79371d4e-3850-4e05-9c50-23b87c6f0faf.36909e9e-9d87-4892-8161-ec17b5e8c53b 1G" returned: 0 in 0.486s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:46 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ca49c874-77b7-404d-88c6-6a03ed61ec54 tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79371d4e-3850-4e05-9c50-23b87c6f0faf -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-79371d4e-3850-4e05-9c50-23b87c6f0faf.36909e9e-9d87-4892-8161-ec17b5e8c53b {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:46 devstack sudo[107658]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:46 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-41de809a-81b0-4812-8dba-a27e89574810 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-c5846c4a-a87c-4490-a449-829324fc67a8" returned: 0 in 0.271s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:46 devstack sudo[107666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79371d4e-3850-4e05-9c50-23b87c6f0faf -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-79371d4e-3850-4e05-9c50-23b87c6f0faf.36909e9e-9d87-4892-8161-ec17b5e8c53b Sep 04 22:59:46 devstack sudo[107666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:46 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-41de809a-81b0-4812-8dba-a27e89574810 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-quobyte-c5846c4a-a87c-4490-a449-829324fc67a8" released by "delete_volume" :: held 0.773s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:59:46 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-41de809a-81b0-4812-8dba-a27e89574810 tempest-ProjectMemberTests-1763329861 None] Created reservations ['ab158635-c51a-4ccd-ac12-8ad7ba4c11e2', '66f879c5-2dec-4b67-a99d-ce33764dc165', 'd7f18107-2e75-4842-912f-201476c07aed', 'cc44f050-1c27-452f-b375-10526d6708d3'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:59:46 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-41de809a-81b0-4812-8dba-a27e89574810 tempest-ProjectMemberTests-1763329861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:59:46 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-41de809a-81b0-4812-8dba-a27e89574810 tempest-ProjectMemberTests-1763329861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:59:46 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-41de809a-81b0-4812-8dba-a27e89574810 tempest-ProjectMemberTests-1763329861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:59:46 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-41de809a-81b0-4812-8dba-a27e89574810 tempest-ProjectMemberTests-1763329861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:59:46 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-41de809a-81b0-4812-8dba-a27e89574810 tempest-ProjectMemberTests-1763329861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:59:46 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-41de809a-81b0-4812-8dba-a27e89574810 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:46 devstack sudo[107668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:59:46 devstack sudo[107668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:46 devstack sudo[107666]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:46 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ca49c874-77b7-404d-88c6-6a03ed61ec54 tempest-ProjectReaderTests-1498489724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79371d4e-3850-4e05-9c50-23b87c6f0faf -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-79371d4e-3850-4e05-9c50-23b87c6f0faf.36909e9e-9d87-4892-8161-ec17b5e8c53b" returned: 0 in 0.340s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:46 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-ca49c874-77b7-404d-88c6-6a03ed61ec54 tempest-ProjectReaderTests-1498489724 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-79371d4e-3850-4e05-9c50-23b87c6f0faf.36909e9e-9d87-4892-8161-ec17b5e8c53b is being set with open permissions: ugo+rw Sep 04 22:59:46 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ca49c874-77b7-404d-88c6-6a03ed61ec54 tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-79371d4e-3850-4e05-9c50-23b87c6f0faf.36909e9e-9d87-4892-8161-ec17b5e8c53b {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:46 devstack sudo[107674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-79371d4e-3850-4e05-9c50-23b87c6f0faf.36909e9e-9d87-4892-8161-ec17b5e8c53b Sep 04 22:59:46 devstack sudo[107674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:46 devstack sudo[107668]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:46 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-41de809a-81b0-4812-8dba-a27e89574810 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.292s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:46 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-41de809a-81b0-4812-8dba-a27e89574810 tempest-ProjectMemberTests-1763329861 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:59:46 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-41de809a-81b0-4812-8dba-a27e89574810 tempest-ProjectMemberTests-1763329861 None] Deleted volume successfully. Sep 04 22:59:46 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-41de809a-81b0-4812-8dba-a27e89574810 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-c5846c4a-a87c-4490-a449-829324fc67a8-delete_volume" released by "delete_volume" :: held 1.308s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:59:46 devstack sudo[107674]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:46 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ca49c874-77b7-404d-88c6-6a03ed61ec54 tempest-ProjectReaderTests-1498489724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-79371d4e-3850-4e05-9c50-23b87c6f0faf.36909e9e-9d87-4892-8161-ec17b5e8c53b" returned: 0 in 0.323s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:46 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ca49c874-77b7-404d-88c6-6a03ed61ec54 tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-79371d4e-3850-4e05-9c50-23b87c6f0faf.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:46 devstack sudo[107678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-79371d4e-3850-4e05-9c50-23b87c6f0faf.info Sep 04 22:59:46 devstack sudo[107678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:47 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c7ba5f7-dbd9-49ec-b367-3bb70cd0cc47 tempest-ProjectMemberTests-1763329861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:59:47 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-7c7ba5f7-dbd9-49ec-b367-3bb70cd0cc47 tempest-ProjectMemberTests-1763329861 None] Flow 'volume_create_manager' (7ebf9fee-55d6-480a-9885-0f0ca1330802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:59:47 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-7c7ba5f7-dbd9-49ec-b367-3bb70cd0cc47 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c624fba-7fee-488d-b382-2c19d00c6029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:47 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-7c7ba5f7-dbd9-49ec-b367-3bb70cd0cc47 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c624fba-7fee-488d-b382-2c19d00c6029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:59:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1954450828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33e458d3-273e-4539-844b-d6b29aa578f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea67d0db23b2432187cdb39da7ed0530',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:59:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:59:47Z,use_quota=True,user_id='f2beadaff952455f8e8d8ab5cdc33aa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:47 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-7c7ba5f7-dbd9-49ec-b367-3bb70cd0cc47 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed8d0a1c-3bd6-483d-8ada-7120f6599092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:47 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-7c7ba5f7-dbd9-49ec-b367-3bb70cd0cc47 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed8d0a1c-3bd6-483d-8ada-7120f6599092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:47 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-7c7ba5f7-dbd9-49ec-b367-3bb70cd0cc47 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (435040fd-d2fe-492a-8828-86de872214ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:47 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-7c7ba5f7-dbd9-49ec-b367-3bb70cd0cc47 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (435040fd-d2fe-492a-8828-86de872214ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33e458d3-273e-4539-844b-d6b29aa578f5', 'volume_name': 'volume-33e458d3-273e-4539-844b-d6b29aa578f5', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:47 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-7c7ba5f7-dbd9-49ec-b367-3bb70cd0cc47 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4165af6-d11a-4730-943f-7ba73f377b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:47 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-7c7ba5f7-dbd9-49ec-b367-3bb70cd0cc47 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4165af6-d11a-4730-943f-7ba73f377b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:47 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-7c7ba5f7-dbd9-49ec-b367-3bb70cd0cc47 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3c1ff62-f234-482c-9abd-12c7e226dcdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:47 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-7c7ba5f7-dbd9-49ec-b367-3bb70cd0cc47 tempest-ProjectMemberTests-1763329861 None] Volume 33e458d3-273e-4539-844b-d6b29aa578f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33e458d3-273e-4539-844b-d6b29aa578f5', 'volume_size': 1} Sep 04 22:59:47 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-7c7ba5f7-dbd9-49ec-b367-3bb70cd0cc47 tempest-ProjectMemberTests-1763329861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:59:47 devstack sudo[107678]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:47 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ca49c874-77b7-404d-88c6-6a03ed61ec54 tempest-ProjectReaderTests-1498489724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-79371d4e-3850-4e05-9c50-23b87c6f0faf.info" returned: 0 in 0.284s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:47 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-ca49c874-77b7-404d-88c6-6a03ed61ec54 tempest-ProjectReaderTests-1498489724 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-79371d4e-3850-4e05-9c50-23b87c6f0faf.info is being set with open permissions: ugo+rw Sep 04 22:59:47 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ca49c874-77b7-404d-88c6-6a03ed61ec54 tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-79371d4e-3850-4e05-9c50-23b87c6f0faf.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:47 devstack sudo[107681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-79371d4e-3850-4e05-9c50-23b87c6f0faf.info Sep 04 22:59:47 devstack sudo[107681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:47 devstack sudo[107681]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:47 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-ca49c874-77b7-404d-88c6-6a03ed61ec54 tempest-ProjectReaderTests-1498489724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-79371d4e-3850-4e05-9c50-23b87c6f0faf.info" returned: 0 in 0.255s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:47 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-ca49c874-77b7-404d-88c6-6a03ed61ec54 tempest-ProjectReaderTests-1498489724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.209s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:59:47 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-7c7ba5f7-dbd9-49ec-b367-3bb70cd0cc47 tempest-ProjectMemberTests-1763329861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.319s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:59:47 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-7c7ba5f7-dbd9-49ec-b367-3bb70cd0cc47 tempest-ProjectMemberTests-1763329861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:59:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1954450828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33e458d3-273e-4539-844b-d6b29aa578f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea67d0db23b2432187cdb39da7ed0530',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:59:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:59:47Z,use_quota=True,user_id='f2beadaff952455f8e8d8ab5cdc33aa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:59:47 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-7c7ba5f7-dbd9-49ec-b367-3bb70cd0cc47 tempest-ProjectMemberTests-1763329861 None] Creating volume 33e458d3-273e-4539-844b-d6b29aa578f5 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:59:47 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-7c7ba5f7-dbd9-49ec-b367-3bb70cd0cc47 tempest-ProjectMemberTests-1763329861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:59:47 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-7c7ba5f7-dbd9-49ec-b367-3bb70cd0cc47 tempest-ProjectMemberTests-1763329861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:59:47 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-7c7ba5f7-dbd9-49ec-b367-3bb70cd0cc47 tempest-ProjectMemberTests-1763329861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:59:47 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-7c7ba5f7-dbd9-49ec-b367-3bb70cd0cc47 tempest-ProjectMemberTests-1763329861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:59:47 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-7c7ba5f7-dbd9-49ec-b367-3bb70cd0cc47 tempest-ProjectMemberTests-1763329861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:59:47 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-7c7ba5f7-dbd9-49ec-b367-3bb70cd0cc47 tempest-ProjectMemberTests-1763329861 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:59:47 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-7c7ba5f7-dbd9-49ec-b367-3bb70cd0cc47 tempest-ProjectMemberTests-1763329861 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:59:47 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-7c7ba5f7-dbd9-49ec-b367-3bb70cd0cc47 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-33e458d3-273e-4539-844b-d6b29aa578f5 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:47 devstack sudo[107684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-33e458d3-273e-4539-844b-d6b29aa578f5 1073741824 Sep 04 22:59:47 devstack sudo[107684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:47 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-ca49c874-77b7-404d-88c6-6a03ed61ec54 tempest-ProjectReaderTests-1498489724 None] Create snapshot completed successfully Sep 04 22:59:47 devstack sudo[107684]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:47 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-7c7ba5f7-dbd9-49ec-b367-3bb70cd0cc47 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-33e458d3-273e-4539-844b-d6b29aa578f5 1073741824" returned: 0 in 0.462s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:48 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-7c7ba5f7-dbd9-49ec-b367-3bb70cd0cc47 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-33e458d3-273e-4539-844b-d6b29aa578f5 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:48 devstack sudo[107696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-33e458d3-273e-4539-844b-d6b29aa578f5 Sep 04 22:59:48 devstack sudo[107696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:48 devstack sudo[107696]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:48 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-7c7ba5f7-dbd9-49ec-b367-3bb70cd0cc47 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-33e458d3-273e-4539-844b-d6b29aa578f5" returned: 0 in 0.281s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:48 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-7c7ba5f7-dbd9-49ec-b367-3bb70cd0cc47 tempest-ProjectMemberTests-1763329861 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:59:48 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-7c7ba5f7-dbd9-49ec-b367-3bb70cd0cc47 tempest-ProjectMemberTests-1763329861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:59:48 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-7c7ba5f7-dbd9-49ec-b367-3bb70cd0cc47 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3c1ff62-f234-482c-9abd-12c7e226dcdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33e458d3-273e-4539-844b-d6b29aa578f5', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:48 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-7c7ba5f7-dbd9-49ec-b367-3bb70cd0cc47 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb9e01ba-b357-4331-9e03-217b2de4aaa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:48 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-7c7ba5f7-dbd9-49ec-b367-3bb70cd0cc47 tempest-ProjectMemberTests-1763329861 None] Volume volume-33e458d3-273e-4539-844b-d6b29aa578f5 (33e458d3-273e-4539-844b-d6b29aa578f5): created successfully Sep 04 22:59:48 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-7c7ba5f7-dbd9-49ec-b367-3bb70cd0cc47 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb9e01ba-b357-4331-9e03-217b2de4aaa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:48 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-7c7ba5f7-dbd9-49ec-b367-3bb70cd0cc47 tempest-ProjectMemberTests-1763329861 None] Flow 'volume_create_manager' (7ebf9fee-55d6-480a-9885-0f0ca1330802) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:59:48 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-7c7ba5f7-dbd9-49ec-b367-3bb70cd0cc47 tempest-ProjectMemberTests-1763329861 None] Created volume successfully. Sep 04 22:59:48 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c9db26b1-4db8-48a5-bafd-21c9724f1dd7 tempest-ProjectReaderTests-1498489724 None] Acquiring lock "cinder-36909e9e-9d87-4892-8161-ec17b5e8c53b-delete_snapshot" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:59:48 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c9db26b1-4db8-48a5-bafd-21c9724f1dd7 tempest-ProjectReaderTests-1498489724 None] Lock "cinder-36909e9e-9d87-4892-8161-ec17b5e8c53b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:59:48 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c9db26b1-4db8-48a5-bafd-21c9724f1dd7 tempest-ProjectReaderTests-1498489724 None] Acquiring lock "cinder-quobyte-79371d4e-3850-4e05-9c50-23b87c6f0faf" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:59:48 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c9db26b1-4db8-48a5-bafd-21c9724f1dd7 tempest-ProjectReaderTests-1498489724 None] Lock "cinder-quobyte-79371d4e-3850-4e05-9c50-23b87c6f0faf" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:59:48 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c9db26b1-4db8-48a5-bafd-21c9724f1dd7 tempest-ProjectReaderTests-1498489724 None] Acquiring lock "cinder-quobyte-36909e9e-9d87-4892-8161-ec17b5e8c53b" by "_delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:59:48 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c9db26b1-4db8-48a5-bafd-21c9724f1dd7 tempest-ProjectReaderTests-1498489724 None] Lock "cinder-quobyte-36909e9e-9d87-4892-8161-ec17b5e8c53b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:59:48 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-c9db26b1-4db8-48a5-bafd-21c9724f1dd7 tempest-ProjectReaderTests-1498489724 None] Deleting offline snapshot 36909e9e-9d87-4892-8161-ec17b5e8c53b of volume 79371d4e-3850-4e05-9c50-23b87c6f0faf {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 22:59:48 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-c9db26b1-4db8-48a5-bafd-21c9724f1dd7 tempest-ProjectReaderTests-1498489724 None] snapshot_file for this snap is: volume-79371d4e-3850-4e05-9c50-23b87c6f0faf.36909e9e-9d87-4892-8161-ec17b5e8c53b {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 22:59:48 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[204e95d3-8571-40eb-b454-5993721c23b7]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:59:48 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c9db26b1-4db8-48a5-bafd-21c9724f1dd7 tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-79371d4e-3850-4e05-9c50-23b87c6f0faf.36909e9e-9d87-4892-8161-ec17b5e8c53b {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:48 devstack sudo[107699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-79371d4e-3850-4e05-9c50-23b87c6f0faf.36909e9e-9d87-4892-8161-ec17b5e8c53b Sep 04 22:59:48 devstack sudo[107699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:48 devstack sudo[107699]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:48 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c9db26b1-4db8-48a5-bafd-21c9724f1dd7 tempest-ProjectReaderTests-1498489724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-79371d4e-3850-4e05-9c50-23b87c6f0faf.36909e9e-9d87-4892-8161-ec17b5e8c53b" returned: 0 in 0.356s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:48 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-c9db26b1-4db8-48a5-bafd-21c9724f1dd7 tempest-ProjectReaderTests-1498489724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79371d4e-3850-4e05-9c50-23b87c6f0faf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 22:59:48 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[785e8fa6-283d-4e72-9fbb-000d454f15eb]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:59:48 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c9db26b1-4db8-48a5-bafd-21c9724f1dd7 tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-79371d4e-3850-4e05-9c50-23b87c6f0faf {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:49 devstack sudo[107704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-79371d4e-3850-4e05-9c50-23b87c6f0faf Sep 04 22:59:49 devstack sudo[107704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:49 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-b4419bbc-1dc6-42c7-a727-61a461498284 tempest-ProjectMemberTests-1763329861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:59:49 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-b4419bbc-1dc6-42c7-a727-61a461498284 tempest-ProjectMemberTests-1763329861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:59:49 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-b4419bbc-1dc6-42c7-a727-61a461498284 tempest-ProjectMemberTests-1763329861 None] Creating offline snapshot 9797c61f-ad5b-4dd6-8332-8df8ff501dfe of volume 33e458d3-273e-4539-844b-d6b29aa578f5 {{(pid=87576) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 22:59:49 devstack sudo[107704]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:49 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c9db26b1-4db8-48a5-bafd-21c9724f1dd7 tempest-ProjectReaderTests-1498489724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-79371d4e-3850-4e05-9c50-23b87c6f0faf" returned: 0 in 0.400s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:49 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c9db26b1-4db8-48a5-bafd-21c9724f1dd7 tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-79371d4e-3850-4e05-9c50-23b87c6f0faf.36909e9e-9d87-4892-8161-ec17b5e8c53b {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:49 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d62fff-74b0-4d8a-9066-893706ce9c73]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:59:49 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b4419bbc-1dc6-42c7-a727-61a461498284 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-33e458d3-273e-4539-844b-d6b29aa578f5 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:49 devstack sudo[107709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-79371d4e-3850-4e05-9c50-23b87c6f0faf.36909e9e-9d87-4892-8161-ec17b5e8c53b Sep 04 22:59:49 devstack sudo[107709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:49 devstack sudo[107710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-33e458d3-273e-4539-844b-d6b29aa578f5 Sep 04 22:59:49 devstack sudo[107710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:49 devstack sudo[107709]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:49 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c9db26b1-4db8-48a5-bafd-21c9724f1dd7 tempest-ProjectReaderTests-1498489724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-79371d4e-3850-4e05-9c50-23b87c6f0faf.36909e9e-9d87-4892-8161-ec17b5e8c53b" returned: 0 in 0.331s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:49 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c9db26b1-4db8-48a5-bafd-21c9724f1dd7 tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-79371d4e-3850-4e05-9c50-23b87c6f0faf.36909e9e-9d87-4892-8161-ec17b5e8c53b {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:49 devstack sudo[107718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-79371d4e-3850-4e05-9c50-23b87c6f0faf.36909e9e-9d87-4892-8161-ec17b5e8c53b Sep 04 22:59:49 devstack sudo[107718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:49 devstack sudo[107710]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:49 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b4419bbc-1dc6-42c7-a727-61a461498284 tempest-ProjectMemberTests-1763329861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-33e458d3-273e-4539-844b-d6b29aa578f5" returned: 0 in 0.388s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:49 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b4419bbc-1dc6-42c7-a727-61a461498284 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-33e458d3-273e-4539-844b-d6b29aa578f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-33e458d3-273e-4539-844b-d6b29aa578f5.9797c61f-ad5b-4dd6-8332-8df8ff501dfe 1G {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:49 devstack sudo[107721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-33e458d3-273e-4539-844b-d6b29aa578f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-33e458d3-273e-4539-844b-d6b29aa578f5.9797c61f-ad5b-4dd6-8332-8df8ff501dfe 1G Sep 04 22:59:49 devstack sudo[107721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:49 devstack sudo[107718]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:49 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c9db26b1-4db8-48a5-bafd-21c9724f1dd7 tempest-ProjectReaderTests-1498489724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-79371d4e-3850-4e05-9c50-23b87c6f0faf.36909e9e-9d87-4892-8161-ec17b5e8c53b" returned: 0 in 0.268s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:49 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c9db26b1-4db8-48a5-bafd-21c9724f1dd7 tempest-ProjectReaderTests-1498489724 None] Lock "cinder-quobyte-36909e9e-9d87-4892-8161-ec17b5e8c53b" released by "_delete_snapshot" :: held 1.446s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:59:49 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c9db26b1-4db8-48a5-bafd-21c9724f1dd7 tempest-ProjectReaderTests-1498489724 None] Lock "cinder-quobyte-79371d4e-3850-4e05-9c50-23b87c6f0faf" released by "delete_snapshot" :: held 1.472s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:59:50 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-c9db26b1-4db8-48a5-bafd-21c9724f1dd7 tempest-ProjectReaderTests-1498489724 None] Created reservations ['8c42af97-91a0-4b5e-8a6d-f3bbb48af9b4', '75403b45-b356-4fe1-83db-e63c887e02db', '48ff3d14-6490-4e05-be0c-b209ccb75249', '61fc4211-48f6-42e1-9695-3aeda2778619'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:59:50 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-c9db26b1-4db8-48a5-bafd-21c9724f1dd7 tempest-ProjectReaderTests-1498489724 None] Delete snapshot completed successfully. Sep 04 22:59:50 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-c9db26b1-4db8-48a5-bafd-21c9724f1dd7 tempest-ProjectReaderTests-1498489724 None] Lock "cinder-36909e9e-9d87-4892-8161-ec17b5e8c53b-delete_snapshot" released by "delete_snapshot" :: held 1.632s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:59:50 devstack sudo[107721]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:50 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b4419bbc-1dc6-42c7-a727-61a461498284 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-33e458d3-273e-4539-844b-d6b29aa578f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-33e458d3-273e-4539-844b-d6b29aa578f5.9797c61f-ad5b-4dd6-8332-8df8ff501dfe 1G" returned: 0 in 0.440s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:50 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b4419bbc-1dc6-42c7-a727-61a461498284 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33e458d3-273e-4539-844b-d6b29aa578f5 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-33e458d3-273e-4539-844b-d6b29aa578f5.9797c61f-ad5b-4dd6-8332-8df8ff501dfe {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:50 devstack sudo[107729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33e458d3-273e-4539-844b-d6b29aa578f5 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-33e458d3-273e-4539-844b-d6b29aa578f5.9797c61f-ad5b-4dd6-8332-8df8ff501dfe Sep 04 22:59:50 devstack sudo[107729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:50 devstack sudo[107729]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:50 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b4419bbc-1dc6-42c7-a727-61a461498284 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33e458d3-273e-4539-844b-d6b29aa578f5 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-33e458d3-273e-4539-844b-d6b29aa578f5.9797c61f-ad5b-4dd6-8332-8df8ff501dfe" returned: 0 in 0.296s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:50 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-b4419bbc-1dc6-42c7-a727-61a461498284 tempest-ProjectMemberTests-1763329861 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-33e458d3-273e-4539-844b-d6b29aa578f5.9797c61f-ad5b-4dd6-8332-8df8ff501dfe is being set with open permissions: ugo+rw Sep 04 22:59:50 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b4419bbc-1dc6-42c7-a727-61a461498284 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-33e458d3-273e-4539-844b-d6b29aa578f5.9797c61f-ad5b-4dd6-8332-8df8ff501dfe {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:50 devstack sudo[107734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-33e458d3-273e-4539-844b-d6b29aa578f5.9797c61f-ad5b-4dd6-8332-8df8ff501dfe Sep 04 22:59:50 devstack sudo[107734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:50 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-49a92671-1903-4179-ac76-6b88655252e3 tempest-ProjectReaderTests-1498489724 None] Acquiring lock "cinder-79371d4e-3850-4e05-9c50-23b87c6f0faf-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:59:50 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-49a92671-1903-4179-ac76-6b88655252e3 tempest-ProjectReaderTests-1498489724 None] Lock "cinder-79371d4e-3850-4e05-9c50-23b87c6f0faf-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:59:50 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-49a92671-1903-4179-ac76-6b88655252e3 tempest-ProjectReaderTests-1498489724 None] Acquiring lock "cinder-quobyte-79371d4e-3850-4e05-9c50-23b87c6f0faf" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:59:50 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-49a92671-1903-4179-ac76-6b88655252e3 tempest-ProjectReaderTests-1498489724 None] Lock "cinder-quobyte-79371d4e-3850-4e05-9c50-23b87c6f0faf" acquired by "delete_volume" :: waited 0.017s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:59:50 devstack sudo[107734]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:50 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b4419bbc-1dc6-42c7-a727-61a461498284 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-33e458d3-273e-4539-844b-d6b29aa578f5.9797c61f-ad5b-4dd6-8332-8df8ff501dfe" returned: 0 in 0.269s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:50 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[825aa8ae-d4ef-438e-bad1-3180d8c3eca5]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:59:50 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-49a92671-1903-4179-ac76-6b88655252e3 tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-79371d4e-3850-4e05-9c50-23b87c6f0faf {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:50 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b4419bbc-1dc6-42c7-a727-61a461498284 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-33e458d3-273e-4539-844b-d6b29aa578f5.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:50 devstack sudo[107738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-33e458d3-273e-4539-844b-d6b29aa578f5.info Sep 04 22:59:50 devstack sudo[107738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:50 devstack sudo[107737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-79371d4e-3850-4e05-9c50-23b87c6f0faf Sep 04 22:59:50 devstack sudo[107737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:51 devstack sudo[107738]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:51 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b4419bbc-1dc6-42c7-a727-61a461498284 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-33e458d3-273e-4539-844b-d6b29aa578f5.info" returned: 0 in 0.260s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:51 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-b4419bbc-1dc6-42c7-a727-61a461498284 tempest-ProjectMemberTests-1763329861 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-33e458d3-273e-4539-844b-d6b29aa578f5.info is being set with open permissions: ugo+rw Sep 04 22:59:51 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b4419bbc-1dc6-42c7-a727-61a461498284 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-33e458d3-273e-4539-844b-d6b29aa578f5.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:51 devstack sudo[107742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-33e458d3-273e-4539-844b-d6b29aa578f5.info Sep 04 22:59:51 devstack sudo[107742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:51 devstack sudo[107737]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:51 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-49a92671-1903-4179-ac76-6b88655252e3 tempest-ProjectReaderTests-1498489724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-79371d4e-3850-4e05-9c50-23b87c6f0faf" returned: 0 in 0.382s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:51 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-49a92671-1903-4179-ac76-6b88655252e3 tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-79371d4e-3850-4e05-9c50-23b87c6f0faf {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:51 devstack sudo[107747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-79371d4e-3850-4e05-9c50-23b87c6f0faf Sep 04 22:59:51 devstack sudo[107747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:51 devstack sudo[107742]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:51 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b4419bbc-1dc6-42c7-a727-61a461498284 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-33e458d3-273e-4539-844b-d6b29aa578f5.info" returned: 0 in 0.246s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:51 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-b4419bbc-1dc6-42c7-a727-61a461498284 tempest-ProjectMemberTests-1763329861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.014s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:59:51 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-b4419bbc-1dc6-42c7-a727-61a461498284 tempest-ProjectMemberTests-1763329861 None] Create snapshot completed successfully Sep 04 22:59:51 devstack sudo[107747]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:51 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-49a92671-1903-4179-ac76-6b88655252e3 tempest-ProjectReaderTests-1498489724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-79371d4e-3850-4e05-9c50-23b87c6f0faf" returned: 0 in 0.252s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:51 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-49a92671-1903-4179-ac76-6b88655252e3 tempest-ProjectReaderTests-1498489724 None] Lock "cinder-quobyte-79371d4e-3850-4e05-9c50-23b87c6f0faf" released by "delete_volume" :: held 0.699s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:59:51 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-49a92671-1903-4179-ac76-6b88655252e3 tempest-ProjectReaderTests-1498489724 None] Created reservations ['f7947566-8ce1-48f4-92a9-22b8b5034545', '384df803-3a81-4ed4-a0d9-6df6672c3518', '88807da2-f712-494b-a042-f2202d60d5a1', 'abd0a0ed-6842-490a-9573-725664a71638'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:59:51 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-49a92671-1903-4179-ac76-6b88655252e3 tempest-ProjectReaderTests-1498489724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:59:51 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-49a92671-1903-4179-ac76-6b88655252e3 tempest-ProjectReaderTests-1498489724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:59:51 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-49a92671-1903-4179-ac76-6b88655252e3 tempest-ProjectReaderTests-1498489724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:59:51 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-49a92671-1903-4179-ac76-6b88655252e3 tempest-ProjectReaderTests-1498489724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:59:51 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-49a92671-1903-4179-ac76-6b88655252e3 tempest-ProjectReaderTests-1498489724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:59:51 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-49a92671-1903-4179-ac76-6b88655252e3 tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:51 devstack sudo[107751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:59:51 devstack sudo[107751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:51 devstack sudo[107751]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:51 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-49a92671-1903-4179-ac76-6b88655252e3 tempest-ProjectReaderTests-1498489724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.256s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:51 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-49a92671-1903-4179-ac76-6b88655252e3 tempest-ProjectReaderTests-1498489724 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:59:51 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-49a92671-1903-4179-ac76-6b88655252e3 tempest-ProjectReaderTests-1498489724 None] Deleted volume successfully. Sep 04 22:59:51 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-49a92671-1903-4179-ac76-6b88655252e3 tempest-ProjectReaderTests-1498489724 None] Lock "cinder-79371d4e-3850-4e05-9c50-23b87c6f0faf-delete_volume" released by "delete_volume" :: held 1.153s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:59:52 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-0428de61-e603-40ee-8eb2-08120bb6b933 tempest-ProjectReaderTests-1498489724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:59:52 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0428de61-e603-40ee-8eb2-08120bb6b933 tempest-ProjectReaderTests-1498489724 None] Flow 'volume_create_manager' (9d199e9e-229f-4278-acbe-41bf0d026429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:59:52 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0428de61-e603-40ee-8eb2-08120bb6b933 tempest-ProjectReaderTests-1498489724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3069e49e-3e0d-48bd-9d42-9057eb9bf3b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:52 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0428de61-e603-40ee-8eb2-08120bb6b933 tempest-ProjectReaderTests-1498489724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3069e49e-3e0d-48bd-9d42-9057eb9bf3b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:59:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-850275442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bb69e48-5b99-4631-b05f-0ac8a50dbf8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7585397571d4467c940871ba04edaa79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:59:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:59:52Z,use_quota=True,user_id='7ce20a5cf92b4a7dae47527aa9513e2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:52 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0428de61-e603-40ee-8eb2-08120bb6b933 tempest-ProjectReaderTests-1498489724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3d6a0fe-0f97-46d2-814a-7fd0e4bca8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:52 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0428de61-e603-40ee-8eb2-08120bb6b933 tempest-ProjectReaderTests-1498489724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3d6a0fe-0f97-46d2-814a-7fd0e4bca8f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:52 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0428de61-e603-40ee-8eb2-08120bb6b933 tempest-ProjectReaderTests-1498489724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23dfb884-5e27-4f1e-8537-df6ebd892f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:52 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0428de61-e603-40ee-8eb2-08120bb6b933 tempest-ProjectReaderTests-1498489724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23dfb884-5e27-4f1e-8537-df6ebd892f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bb69e48-5b99-4631-b05f-0ac8a50dbf8c', 'volume_name': 'volume-9bb69e48-5b99-4631-b05f-0ac8a50dbf8c', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:52 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0428de61-e603-40ee-8eb2-08120bb6b933 tempest-ProjectReaderTests-1498489724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ea90c97-0fb4-42ef-b0c7-f6ac93e64833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:52 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0428de61-e603-40ee-8eb2-08120bb6b933 tempest-ProjectReaderTests-1498489724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ea90c97-0fb4-42ef-b0c7-f6ac93e64833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:52 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0428de61-e603-40ee-8eb2-08120bb6b933 tempest-ProjectReaderTests-1498489724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da9cc347-08e5-401d-befd-77da1e70e159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:52 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-0428de61-e603-40ee-8eb2-08120bb6b933 tempest-ProjectReaderTests-1498489724 None] Volume 9bb69e48-5b99-4631-b05f-0ac8a50dbf8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bb69e48-5b99-4631-b05f-0ac8a50dbf8c', 'volume_size': 1} Sep 04 22:59:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-0428de61-e603-40ee-8eb2-08120bb6b933 tempest-ProjectReaderTests-1498489724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:59:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-0428de61-e603-40ee-8eb2-08120bb6b933 tempest-ProjectReaderTests-1498489724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:59:52 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-0428de61-e603-40ee-8eb2-08120bb6b933 tempest-ProjectReaderTests-1498489724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:59:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-850275442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bb69e48-5b99-4631-b05f-0ac8a50dbf8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7585397571d4467c940871ba04edaa79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:59:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:59:52Z,use_quota=True,user_id='7ce20a5cf92b4a7dae47527aa9513e2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:59:52 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-0428de61-e603-40ee-8eb2-08120bb6b933 tempest-ProjectReaderTests-1498489724 None] Creating volume 9bb69e48-5b99-4631-b05f-0ac8a50dbf8c {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:59:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-0428de61-e603-40ee-8eb2-08120bb6b933 tempest-ProjectReaderTests-1498489724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:59:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-0428de61-e603-40ee-8eb2-08120bb6b933 tempest-ProjectReaderTests-1498489724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:59:52 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-0428de61-e603-40ee-8eb2-08120bb6b933 tempest-ProjectReaderTests-1498489724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:59:52 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-0428de61-e603-40ee-8eb2-08120bb6b933 tempest-ProjectReaderTests-1498489724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:59:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-0428de61-e603-40ee-8eb2-08120bb6b933 tempest-ProjectReaderTests-1498489724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:59:52 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-0428de61-e603-40ee-8eb2-08120bb6b933 tempest-ProjectReaderTests-1498489724 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:59:52 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-0428de61-e603-40ee-8eb2-08120bb6b933 tempest-ProjectReaderTests-1498489724 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:59:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0428de61-e603-40ee-8eb2-08120bb6b933 tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9bb69e48-5b99-4631-b05f-0ac8a50dbf8c 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:52 devstack sudo[107754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9bb69e48-5b99-4631-b05f-0ac8a50dbf8c 1073741824 Sep 04 22:59:52 devstack sudo[107754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:52 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-27189b24-c82d-4351-9a4b-29c8188751c1 tempest-ProjectMemberTests-1763329861 None] Acquiring lock "cinder-9797c61f-ad5b-4dd6-8332-8df8ff501dfe-delete_snapshot" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:59:52 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-27189b24-c82d-4351-9a4b-29c8188751c1 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-9797c61f-ad5b-4dd6-8332-8df8ff501dfe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:59:52 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-27189b24-c82d-4351-9a4b-29c8188751c1 tempest-ProjectMemberTests-1763329861 None] Acquiring lock "cinder-quobyte-33e458d3-273e-4539-844b-d6b29aa578f5" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:59:52 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-27189b24-c82d-4351-9a4b-29c8188751c1 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-quobyte-33e458d3-273e-4539-844b-d6b29aa578f5" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:59:52 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-27189b24-c82d-4351-9a4b-29c8188751c1 tempest-ProjectMemberTests-1763329861 None] Acquiring lock "cinder-quobyte-9797c61f-ad5b-4dd6-8332-8df8ff501dfe" by "_delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:59:52 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-27189b24-c82d-4351-9a4b-29c8188751c1 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-quobyte-9797c61f-ad5b-4dd6-8332-8df8ff501dfe" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:59:52 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-27189b24-c82d-4351-9a4b-29c8188751c1 tempest-ProjectMemberTests-1763329861 None] Deleting offline snapshot 9797c61f-ad5b-4dd6-8332-8df8ff501dfe of volume 33e458d3-273e-4539-844b-d6b29aa578f5 {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 22:59:52 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-27189b24-c82d-4351-9a4b-29c8188751c1 tempest-ProjectMemberTests-1763329861 None] snapshot_file for this snap is: volume-33e458d3-273e-4539-844b-d6b29aa578f5.9797c61f-ad5b-4dd6-8332-8df8ff501dfe {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 22:59:52 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4e81fd-8755-43b7-9dfa-b5cfdb2f86fd]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:59:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-27189b24-c82d-4351-9a4b-29c8188751c1 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-33e458d3-273e-4539-844b-d6b29aa578f5.9797c61f-ad5b-4dd6-8332-8df8ff501dfe {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:52 devstack sudo[107759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-33e458d3-273e-4539-844b-d6b29aa578f5.9797c61f-ad5b-4dd6-8332-8df8ff501dfe Sep 04 22:59:52 devstack sudo[107759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:52 devstack sudo[107754]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0428de61-e603-40ee-8eb2-08120bb6b933 tempest-ProjectReaderTests-1498489724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9bb69e48-5b99-4631-b05f-0ac8a50dbf8c 1073741824" returned: 0 in 0.399s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0428de61-e603-40ee-8eb2-08120bb6b933 tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9bb69e48-5b99-4631-b05f-0ac8a50dbf8c {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:52 devstack sudo[107762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9bb69e48-5b99-4631-b05f-0ac8a50dbf8c Sep 04 22:59:52 devstack sudo[107762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:52 devstack sudo[107759]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-27189b24-c82d-4351-9a4b-29c8188751c1 tempest-ProjectMemberTests-1763329861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-33e458d3-273e-4539-844b-d6b29aa578f5.9797c61f-ad5b-4dd6-8332-8df8ff501dfe" returned: 0 in 0.392s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:52 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-27189b24-c82d-4351-9a4b-29c8188751c1 tempest-ProjectMemberTests-1763329861 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33e458d3-273e-4539-844b-d6b29aa578f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 22:59:52 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[08acc830-5014-4d38-9fc8-0013505620f4]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:59:52 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-27189b24-c82d-4351-9a4b-29c8188751c1 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-33e458d3-273e-4539-844b-d6b29aa578f5 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:53 devstack sudo[107762]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:53 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-0428de61-e603-40ee-8eb2-08120bb6b933 tempest-ProjectReaderTests-1498489724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9bb69e48-5b99-4631-b05f-0ac8a50dbf8c" returned: 0 in 0.261s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:53 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-0428de61-e603-40ee-8eb2-08120bb6b933 tempest-ProjectReaderTests-1498489724 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:59:53 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-0428de61-e603-40ee-8eb2-08120bb6b933 tempest-ProjectReaderTests-1498489724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:59:53 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0428de61-e603-40ee-8eb2-08120bb6b933 tempest-ProjectReaderTests-1498489724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da9cc347-08e5-401d-befd-77da1e70e159) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bb69e48-5b99-4631-b05f-0ac8a50dbf8c', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:53 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0428de61-e603-40ee-8eb2-08120bb6b933 tempest-ProjectReaderTests-1498489724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9135db6-ec7f-42fa-a729-18e785b9a006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:53 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-0428de61-e603-40ee-8eb2-08120bb6b933 tempest-ProjectReaderTests-1498489724 None] Volume volume-9bb69e48-5b99-4631-b05f-0ac8a50dbf8c (9bb69e48-5b99-4631-b05f-0ac8a50dbf8c): created successfully Sep 04 22:59:53 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0428de61-e603-40ee-8eb2-08120bb6b933 tempest-ProjectReaderTests-1498489724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9135db6-ec7f-42fa-a729-18e785b9a006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:53 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-0428de61-e603-40ee-8eb2-08120bb6b933 tempest-ProjectReaderTests-1498489724 None] Flow 'volume_create_manager' (9d199e9e-229f-4278-acbe-41bf0d026429) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:59:53 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-0428de61-e603-40ee-8eb2-08120bb6b933 tempest-ProjectReaderTests-1498489724 None] Created volume successfully. Sep 04 22:59:53 devstack sudo[107768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-33e458d3-273e-4539-844b-d6b29aa578f5 Sep 04 22:59:53 devstack sudo[107768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:53 devstack sudo[107768]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:53 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-27189b24-c82d-4351-9a4b-29c8188751c1 tempest-ProjectMemberTests-1763329861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-33e458d3-273e-4539-844b-d6b29aa578f5" returned: 0 in 0.386s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:53 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-27189b24-c82d-4351-9a4b-29c8188751c1 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-33e458d3-273e-4539-844b-d6b29aa578f5.9797c61f-ad5b-4dd6-8332-8df8ff501dfe {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:53 devstack sudo[107774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-33e458d3-273e-4539-844b-d6b29aa578f5.9797c61f-ad5b-4dd6-8332-8df8ff501dfe Sep 04 22:59:53 devstack sudo[107774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:53 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-2bd80217-e07a-4623-9128-822066dc4987 tempest-ProjectReaderTests-1498489724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:59:53 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-2bd80217-e07a-4623-9128-822066dc4987 tempest-ProjectReaderTests-1498489724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:59:53 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-2bd80217-e07a-4623-9128-822066dc4987 tempest-ProjectReaderTests-1498489724 None] Creating offline snapshot 64d12d08-0771-4028-b591-270434c94a1b of volume 9bb69e48-5b99-4631-b05f-0ac8a50dbf8c {{(pid=87576) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 22:59:53 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36f0401-a62d-41ad-8c23-c07c87c37203]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:59:53 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2bd80217-e07a-4623-9128-822066dc4987 tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9bb69e48-5b99-4631-b05f-0ac8a50dbf8c {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:53 devstack sudo[107776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9bb69e48-5b99-4631-b05f-0ac8a50dbf8c Sep 04 22:59:53 devstack sudo[107776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:53 devstack sudo[107774]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:53 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-27189b24-c82d-4351-9a4b-29c8188751c1 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-33e458d3-273e-4539-844b-d6b29aa578f5.9797c61f-ad5b-4dd6-8332-8df8ff501dfe" returned: 0 in 0.343s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:53 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-27189b24-c82d-4351-9a4b-29c8188751c1 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-33e458d3-273e-4539-844b-d6b29aa578f5.9797c61f-ad5b-4dd6-8332-8df8ff501dfe {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:53 devstack sudo[107781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-33e458d3-273e-4539-844b-d6b29aa578f5.9797c61f-ad5b-4dd6-8332-8df8ff501dfe Sep 04 22:59:53 devstack sudo[107781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:53 devstack sudo[107776]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:53 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2bd80217-e07a-4623-9128-822066dc4987 tempest-ProjectReaderTests-1498489724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9bb69e48-5b99-4631-b05f-0ac8a50dbf8c" returned: 0 in 0.371s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:53 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2bd80217-e07a-4623-9128-822066dc4987 tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9bb69e48-5b99-4631-b05f-0ac8a50dbf8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9bb69e48-5b99-4631-b05f-0ac8a50dbf8c.64d12d08-0771-4028-b591-270434c94a1b 1G {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:53 devstack sudo[107786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9bb69e48-5b99-4631-b05f-0ac8a50dbf8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9bb69e48-5b99-4631-b05f-0ac8a50dbf8c.64d12d08-0771-4028-b591-270434c94a1b 1G Sep 04 22:59:53 devstack sudo[107786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:53 devstack sudo[107781]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:53 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-27189b24-c82d-4351-9a4b-29c8188751c1 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-33e458d3-273e-4539-844b-d6b29aa578f5.9797c61f-ad5b-4dd6-8332-8df8ff501dfe" returned: 0 in 0.250s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:54 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-27189b24-c82d-4351-9a4b-29c8188751c1 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-quobyte-9797c61f-ad5b-4dd6-8332-8df8ff501dfe" released by "_delete_snapshot" :: held 1.463s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:59:54 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-27189b24-c82d-4351-9a4b-29c8188751c1 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-quobyte-33e458d3-273e-4539-844b-d6b29aa578f5" released by "delete_snapshot" :: held 1.484s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:59:54 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-27189b24-c82d-4351-9a4b-29c8188751c1 tempest-ProjectMemberTests-1763329861 None] Created reservations ['6fed45ad-0249-4507-9849-f4f2b8b89d7e', 'ffbec2f8-da24-4f1a-a27c-fc1aef97cf3f', '348cc1da-73c4-466d-ae4f-7a2dd55b4bdb', '2ed6848d-6431-40e9-98ce-c96574638cad'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:59:54 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-27189b24-c82d-4351-9a4b-29c8188751c1 tempest-ProjectMemberTests-1763329861 None] Delete snapshot completed successfully. Sep 04 22:59:54 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-27189b24-c82d-4351-9a4b-29c8188751c1 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-9797c61f-ad5b-4dd6-8332-8df8ff501dfe-delete_snapshot" released by "delete_snapshot" :: held 1.624s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:59:54 devstack sudo[107786]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2bd80217-e07a-4623-9128-822066dc4987 tempest-ProjectReaderTests-1498489724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9bb69e48-5b99-4631-b05f-0ac8a50dbf8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9bb69e48-5b99-4631-b05f-0ac8a50dbf8c.64d12d08-0771-4028-b591-270434c94a1b 1G" returned: 0 in 0.402s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2bd80217-e07a-4623-9128-822066dc4987 tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bb69e48-5b99-4631-b05f-0ac8a50dbf8c -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9bb69e48-5b99-4631-b05f-0ac8a50dbf8c.64d12d08-0771-4028-b591-270434c94a1b {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:54 devstack sudo[107792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bb69e48-5b99-4631-b05f-0ac8a50dbf8c -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9bb69e48-5b99-4631-b05f-0ac8a50dbf8c.64d12d08-0771-4028-b591-270434c94a1b Sep 04 22:59:54 devstack sudo[107792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:54 devstack sudo[107792]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2bd80217-e07a-4623-9128-822066dc4987 tempest-ProjectReaderTests-1498489724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bb69e48-5b99-4631-b05f-0ac8a50dbf8c -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9bb69e48-5b99-4631-b05f-0ac8a50dbf8c.64d12d08-0771-4028-b591-270434c94a1b" returned: 0 in 0.284s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:54 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-2bd80217-e07a-4623-9128-822066dc4987 tempest-ProjectReaderTests-1498489724 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9bb69e48-5b99-4631-b05f-0ac8a50dbf8c.64d12d08-0771-4028-b591-270434c94a1b is being set with open permissions: ugo+rw Sep 04 22:59:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2bd80217-e07a-4623-9128-822066dc4987 tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9bb69e48-5b99-4631-b05f-0ac8a50dbf8c.64d12d08-0771-4028-b591-270434c94a1b {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:54 devstack sudo[107797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9bb69e48-5b99-4631-b05f-0ac8a50dbf8c.64d12d08-0771-4028-b591-270434c94a1b Sep 04 22:59:54 devstack sudo[107797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:54 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-4d7f0d49-cf1c-4677-b435-371211e571ea tempest-ProjectMemberTests-1763329861 None] Acquiring lock "cinder-33e458d3-273e-4539-844b-d6b29aa578f5-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:59:54 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-4d7f0d49-cf1c-4677-b435-371211e571ea tempest-ProjectMemberTests-1763329861 None] Lock "cinder-33e458d3-273e-4539-844b-d6b29aa578f5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:59:54 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-4d7f0d49-cf1c-4677-b435-371211e571ea tempest-ProjectMemberTests-1763329861 None] Acquiring lock "cinder-quobyte-33e458d3-273e-4539-844b-d6b29aa578f5" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:59:54 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-4d7f0d49-cf1c-4677-b435-371211e571ea tempest-ProjectMemberTests-1763329861 None] Lock "cinder-quobyte-33e458d3-273e-4539-844b-d6b29aa578f5" acquired by "delete_volume" :: waited 0.016s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:59:54 devstack sudo[107797]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2bd80217-e07a-4623-9128-822066dc4987 tempest-ProjectReaderTests-1498489724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9bb69e48-5b99-4631-b05f-0ac8a50dbf8c.64d12d08-0771-4028-b591-270434c94a1b" returned: 0 in 0.249s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:54 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[2682cf2a-b4c3-49e7-b7a0-e23673e07e70]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:59:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4d7f0d49-cf1c-4677-b435-371211e571ea tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-33e458d3-273e-4539-844b-d6b29aa578f5 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:54 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2bd80217-e07a-4623-9128-822066dc4987 tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9bb69e48-5b99-4631-b05f-0ac8a50dbf8c.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:54 devstack sudo[107801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9bb69e48-5b99-4631-b05f-0ac8a50dbf8c.info Sep 04 22:59:54 devstack sudo[107801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:54 devstack sudo[107800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-33e458d3-273e-4539-844b-d6b29aa578f5 Sep 04 22:59:54 devstack sudo[107800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:55 devstack sudo[107801]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2bd80217-e07a-4623-9128-822066dc4987 tempest-ProjectReaderTests-1498489724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9bb69e48-5b99-4631-b05f-0ac8a50dbf8c.info" returned: 0 in 0.253s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:55 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-2bd80217-e07a-4623-9128-822066dc4987 tempest-ProjectReaderTests-1498489724 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9bb69e48-5b99-4631-b05f-0ac8a50dbf8c.info is being set with open permissions: ugo+rw Sep 04 22:59:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2bd80217-e07a-4623-9128-822066dc4987 tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9bb69e48-5b99-4631-b05f-0ac8a50dbf8c.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:55 devstack sudo[107807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9bb69e48-5b99-4631-b05f-0ac8a50dbf8c.info Sep 04 22:59:55 devstack sudo[107807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:55 devstack sudo[107800]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4d7f0d49-cf1c-4677-b435-371211e571ea tempest-ProjectMemberTests-1763329861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-33e458d3-273e-4539-844b-d6b29aa578f5" returned: 0 in 0.360s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4d7f0d49-cf1c-4677-b435-371211e571ea tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-33e458d3-273e-4539-844b-d6b29aa578f5 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:55 devstack sudo[107810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-33e458d3-273e-4539-844b-d6b29aa578f5 Sep 04 22:59:55 devstack sudo[107810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:55 devstack sudo[107807]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2bd80217-e07a-4623-9128-822066dc4987 tempest-ProjectReaderTests-1498489724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9bb69e48-5b99-4631-b05f-0ac8a50dbf8c.info" returned: 0 in 0.247s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-2bd80217-e07a-4623-9128-822066dc4987 tempest-ProjectReaderTests-1498489724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.902s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:59:55 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-2bd80217-e07a-4623-9128-822066dc4987 tempest-ProjectReaderTests-1498489724 None] Create snapshot completed successfully Sep 04 22:59:55 devstack sudo[107810]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4d7f0d49-cf1c-4677-b435-371211e571ea tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-33e458d3-273e-4539-844b-d6b29aa578f5" returned: 0 in 0.255s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:55 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-4d7f0d49-cf1c-4677-b435-371211e571ea tempest-ProjectMemberTests-1763329861 None] Lock "cinder-quobyte-33e458d3-273e-4539-844b-d6b29aa578f5" released by "delete_volume" :: held 0.672s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:59:55 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-4d7f0d49-cf1c-4677-b435-371211e571ea tempest-ProjectMemberTests-1763329861 None] Created reservations ['c6e2a5d5-a644-4264-8a91-0cfc9af826eb', 'a1c83aa1-e2ca-4cb2-bb97-70005c383b27', 'c592e64e-e402-41b3-be31-02b0d08b789b', '682ce8c7-0491-4062-8ae3-cbe9e5b5da04'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:59:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-4d7f0d49-cf1c-4677-b435-371211e571ea tempest-ProjectMemberTests-1763329861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:59:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-4d7f0d49-cf1c-4677-b435-371211e571ea tempest-ProjectMemberTests-1763329861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:59:55 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-4d7f0d49-cf1c-4677-b435-371211e571ea tempest-ProjectMemberTests-1763329861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:59:55 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-4d7f0d49-cf1c-4677-b435-371211e571ea tempest-ProjectMemberTests-1763329861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:59:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-4d7f0d49-cf1c-4677-b435-371211e571ea tempest-ProjectMemberTests-1763329861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:59:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4d7f0d49-cf1c-4677-b435-371211e571ea tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:55 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-b060fb73-60fa-45bf-92c6-a52a6cf292a0 tempest-ProjectReaderTests-1498489724 None] Acquiring lock "cinder-64d12d08-0771-4028-b591-270434c94a1b-delete_snapshot" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:59:55 devstack sudo[107814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:59:55 devstack sudo[107814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:55 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-b060fb73-60fa-45bf-92c6-a52a6cf292a0 tempest-ProjectReaderTests-1498489724 None] Lock "cinder-64d12d08-0771-4028-b591-270434c94a1b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:59:55 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-b060fb73-60fa-45bf-92c6-a52a6cf292a0 tempest-ProjectReaderTests-1498489724 None] Acquiring lock "cinder-quobyte-9bb69e48-5b99-4631-b05f-0ac8a50dbf8c" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:59:55 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-b060fb73-60fa-45bf-92c6-a52a6cf292a0 tempest-ProjectReaderTests-1498489724 None] Lock "cinder-quobyte-9bb69e48-5b99-4631-b05f-0ac8a50dbf8c" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:59:55 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-b060fb73-60fa-45bf-92c6-a52a6cf292a0 tempest-ProjectReaderTests-1498489724 None] Acquiring lock "cinder-quobyte-64d12d08-0771-4028-b591-270434c94a1b" by "_delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:59:55 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-b060fb73-60fa-45bf-92c6-a52a6cf292a0 tempest-ProjectReaderTests-1498489724 None] Lock "cinder-quobyte-64d12d08-0771-4028-b591-270434c94a1b" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:59:55 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-b060fb73-60fa-45bf-92c6-a52a6cf292a0 tempest-ProjectReaderTests-1498489724 None] Deleting offline snapshot 64d12d08-0771-4028-b591-270434c94a1b of volume 9bb69e48-5b99-4631-b05f-0ac8a50dbf8c {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 22:59:55 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-b060fb73-60fa-45bf-92c6-a52a6cf292a0 tempest-ProjectReaderTests-1498489724 None] snapshot_file for this snap is: volume-9bb69e48-5b99-4631-b05f-0ac8a50dbf8c.64d12d08-0771-4028-b591-270434c94a1b {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 22:59:55 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[41bb79c7-fbbb-4610-b0ef-a5c05ee9d5cd]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:59:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b060fb73-60fa-45bf-92c6-a52a6cf292a0 tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9bb69e48-5b99-4631-b05f-0ac8a50dbf8c.64d12d08-0771-4028-b591-270434c94a1b {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:55 devstack sudo[107816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9bb69e48-5b99-4631-b05f-0ac8a50dbf8c.64d12d08-0771-4028-b591-270434c94a1b Sep 04 22:59:55 devstack sudo[107816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:55 devstack sudo[107814]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:55 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-4d7f0d49-cf1c-4677-b435-371211e571ea tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.256s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:55 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-4d7f0d49-cf1c-4677-b435-371211e571ea tempest-ProjectMemberTests-1763329861 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:59:55 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-4d7f0d49-cf1c-4677-b435-371211e571ea tempest-ProjectMemberTests-1763329861 None] Deleted volume successfully. Sep 04 22:59:55 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-4d7f0d49-cf1c-4677-b435-371211e571ea tempest-ProjectMemberTests-1763329861 None] Lock "cinder-33e458d3-273e-4539-844b-d6b29aa578f5-delete_volume" released by "delete_volume" :: held 1.146s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:59:56 devstack sudo[107816]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b060fb73-60fa-45bf-92c6-a52a6cf292a0 tempest-ProjectReaderTests-1498489724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9bb69e48-5b99-4631-b05f-0ac8a50dbf8c.64d12d08-0771-4028-b591-270434c94a1b" returned: 0 in 0.414s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:56 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-b060fb73-60fa-45bf-92c6-a52a6cf292a0 tempest-ProjectReaderTests-1498489724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9bb69e48-5b99-4631-b05f-0ac8a50dbf8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 22:59:56 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b204ac2-d096-47f1-9c8c-30d85f593985]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:59:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b060fb73-60fa-45bf-92c6-a52a6cf292a0 tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9bb69e48-5b99-4631-b05f-0ac8a50dbf8c {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:56 devstack sudo[107824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9bb69e48-5b99-4631-b05f-0ac8a50dbf8c Sep 04 22:59:56 devstack sudo[107824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:56 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc140fbd-759f-4fd4-9e71-d525b1e198ff tempest-ProjectMemberTests-1763329861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:59:56 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-cc140fbd-759f-4fd4-9e71-d525b1e198ff tempest-ProjectMemberTests-1763329861 None] Flow 'volume_create_manager' (efd7eb32-4666-4658-a19f-8964c6b4a357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:59:56 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-cc140fbd-759f-4fd4-9e71-d525b1e198ff tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ced3d1ed-2430-4dbf-86e2-65c74167d539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:56 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-cc140fbd-759f-4fd4-9e71-d525b1e198ff tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ced3d1ed-2430-4dbf-86e2-65c74167d539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:59:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-915701328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=924be387-b752-4490-b595-22a539d93f6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea67d0db23b2432187cdb39da7ed0530',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:59:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:59:56Z,use_quota=True,user_id='f2beadaff952455f8e8d8ab5cdc33aa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:56 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-cc140fbd-759f-4fd4-9e71-d525b1e198ff tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93a2a2bd-d089-4b84-b50c-614eda34efa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:56 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-cc140fbd-759f-4fd4-9e71-d525b1e198ff tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93a2a2bd-d089-4b84-b50c-614eda34efa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:56 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-cc140fbd-759f-4fd4-9e71-d525b1e198ff tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d57b4456-478a-4a5d-b072-c65353c2218e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:56 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-cc140fbd-759f-4fd4-9e71-d525b1e198ff tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d57b4456-478a-4a5d-b072-c65353c2218e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '924be387-b752-4490-b595-22a539d93f6e', 'volume_name': 'volume-924be387-b752-4490-b595-22a539d93f6e', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:56 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-cc140fbd-759f-4fd4-9e71-d525b1e198ff tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f1bc2b3-8936-40d3-b957-20f7af85b89a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:56 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-cc140fbd-759f-4fd4-9e71-d525b1e198ff tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f1bc2b3-8936-40d3-b957-20f7af85b89a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:56 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-cc140fbd-759f-4fd4-9e71-d525b1e198ff tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd2c25b8-5476-410d-83a9-9f0d6a17eb18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:56 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-cc140fbd-759f-4fd4-9e71-d525b1e198ff tempest-ProjectMemberTests-1763329861 None] Volume 924be387-b752-4490-b595-22a539d93f6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-924be387-b752-4490-b595-22a539d93f6e', 'volume_size': 1} Sep 04 22:59:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-cc140fbd-759f-4fd4-9e71-d525b1e198ff tempest-ProjectMemberTests-1763329861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:59:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-cc140fbd-759f-4fd4-9e71-d525b1e198ff tempest-ProjectMemberTests-1763329861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:59:56 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-cc140fbd-759f-4fd4-9e71-d525b1e198ff tempest-ProjectMemberTests-1763329861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:59:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-915701328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=924be387-b752-4490-b595-22a539d93f6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea67d0db23b2432187cdb39da7ed0530',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:59:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:59:56Z,use_quota=True,user_id='f2beadaff952455f8e8d8ab5cdc33aa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:59:56 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-cc140fbd-759f-4fd4-9e71-d525b1e198ff tempest-ProjectMemberTests-1763329861 None] Creating volume 924be387-b752-4490-b595-22a539d93f6e {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:59:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-cc140fbd-759f-4fd4-9e71-d525b1e198ff tempest-ProjectMemberTests-1763329861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:59:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-cc140fbd-759f-4fd4-9e71-d525b1e198ff tempest-ProjectMemberTests-1763329861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:59:56 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-cc140fbd-759f-4fd4-9e71-d525b1e198ff tempest-ProjectMemberTests-1763329861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:59:56 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-cc140fbd-759f-4fd4-9e71-d525b1e198ff tempest-ProjectMemberTests-1763329861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:59:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-cc140fbd-759f-4fd4-9e71-d525b1e198ff tempest-ProjectMemberTests-1763329861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:59:56 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-cc140fbd-759f-4fd4-9e71-d525b1e198ff tempest-ProjectMemberTests-1763329861 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:59:56 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-cc140fbd-759f-4fd4-9e71-d525b1e198ff tempest-ProjectMemberTests-1763329861 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:59:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-cc140fbd-759f-4fd4-9e71-d525b1e198ff tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-924be387-b752-4490-b595-22a539d93f6e 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:56 devstack sudo[107828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-924be387-b752-4490-b595-22a539d93f6e 1073741824 Sep 04 22:59:56 devstack sudo[107828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:56 devstack sudo[107824]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b060fb73-60fa-45bf-92c6-a52a6cf292a0 tempest-ProjectReaderTests-1498489724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9bb69e48-5b99-4631-b05f-0ac8a50dbf8c" returned: 0 in 0.375s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b060fb73-60fa-45bf-92c6-a52a6cf292a0 tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9bb69e48-5b99-4631-b05f-0ac8a50dbf8c.64d12d08-0771-4028-b591-270434c94a1b {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:56 devstack sudo[107831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9bb69e48-5b99-4631-b05f-0ac8a50dbf8c.64d12d08-0771-4028-b591-270434c94a1b Sep 04 22:59:56 devstack sudo[107831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:56 devstack sudo[107831]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b060fb73-60fa-45bf-92c6-a52a6cf292a0 tempest-ProjectReaderTests-1498489724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9bb69e48-5b99-4631-b05f-0ac8a50dbf8c.64d12d08-0771-4028-b591-270434c94a1b" returned: 0 in 0.331s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b060fb73-60fa-45bf-92c6-a52a6cf292a0 tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9bb69e48-5b99-4631-b05f-0ac8a50dbf8c.64d12d08-0771-4028-b591-270434c94a1b {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:56 devstack sudo[107828]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-cc140fbd-759f-4fd4-9e71-d525b1e198ff tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-924be387-b752-4490-b595-22a539d93f6e 1073741824" returned: 0 in 0.423s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:56 devstack sudo[107840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9bb69e48-5b99-4631-b05f-0ac8a50dbf8c.64d12d08-0771-4028-b591-270434c94a1b Sep 04 22:59:56 devstack sudo[107840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-cc140fbd-759f-4fd4-9e71-d525b1e198ff tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-924be387-b752-4490-b595-22a539d93f6e {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:56 devstack sudo[107842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-924be387-b752-4490-b595-22a539d93f6e Sep 04 22:59:56 devstack sudo[107842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:57 devstack sudo[107840]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b060fb73-60fa-45bf-92c6-a52a6cf292a0 tempest-ProjectReaderTests-1498489724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9bb69e48-5b99-4631-b05f-0ac8a50dbf8c.64d12d08-0771-4028-b591-270434c94a1b" returned: 0 in 0.247s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:57 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-b060fb73-60fa-45bf-92c6-a52a6cf292a0 tempest-ProjectReaderTests-1498489724 None] Lock "cinder-quobyte-64d12d08-0771-4028-b591-270434c94a1b" released by "_delete_snapshot" :: held 1.462s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:59:57 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-b060fb73-60fa-45bf-92c6-a52a6cf292a0 tempest-ProjectReaderTests-1498489724 None] Lock "cinder-quobyte-9bb69e48-5b99-4631-b05f-0ac8a50dbf8c" released by "delete_snapshot" :: held 1.484s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:59:57 devstack sudo[107842]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-cc140fbd-759f-4fd4-9e71-d525b1e198ff tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-924be387-b752-4490-b595-22a539d93f6e" returned: 0 in 0.253s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:57 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-cc140fbd-759f-4fd4-9e71-d525b1e198ff tempest-ProjectMemberTests-1763329861 None] <== create_volume: return (724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 22:59:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-cc140fbd-759f-4fd4-9e71-d525b1e198ff tempest-ProjectMemberTests-1763329861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:59:57 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-cc140fbd-759f-4fd4-9e71-d525b1e198ff tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd2c25b8-5476-410d-83a9-9f0d6a17eb18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-924be387-b752-4490-b595-22a539d93f6e', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:57 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-cc140fbd-759f-4fd4-9e71-d525b1e198ff tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba876097-c326-4a29-b5b6-d9612272e4c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:57 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-cc140fbd-759f-4fd4-9e71-d525b1e198ff tempest-ProjectMemberTests-1763329861 None] Volume volume-924be387-b752-4490-b595-22a539d93f6e (924be387-b752-4490-b595-22a539d93f6e): created successfully Sep 04 22:59:57 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-cc140fbd-759f-4fd4-9e71-d525b1e198ff tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba876097-c326-4a29-b5b6-d9612272e4c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:57 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-cc140fbd-759f-4fd4-9e71-d525b1e198ff tempest-ProjectMemberTests-1763329861 None] Flow 'volume_create_manager' (efd7eb32-4666-4658-a19f-8964c6b4a357) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:59:57 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-cc140fbd-759f-4fd4-9e71-d525b1e198ff tempest-ProjectMemberTests-1763329861 None] Created volume successfully. Sep 04 22:59:57 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-b060fb73-60fa-45bf-92c6-a52a6cf292a0 tempest-ProjectReaderTests-1498489724 None] Created reservations ['83c2f973-4907-4ab5-a123-a1fea8ed386e', '36ac99f1-3c74-4df6-8b4a-8cafd1c3dbe0', '56208678-b7ee-435c-89e2-e5a4cd4cf894', '1b6350bc-c0cc-4276-a1b9-0f169f99860b'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:59:57 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-b060fb73-60fa-45bf-92c6-a52a6cf292a0 tempest-ProjectReaderTests-1498489724 None] Delete snapshot completed successfully. Sep 04 22:59:57 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-b060fb73-60fa-45bf-92c6-a52a6cf292a0 tempest-ProjectReaderTests-1498489724 None] Lock "cinder-64d12d08-0771-4028-b591-270434c94a1b-delete_snapshot" released by "delete_snapshot" :: held 1.668s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:59:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-e41b6f87-7073-4458-ba70-fb7b3ec7db21 tempest-ProjectMemberTests-1763329861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:59:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-e41b6f87-7073-4458-ba70-fb7b3ec7db21 tempest-ProjectMemberTests-1763329861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:59:57 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-e41b6f87-7073-4458-ba70-fb7b3ec7db21 tempest-ProjectMemberTests-1763329861 None] Creating offline snapshot 17148847-5d1b-49fc-9b70-a320f7cd7952 of volume 924be387-b752-4490-b595-22a539d93f6e {{(pid=87576) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 22:59:57 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[efdfc226-2baf-4510-8787-8516ab2b1209]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:59:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e41b6f87-7073-4458-ba70-fb7b3ec7db21 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-924be387-b752-4490-b595-22a539d93f6e {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:57 devstack sudo[107846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-924be387-b752-4490-b595-22a539d93f6e Sep 04 22:59:57 devstack sudo[107846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:57 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-b2479ee2-15c6-41c2-b544-1c7be498f5d0 tempest-ProjectReaderTests-1498489724 None] Acquiring lock "cinder-9bb69e48-5b99-4631-b05f-0ac8a50dbf8c-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:59:57 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-b2479ee2-15c6-41c2-b544-1c7be498f5d0 tempest-ProjectReaderTests-1498489724 None] Lock "cinder-9bb69e48-5b99-4631-b05f-0ac8a50dbf8c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:59:57 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-b2479ee2-15c6-41c2-b544-1c7be498f5d0 tempest-ProjectReaderTests-1498489724 None] Acquiring lock "cinder-quobyte-9bb69e48-5b99-4631-b05f-0ac8a50dbf8c" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 22:59:57 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-b2479ee2-15c6-41c2-b544-1c7be498f5d0 tempest-ProjectReaderTests-1498489724 None] Lock "cinder-quobyte-9bb69e48-5b99-4631-b05f-0ac8a50dbf8c" acquired by "delete_volume" :: waited 0.014s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 22:59:57 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b91275-f510-468a-bec7-17b53cf978b3]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 22:59:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b2479ee2-15c6-41c2-b544-1c7be498f5d0 tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9bb69e48-5b99-4631-b05f-0ac8a50dbf8c {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:57 devstack sudo[107846]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e41b6f87-7073-4458-ba70-fb7b3ec7db21 tempest-ProjectMemberTests-1763329861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-924be387-b752-4490-b595-22a539d93f6e" returned: 0 in 0.395s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e41b6f87-7073-4458-ba70-fb7b3ec7db21 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-924be387-b752-4490-b595-22a539d93f6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-924be387-b752-4490-b595-22a539d93f6e.17148847-5d1b-49fc-9b70-a320f7cd7952 1G {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:57 devstack sudo[107852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-924be387-b752-4490-b595-22a539d93f6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-924be387-b752-4490-b595-22a539d93f6e.17148847-5d1b-49fc-9b70-a320f7cd7952 1G Sep 04 22:59:57 devstack sudo[107852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:57 devstack sudo[107851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9bb69e48-5b99-4631-b05f-0ac8a50dbf8c Sep 04 22:59:57 devstack sudo[107851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:58 devstack sudo[107851]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b2479ee2-15c6-41c2-b544-1c7be498f5d0 tempest-ProjectReaderTests-1498489724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9bb69e48-5b99-4631-b05f-0ac8a50dbf8c" returned: 0 in 0.370s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b2479ee2-15c6-41c2-b544-1c7be498f5d0 tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9bb69e48-5b99-4631-b05f-0ac8a50dbf8c {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:58 devstack sudo[107862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9bb69e48-5b99-4631-b05f-0ac8a50dbf8c Sep 04 22:59:58 devstack sudo[107862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:58 devstack sudo[107852]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e41b6f87-7073-4458-ba70-fb7b3ec7db21 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-924be387-b752-4490-b595-22a539d93f6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-924be387-b752-4490-b595-22a539d93f6e.17148847-5d1b-49fc-9b70-a320f7cd7952 1G" returned: 0 in 0.418s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e41b6f87-7073-4458-ba70-fb7b3ec7db21 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-924be387-b752-4490-b595-22a539d93f6e -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-924be387-b752-4490-b595-22a539d93f6e.17148847-5d1b-49fc-9b70-a320f7cd7952 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:58 devstack sudo[107864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-924be387-b752-4490-b595-22a539d93f6e -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-924be387-b752-4490-b595-22a539d93f6e.17148847-5d1b-49fc-9b70-a320f7cd7952 Sep 04 22:59:58 devstack sudo[107864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:58 devstack sudo[107862]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b2479ee2-15c6-41c2-b544-1c7be498f5d0 tempest-ProjectReaderTests-1498489724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-9bb69e48-5b99-4631-b05f-0ac8a50dbf8c" returned: 0 in 0.262s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:58 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-b2479ee2-15c6-41c2-b544-1c7be498f5d0 tempest-ProjectReaderTests-1498489724 None] Lock "cinder-quobyte-9bb69e48-5b99-4631-b05f-0ac8a50dbf8c" released by "delete_volume" :: held 0.692s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:59:58 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-b2479ee2-15c6-41c2-b544-1c7be498f5d0 tempest-ProjectReaderTests-1498489724 None] Created reservations ['6fc0a793-3ec9-493d-a749-34b2fc1e5dd0', '00e1b80a-101d-41cd-8ae5-bbdc990a8596', '51c47091-f95c-4c22-8a57-6930b2961167', '02213982-ca40-415d-9015-d6d74acc8deb'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 22:59:58 devstack sudo[107864]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e41b6f87-7073-4458-ba70-fb7b3ec7db21 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-924be387-b752-4490-b595-22a539d93f6e -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-924be387-b752-4490-b595-22a539d93f6e.17148847-5d1b-49fc-9b70-a320f7cd7952" returned: 0 in 0.299s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:58 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-e41b6f87-7073-4458-ba70-fb7b3ec7db21 tempest-ProjectMemberTests-1763329861 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-924be387-b752-4490-b595-22a539d93f6e.17148847-5d1b-49fc-9b70-a320f7cd7952 is being set with open permissions: ugo+rw Sep 04 22:59:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e41b6f87-7073-4458-ba70-fb7b3ec7db21 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-924be387-b752-4490-b595-22a539d93f6e.17148847-5d1b-49fc-9b70-a320f7cd7952 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-b2479ee2-15c6-41c2-b544-1c7be498f5d0 tempest-ProjectReaderTests-1498489724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:59:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-b2479ee2-15c6-41c2-b544-1c7be498f5d0 tempest-ProjectReaderTests-1498489724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:59:58 devstack sudo[107870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-924be387-b752-4490-b595-22a539d93f6e.17148847-5d1b-49fc-9b70-a320f7cd7952 Sep 04 22:59:58 devstack sudo[107870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:58 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-b2479ee2-15c6-41c2-b544-1c7be498f5d0 tempest-ProjectReaderTests-1498489724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:59:58 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-b2479ee2-15c6-41c2-b544-1c7be498f5d0 tempest-ProjectReaderTests-1498489724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:59:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-b2479ee2-15c6-41c2-b544-1c7be498f5d0 tempest-ProjectReaderTests-1498489724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:59:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b2479ee2-15c6-41c2-b544-1c7be498f5d0 tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:58 devstack sudo[107872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 22:59:58 devstack sudo[107872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:58 devstack sudo[107870]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e41b6f87-7073-4458-ba70-fb7b3ec7db21 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-924be387-b752-4490-b595-22a539d93f6e.17148847-5d1b-49fc-9b70-a320f7cd7952" returned: 0 in 0.279s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:58 devstack sudo[107872]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b2479ee2-15c6-41c2-b544-1c7be498f5d0 tempest-ProjectReaderTests-1498489724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.256s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:58 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-b2479ee2-15c6-41c2-b544-1c7be498f5d0 tempest-ProjectReaderTests-1498489724 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 22:59:58 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-b2479ee2-15c6-41c2-b544-1c7be498f5d0 tempest-ProjectReaderTests-1498489724 None] Deleted volume successfully. Sep 04 22:59:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e41b6f87-7073-4458-ba70-fb7b3ec7db21 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-924be387-b752-4490-b595-22a539d93f6e.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:58 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-b2479ee2-15c6-41c2-b544-1c7be498f5d0 tempest-ProjectReaderTests-1498489724 None] Lock "cinder-9bb69e48-5b99-4631-b05f-0ac8a50dbf8c-delete_volume" released by "delete_volume" :: held 1.181s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 22:59:58 devstack sudo[107876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-924be387-b752-4490-b595-22a539d93f6e.info Sep 04 22:59:58 devstack sudo[107876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:59 devstack sudo[107876]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e41b6f87-7073-4458-ba70-fb7b3ec7db21 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-924be387-b752-4490-b595-22a539d93f6e.info" returned: 0 in 0.249s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:59 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-e41b6f87-7073-4458-ba70-fb7b3ec7db21 tempest-ProjectMemberTests-1763329861 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-924be387-b752-4490-b595-22a539d93f6e.info is being set with open permissions: ugo+rw Sep 04 22:59:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e41b6f87-7073-4458-ba70-fb7b3ec7db21 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-924be387-b752-4490-b595-22a539d93f6e.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:59 devstack sudo[107879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-924be387-b752-4490-b595-22a539d93f6e.info Sep 04 22:59:59 devstack sudo[107879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:59 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-5044e19f-d87c-4727-9960-882f0cf7df8d tempest-ProjectReaderTests-1498489724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 22:59:59 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-5044e19f-d87c-4727-9960-882f0cf7df8d tempest-ProjectReaderTests-1498489724 None] Flow 'volume_create_manager' (1ec98bc1-57fc-4bc7-96e1-c4b2df53d619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 22:59:59 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-5044e19f-d87c-4727-9960-882f0cf7df8d tempest-ProjectReaderTests-1498489724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d4c11e5-f772-4504-855c-fc3f45f95a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:59 devstack sudo[107879]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-e41b6f87-7073-4458-ba70-fb7b3ec7db21 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-924be387-b752-4490-b595-22a539d93f6e.info" returned: 0 in 0.254s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-e41b6f87-7073-4458-ba70-fb7b3ec7db21 tempest-ProjectMemberTests-1763329861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.975s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:59:59 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-5044e19f-d87c-4727-9960-882f0cf7df8d tempest-ProjectReaderTests-1498489724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d4c11e5-f772-4504-855c-fc3f45f95a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:59:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-13021023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eaa2720-3af3-4d57-b460-baae7626a556,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7585397571d4467c940871ba04edaa79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:59:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:59:59Z,use_quota=True,user_id='7ce20a5cf92b4a7dae47527aa9513e2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:59 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-5044e19f-d87c-4727-9960-882f0cf7df8d tempest-ProjectReaderTests-1498489724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f162cafb-4aea-4630-baec-9281549fd454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:59 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-5044e19f-d87c-4727-9960-882f0cf7df8d tempest-ProjectReaderTests-1498489724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f162cafb-4aea-4630-baec-9281549fd454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:59 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-5044e19f-d87c-4727-9960-882f0cf7df8d tempest-ProjectReaderTests-1498489724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06f16eb1-8e4b-4822-a112-706ed59d3b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:59 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-5044e19f-d87c-4727-9960-882f0cf7df8d tempest-ProjectReaderTests-1498489724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06f16eb1-8e4b-4822-a112-706ed59d3b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5eaa2720-3af3-4d57-b460-baae7626a556', 'volume_name': 'volume-5eaa2720-3af3-4d57-b460-baae7626a556', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:59 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-5044e19f-d87c-4727-9960-882f0cf7df8d tempest-ProjectReaderTests-1498489724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6d4796e-903e-4504-9e98-1567b5afa888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:59 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-5044e19f-d87c-4727-9960-882f0cf7df8d tempest-ProjectReaderTests-1498489724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6d4796e-903e-4504-9e98-1567b5afa888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 22:59:59 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-5044e19f-d87c-4727-9960-882f0cf7df8d tempest-ProjectReaderTests-1498489724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c8becaf-a9fd-44b7-b5c7-f5893e5d056e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 22:59:59 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-5044e19f-d87c-4727-9960-882f0cf7df8d tempest-ProjectReaderTests-1498489724 None] Volume 5eaa2720-3af3-4d57-b460-baae7626a556: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5eaa2720-3af3-4d57-b460-baae7626a556', 'volume_size': 1} Sep 04 22:59:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-5044e19f-d87c-4727-9960-882f0cf7df8d tempest-ProjectReaderTests-1498489724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:59:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-5044e19f-d87c-4727-9960-882f0cf7df8d tempest-ProjectReaderTests-1498489724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:59:59 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-5044e19f-d87c-4727-9960-882f0cf7df8d tempest-ProjectReaderTests-1498489724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T20:59:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-13021023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eaa2720-3af3-4d57-b460-baae7626a556,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7585397571d4467c940871ba04edaa79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T20:59:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T20:59:59Z,use_quota=True,user_id='7ce20a5cf92b4a7dae47527aa9513e2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 22:59:59 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-5044e19f-d87c-4727-9960-882f0cf7df8d tempest-ProjectReaderTests-1498489724 None] Creating volume 5eaa2720-3af3-4d57-b460-baae7626a556 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 22:59:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-5044e19f-d87c-4727-9960-882f0cf7df8d tempest-ProjectReaderTests-1498489724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 22:59:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-5044e19f-d87c-4727-9960-882f0cf7df8d tempest-ProjectReaderTests-1498489724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 22:59:59 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-5044e19f-d87c-4727-9960-882f0cf7df8d tempest-ProjectReaderTests-1498489724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 22:59:59 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-5044e19f-d87c-4727-9960-882f0cf7df8d tempest-ProjectReaderTests-1498489724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 22:59:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-5044e19f-d87c-4727-9960-882f0cf7df8d tempest-ProjectReaderTests-1498489724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 22:59:59 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-5044e19f-d87c-4727-9960-882f0cf7df8d tempest-ProjectReaderTests-1498489724 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 22:59:59 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-5044e19f-d87c-4727-9960-882f0cf7df8d tempest-ProjectReaderTests-1498489724 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 22:59:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5044e19f-d87c-4727-9960-882f0cf7df8d tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5eaa2720-3af3-4d57-b460-baae7626a556 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:59 devstack sudo[107882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5eaa2720-3af3-4d57-b460-baae7626a556 1073741824 Sep 04 22:59:59 devstack sudo[107882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 22:59:59 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-e41b6f87-7073-4458-ba70-fb7b3ec7db21 tempest-ProjectMemberTests-1763329861 None] Create snapshot completed successfully Sep 04 22:59:59 devstack sudo[107882]: pam_unix(sudo:session): session closed for user root Sep 04 22:59:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5044e19f-d87c-4727-9960-882f0cf7df8d tempest-ProjectReaderTests-1498489724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5eaa2720-3af3-4d57-b460-baae7626a556 1073741824" returned: 0 in 0.392s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 22:59:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5044e19f-d87c-4727-9960-882f0cf7df8d tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5eaa2720-3af3-4d57-b460-baae7626a556 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 22:59:59 devstack sudo[107887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5eaa2720-3af3-4d57-b460-baae7626a556 Sep 04 22:59:59 devstack sudo[107887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:00 devstack sudo[107887]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5044e19f-d87c-4727-9960-882f0cf7df8d tempest-ProjectReaderTests-1498489724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5eaa2720-3af3-4d57-b460-baae7626a556" returned: 0 in 0.238s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:00 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-5044e19f-d87c-4727-9960-882f0cf7df8d tempest-ProjectReaderTests-1498489724 None] <== create_volume: return (667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 23:00:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-5044e19f-d87c-4727-9960-882f0cf7df8d tempest-ProjectReaderTests-1498489724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.669s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 23:00:00 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-5044e19f-d87c-4727-9960-882f0cf7df8d tempest-ProjectReaderTests-1498489724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c8becaf-a9fd-44b7-b5c7-f5893e5d056e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5eaa2720-3af3-4d57-b460-baae7626a556', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 23:00:00 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-5044e19f-d87c-4727-9960-882f0cf7df8d tempest-ProjectReaderTests-1498489724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (416bca06-2914-4dc7-a7b0-8d26e82f5c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 23:00:00 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-5044e19f-d87c-4727-9960-882f0cf7df8d tempest-ProjectReaderTests-1498489724 None] Volume volume-5eaa2720-3af3-4d57-b460-baae7626a556 (5eaa2720-3af3-4d57-b460-baae7626a556): created successfully Sep 04 23:00:00 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-5044e19f-d87c-4727-9960-882f0cf7df8d tempest-ProjectReaderTests-1498489724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (416bca06-2914-4dc7-a7b0-8d26e82f5c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 23:00:00 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-5044e19f-d87c-4727-9960-882f0cf7df8d tempest-ProjectReaderTests-1498489724 None] Flow 'volume_create_manager' (1ec98bc1-57fc-4bc7-96e1-c4b2df53d619) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 23:00:00 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-5044e19f-d87c-4727-9960-882f0cf7df8d tempest-ProjectReaderTests-1498489724 None] Created volume successfully. Sep 04 23:00:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-048fa83a-7080-4a62-a6a1-668ce907653b tempest-ProjectReaderTests-1498489724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 23:00:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-048fa83a-7080-4a62-a6a1-668ce907653b tempest-ProjectReaderTests-1498489724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 23:00:00 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-048fa83a-7080-4a62-a6a1-668ce907653b tempest-ProjectReaderTests-1498489724 None] Creating offline snapshot 189c085c-eb72-44f6-a94c-d04182c58c60 of volume 5eaa2720-3af3-4d57-b460-baae7626a556 {{(pid=87576) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 23:00:00 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[a428e558-dd71-4aec-ae15-dfb6c3e3b6e1]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 23:00:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-048fa83a-7080-4a62-a6a1-668ce907653b tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5eaa2720-3af3-4d57-b460-baae7626a556 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:00 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-49b53ef7-f826-4589-8e46-1ae2e28b2442 tempest-ProjectMemberTests-1763329861 None] Acquiring lock "cinder-17148847-5d1b-49fc-9b70-a320f7cd7952-delete_snapshot" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 23:00:00 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-49b53ef7-f826-4589-8e46-1ae2e28b2442 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-17148847-5d1b-49fc-9b70-a320f7cd7952-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 23:00:00 devstack sudo[107890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5eaa2720-3af3-4d57-b460-baae7626a556 Sep 04 23:00:00 devstack sudo[107890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:00 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-49b53ef7-f826-4589-8e46-1ae2e28b2442 tempest-ProjectMemberTests-1763329861 None] Acquiring lock "cinder-quobyte-924be387-b752-4490-b595-22a539d93f6e" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 23:00:00 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-49b53ef7-f826-4589-8e46-1ae2e28b2442 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-quobyte-924be387-b752-4490-b595-22a539d93f6e" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 23:00:00 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-49b53ef7-f826-4589-8e46-1ae2e28b2442 tempest-ProjectMemberTests-1763329861 None] Acquiring lock "cinder-quobyte-17148847-5d1b-49fc-9b70-a320f7cd7952" by "_delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 23:00:00 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-49b53ef7-f826-4589-8e46-1ae2e28b2442 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-quobyte-17148847-5d1b-49fc-9b70-a320f7cd7952" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 23:00:00 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-49b53ef7-f826-4589-8e46-1ae2e28b2442 tempest-ProjectMemberTests-1763329861 None] Deleting offline snapshot 17148847-5d1b-49fc-9b70-a320f7cd7952 of volume 924be387-b752-4490-b595-22a539d93f6e {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 23:00:00 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-49b53ef7-f826-4589-8e46-1ae2e28b2442 tempest-ProjectMemberTests-1763329861 None] snapshot_file for this snap is: volume-924be387-b752-4490-b595-22a539d93f6e.17148847-5d1b-49fc-9b70-a320f7cd7952 {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 23:00:00 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bddcb4e-fe0c-4384-bbaf-45da94e7812f]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 23:00:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-49b53ef7-f826-4589-8e46-1ae2e28b2442 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-924be387-b752-4490-b595-22a539d93f6e.17148847-5d1b-49fc-9b70-a320f7cd7952 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:00 devstack sudo[107892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-924be387-b752-4490-b595-22a539d93f6e.17148847-5d1b-49fc-9b70-a320f7cd7952 Sep 04 23:00:00 devstack sudo[107892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:00 devstack sudo[107890]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-048fa83a-7080-4a62-a6a1-668ce907653b tempest-ProjectReaderTests-1498489724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5eaa2720-3af3-4d57-b460-baae7626a556" returned: 0 in 0.361s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-048fa83a-7080-4a62-a6a1-668ce907653b tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5eaa2720-3af3-4d57-b460-baae7626a556,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5eaa2720-3af3-4d57-b460-baae7626a556.189c085c-eb72-44f6-a94c-d04182c58c60 1G {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:00 devstack sudo[107897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5eaa2720-3af3-4d57-b460-baae7626a556,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5eaa2720-3af3-4d57-b460-baae7626a556.189c085c-eb72-44f6-a94c-d04182c58c60 1G Sep 04 23:00:00 devstack sudo[107897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:01 devstack sudo[107892]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-49b53ef7-f826-4589-8e46-1ae2e28b2442 tempest-ProjectMemberTests-1763329861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-924be387-b752-4490-b595-22a539d93f6e.17148847-5d1b-49fc-9b70-a320f7cd7952" returned: 0 in 0.357s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:01 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-49b53ef7-f826-4589-8e46-1ae2e28b2442 tempest-ProjectMemberTests-1763329861 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-924be387-b752-4490-b595-22a539d93f6e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 23:00:01 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc747a5-7b4f-439c-9341-2d3806c81af9]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 23:00:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-49b53ef7-f826-4589-8e46-1ae2e28b2442 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-924be387-b752-4490-b595-22a539d93f6e {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:01 devstack sudo[107903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-924be387-b752-4490-b595-22a539d93f6e Sep 04 23:00:01 devstack sudo[107903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:01 devstack sudo[107897]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-048fa83a-7080-4a62-a6a1-668ce907653b tempest-ProjectReaderTests-1498489724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5eaa2720-3af3-4d57-b460-baae7626a556,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5eaa2720-3af3-4d57-b460-baae7626a556.189c085c-eb72-44f6-a94c-d04182c58c60 1G" returned: 0 in 0.382s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-048fa83a-7080-4a62-a6a1-668ce907653b tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5eaa2720-3af3-4d57-b460-baae7626a556 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5eaa2720-3af3-4d57-b460-baae7626a556.189c085c-eb72-44f6-a94c-d04182c58c60 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:01 devstack sudo[107907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5eaa2720-3af3-4d57-b460-baae7626a556 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5eaa2720-3af3-4d57-b460-baae7626a556.189c085c-eb72-44f6-a94c-d04182c58c60 Sep 04 23:00:01 devstack sudo[107907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:01 devstack sudo[107903]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-49b53ef7-f826-4589-8e46-1ae2e28b2442 tempest-ProjectMemberTests-1763329861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-924be387-b752-4490-b595-22a539d93f6e" returned: 0 in 0.376s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-49b53ef7-f826-4589-8e46-1ae2e28b2442 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-924be387-b752-4490-b595-22a539d93f6e.17148847-5d1b-49fc-9b70-a320f7cd7952 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:01 devstack sudo[107912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-924be387-b752-4490-b595-22a539d93f6e.17148847-5d1b-49fc-9b70-a320f7cd7952 Sep 04 23:00:01 devstack sudo[107912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:01 devstack sudo[107907]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-048fa83a-7080-4a62-a6a1-668ce907653b tempest-ProjectReaderTests-1498489724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5eaa2720-3af3-4d57-b460-baae7626a556 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5eaa2720-3af3-4d57-b460-baae7626a556.189c085c-eb72-44f6-a94c-d04182c58c60" returned: 0 in 0.301s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:01 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-048fa83a-7080-4a62-a6a1-668ce907653b tempest-ProjectReaderTests-1498489724 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5eaa2720-3af3-4d57-b460-baae7626a556.189c085c-eb72-44f6-a94c-d04182c58c60 is being set with open permissions: ugo+rw Sep 04 23:00:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-048fa83a-7080-4a62-a6a1-668ce907653b tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5eaa2720-3af3-4d57-b460-baae7626a556.189c085c-eb72-44f6-a94c-d04182c58c60 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:01 devstack sudo[107917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5eaa2720-3af3-4d57-b460-baae7626a556.189c085c-eb72-44f6-a94c-d04182c58c60 Sep 04 23:00:01 devstack sudo[107917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:01 devstack sudo[107912]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-49b53ef7-f826-4589-8e46-1ae2e28b2442 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-924be387-b752-4490-b595-22a539d93f6e.17148847-5d1b-49fc-9b70-a320f7cd7952" returned: 0 in 0.348s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-49b53ef7-f826-4589-8e46-1ae2e28b2442 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-924be387-b752-4490-b595-22a539d93f6e.17148847-5d1b-49fc-9b70-a320f7cd7952 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:01 devstack sudo[107917]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-048fa83a-7080-4a62-a6a1-668ce907653b tempest-ProjectReaderTests-1498489724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5eaa2720-3af3-4d57-b460-baae7626a556.189c085c-eb72-44f6-a94c-d04182c58c60" returned: 0 in 0.258s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:01 devstack sudo[107923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-924be387-b752-4490-b595-22a539d93f6e.17148847-5d1b-49fc-9b70-a320f7cd7952 Sep 04 23:00:01 devstack sudo[107923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-048fa83a-7080-4a62-a6a1-668ce907653b tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5eaa2720-3af3-4d57-b460-baae7626a556.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:01 devstack sudo[107925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5eaa2720-3af3-4d57-b460-baae7626a556.info Sep 04 23:00:01 devstack sudo[107925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:02 devstack sudo[107923]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:02 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-49b53ef7-f826-4589-8e46-1ae2e28b2442 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-924be387-b752-4490-b595-22a539d93f6e.17148847-5d1b-49fc-9b70-a320f7cd7952" returned: 0 in 0.248s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:02 devstack sudo[107925]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:02 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-49b53ef7-f826-4589-8e46-1ae2e28b2442 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-quobyte-17148847-5d1b-49fc-9b70-a320f7cd7952" released by "_delete_snapshot" :: held 1.427s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 23:00:02 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-048fa83a-7080-4a62-a6a1-668ce907653b tempest-ProjectReaderTests-1498489724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5eaa2720-3af3-4d57-b460-baae7626a556.info" returned: 0 in 0.239s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:02 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-048fa83a-7080-4a62-a6a1-668ce907653b tempest-ProjectReaderTests-1498489724 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5eaa2720-3af3-4d57-b460-baae7626a556.info is being set with open permissions: ugo+rw Sep 04 23:00:02 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-048fa83a-7080-4a62-a6a1-668ce907653b tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5eaa2720-3af3-4d57-b460-baae7626a556.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:02 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-49b53ef7-f826-4589-8e46-1ae2e28b2442 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-quobyte-924be387-b752-4490-b595-22a539d93f6e" released by "delete_snapshot" :: held 1.457s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 23:00:02 devstack sudo[107929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5eaa2720-3af3-4d57-b460-baae7626a556.info Sep 04 23:00:02 devstack sudo[107929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:02 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-49b53ef7-f826-4589-8e46-1ae2e28b2442 tempest-ProjectMemberTests-1763329861 None] Created reservations ['dbf20990-be2a-4f3b-aa14-ea49ac4fd9bf', '7ec26950-ee02-48c0-948b-a5067ef98b2d', 'da96cd47-8aae-4c17-857d-c2d60c306cd7', 'dc2c6057-a9c0-4227-aa9f-174f9c61f329'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 23:00:02 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-49b53ef7-f826-4589-8e46-1ae2e28b2442 tempest-ProjectMemberTests-1763329861 None] Delete snapshot completed successfully. Sep 04 23:00:02 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-49b53ef7-f826-4589-8e46-1ae2e28b2442 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-17148847-5d1b-49fc-9b70-a320f7cd7952-delete_snapshot" released by "delete_snapshot" :: held 1.602s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 23:00:02 devstack sudo[107929]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:02 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-048fa83a-7080-4a62-a6a1-668ce907653b tempest-ProjectReaderTests-1498489724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5eaa2720-3af3-4d57-b460-baae7626a556.info" returned: 0 in 0.253s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:02 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-048fa83a-7080-4a62-a6a1-668ce907653b tempest-ProjectReaderTests-1498489724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.876s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 23:00:02 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-048fa83a-7080-4a62-a6a1-668ce907653b tempest-ProjectReaderTests-1498489724 None] Create snapshot completed successfully Sep 04 23:00:02 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-776c0337-bfe7-470a-8001-f557303d7540 tempest-ProjectReaderTests-1498489724 None] Acquiring lock "cinder-189c085c-eb72-44f6-a94c-d04182c58c60-delete_snapshot" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 23:00:02 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-776c0337-bfe7-470a-8001-f557303d7540 tempest-ProjectReaderTests-1498489724 None] Lock "cinder-189c085c-eb72-44f6-a94c-d04182c58c60-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 23:00:02 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-776c0337-bfe7-470a-8001-f557303d7540 tempest-ProjectReaderTests-1498489724 None] Acquiring lock "cinder-quobyte-5eaa2720-3af3-4d57-b460-baae7626a556" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 23:00:02 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-776c0337-bfe7-470a-8001-f557303d7540 tempest-ProjectReaderTests-1498489724 None] Lock "cinder-quobyte-5eaa2720-3af3-4d57-b460-baae7626a556" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 23:00:02 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-776c0337-bfe7-470a-8001-f557303d7540 tempest-ProjectReaderTests-1498489724 None] Acquiring lock "cinder-quobyte-189c085c-eb72-44f6-a94c-d04182c58c60" by "_delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 23:00:02 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-776c0337-bfe7-470a-8001-f557303d7540 tempest-ProjectReaderTests-1498489724 None] Lock "cinder-quobyte-189c085c-eb72-44f6-a94c-d04182c58c60" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 23:00:02 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-776c0337-bfe7-470a-8001-f557303d7540 tempest-ProjectReaderTests-1498489724 None] Deleting offline snapshot 189c085c-eb72-44f6-a94c-d04182c58c60 of volume 5eaa2720-3af3-4d57-b460-baae7626a556 {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 23:00:02 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-776c0337-bfe7-470a-8001-f557303d7540 tempest-ProjectReaderTests-1498489724 None] snapshot_file for this snap is: volume-5eaa2720-3af3-4d57-b460-baae7626a556.189c085c-eb72-44f6-a94c-d04182c58c60 {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 23:00:02 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56c7a93-48f5-4402-b0f1-0ed99f61793e]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 23:00:02 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-776c0337-bfe7-470a-8001-f557303d7540 tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5eaa2720-3af3-4d57-b460-baae7626a556.189c085c-eb72-44f6-a94c-d04182c58c60 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:02 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-25495805-9c12-4568-94a9-d8cdbf284666 tempest-ProjectMemberTests-1763329861 None] Acquiring lock "cinder-924be387-b752-4490-b595-22a539d93f6e-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 23:00:02 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-25495805-9c12-4568-94a9-d8cdbf284666 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-924be387-b752-4490-b595-22a539d93f6e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 23:00:02 devstack sudo[107932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5eaa2720-3af3-4d57-b460-baae7626a556.189c085c-eb72-44f6-a94c-d04182c58c60 Sep 04 23:00:02 devstack sudo[107932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:02 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-25495805-9c12-4568-94a9-d8cdbf284666 tempest-ProjectMemberTests-1763329861 None] Acquiring lock "cinder-quobyte-924be387-b752-4490-b595-22a539d93f6e" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 23:00:02 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-25495805-9c12-4568-94a9-d8cdbf284666 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-quobyte-924be387-b752-4490-b595-22a539d93f6e" acquired by "delete_volume" :: waited 0.020s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 23:00:02 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5e16f9-a9b4-4185-aa8d-92a92855f925]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 23:00:02 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-25495805-9c12-4568-94a9-d8cdbf284666 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-924be387-b752-4490-b595-22a539d93f6e {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:03 devstack sudo[107934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-924be387-b752-4490-b595-22a539d93f6e Sep 04 23:00:03 devstack sudo[107934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:03 devstack sudo[107932]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-776c0337-bfe7-470a-8001-f557303d7540 tempest-ProjectReaderTests-1498489724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5eaa2720-3af3-4d57-b460-baae7626a556.189c085c-eb72-44f6-a94c-d04182c58c60" returned: 0 in 0.355s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:03 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-776c0337-bfe7-470a-8001-f557303d7540 tempest-ProjectReaderTests-1498489724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5eaa2720-3af3-4d57-b460-baae7626a556(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 23:00:03 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e6de3b-7f35-49a3-ba46-cf6b2de0011b]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 23:00:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-776c0337-bfe7-470a-8001-f557303d7540 tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5eaa2720-3af3-4d57-b460-baae7626a556 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:03 devstack sudo[107939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5eaa2720-3af3-4d57-b460-baae7626a556 Sep 04 23:00:03 devstack sudo[107939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:03 devstack sudo[107934]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-25495805-9c12-4568-94a9-d8cdbf284666 tempest-ProjectMemberTests-1763329861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-924be387-b752-4490-b595-22a539d93f6e" returned: 0 in 0.372s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-25495805-9c12-4568-94a9-d8cdbf284666 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-924be387-b752-4490-b595-22a539d93f6e {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:03 devstack sudo[107945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-924be387-b752-4490-b595-22a539d93f6e Sep 04 23:00:03 devstack sudo[107945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:03 devstack sudo[107939]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-776c0337-bfe7-470a-8001-f557303d7540 tempest-ProjectReaderTests-1498489724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5eaa2720-3af3-4d57-b460-baae7626a556" returned: 0 in 0.371s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-776c0337-bfe7-470a-8001-f557303d7540 tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5eaa2720-3af3-4d57-b460-baae7626a556.189c085c-eb72-44f6-a94c-d04182c58c60 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:03 devstack sudo[107950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5eaa2720-3af3-4d57-b460-baae7626a556.189c085c-eb72-44f6-a94c-d04182c58c60 Sep 04 23:00:03 devstack sudo[107950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:03 devstack sudo[107945]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-25495805-9c12-4568-94a9-d8cdbf284666 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-924be387-b752-4490-b595-22a539d93f6e" returned: 0 in 0.264s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:03 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-25495805-9c12-4568-94a9-d8cdbf284666 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-quobyte-924be387-b752-4490-b595-22a539d93f6e" released by "delete_volume" :: held 0.692s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 23:00:03 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-25495805-9c12-4568-94a9-d8cdbf284666 tempest-ProjectMemberTests-1763329861 None] Created reservations ['43d14fa1-66bc-406e-8b6e-67c51b67e1d5', '5e8fd8ec-290c-421d-a13f-edbc5581d94a', 'c33c7edf-efa1-4709-9e50-6d791c3fa03d', '2cad64df-6116-4e66-8d46-35ceb2784884'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 23:00:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-25495805-9c12-4568-94a9-d8cdbf284666 tempest-ProjectMemberTests-1763329861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 23:00:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-25495805-9c12-4568-94a9-d8cdbf284666 tempest-ProjectMemberTests-1763329861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 23:00:03 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-25495805-9c12-4568-94a9-d8cdbf284666 tempest-ProjectMemberTests-1763329861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 23:00:03 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-25495805-9c12-4568-94a9-d8cdbf284666 tempest-ProjectMemberTests-1763329861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 23:00:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-25495805-9c12-4568-94a9-d8cdbf284666 tempest-ProjectMemberTests-1763329861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 23:00:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-25495805-9c12-4568-94a9-d8cdbf284666 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:03 devstack sudo[107955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 23:00:03 devstack sudo[107955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:03 devstack sudo[107950]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-776c0337-bfe7-470a-8001-f557303d7540 tempest-ProjectReaderTests-1498489724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5eaa2720-3af3-4d57-b460-baae7626a556.189c085c-eb72-44f6-a94c-d04182c58c60" returned: 0 in 0.356s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-776c0337-bfe7-470a-8001-f557303d7540 tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5eaa2720-3af3-4d57-b460-baae7626a556.189c085c-eb72-44f6-a94c-d04182c58c60 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:03 devstack sudo[107958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5eaa2720-3af3-4d57-b460-baae7626a556.189c085c-eb72-44f6-a94c-d04182c58c60 Sep 04 23:00:03 devstack sudo[107958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:03 devstack sudo[107955]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:03 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-25495805-9c12-4568-94a9-d8cdbf284666 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.279s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:03 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-25495805-9c12-4568-94a9-d8cdbf284666 tempest-ProjectMemberTests-1763329861 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 23:00:03 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-25495805-9c12-4568-94a9-d8cdbf284666 tempest-ProjectMemberTests-1763329861 None] Deleted volume successfully. Sep 04 23:00:03 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-25495805-9c12-4568-94a9-d8cdbf284666 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-924be387-b752-4490-b595-22a539d93f6e-delete_volume" released by "delete_volume" :: held 1.191s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 23:00:04 devstack sudo[107958]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-776c0337-bfe7-470a-8001-f557303d7540 tempest-ProjectReaderTests-1498489724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5eaa2720-3af3-4d57-b460-baae7626a556.189c085c-eb72-44f6-a94c-d04182c58c60" returned: 0 in 0.271s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:04 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-776c0337-bfe7-470a-8001-f557303d7540 tempest-ProjectReaderTests-1498489724 None] Lock "cinder-quobyte-189c085c-eb72-44f6-a94c-d04182c58c60" released by "_delete_snapshot" :: held 1.442s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 23:00:04 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-776c0337-bfe7-470a-8001-f557303d7540 tempest-ProjectReaderTests-1498489724 None] Lock "cinder-quobyte-5eaa2720-3af3-4d57-b460-baae7626a556" released by "delete_snapshot" :: held 1.463s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 23:00:04 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-776c0337-bfe7-470a-8001-f557303d7540 tempest-ProjectReaderTests-1498489724 None] Created reservations ['bf2714a5-1f1a-4bc5-a6d2-b519aa086874', '8e67ac83-166d-4feb-a3cd-d93af2c67e9f', '1f98bfef-76fa-4b7b-8a12-59c05197fff0', '237b5942-2a8e-43e5-b98b-488e587cab1a'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 23:00:04 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-776c0337-bfe7-470a-8001-f557303d7540 tempest-ProjectReaderTests-1498489724 None] Delete snapshot completed successfully. Sep 04 23:00:04 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-776c0337-bfe7-470a-8001-f557303d7540 tempest-ProjectReaderTests-1498489724 None] Lock "cinder-189c085c-eb72-44f6-a94c-d04182c58c60-delete_snapshot" released by "delete_snapshot" :: held 1.610s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 23:00:04 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-372edf3c-dea0-434c-aadd-4a1257ce1403 tempest-ProjectMemberTests-1763329861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 23:00:04 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-372edf3c-dea0-434c-aadd-4a1257ce1403 tempest-ProjectMemberTests-1763329861 None] Flow 'volume_create_manager' (ff7c95c5-1c7c-4332-b82b-1c442bf4fea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 23:00:04 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-372edf3c-dea0-434c-aadd-4a1257ce1403 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f325a73f-628f-42a1-b469-a38a1ddf5cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 23:00:04 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-372edf3c-dea0-434c-aadd-4a1257ce1403 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f325a73f-628f-42a1-b469-a38a1ddf5cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T21:00:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-237000737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35dc301b-24f7-4a95-bd5d-27f5f2bc1a32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea67d0db23b2432187cdb39da7ed0530',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T21:00:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T21:00:04Z,use_quota=True,user_id='f2beadaff952455f8e8d8ab5cdc33aa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 23:00:04 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-372edf3c-dea0-434c-aadd-4a1257ce1403 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3dcbb5e-d041-4a81-bdc6-3967b2e01274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 23:00:04 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-372edf3c-dea0-434c-aadd-4a1257ce1403 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3dcbb5e-d041-4a81-bdc6-3967b2e01274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 23:00:04 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-372edf3c-dea0-434c-aadd-4a1257ce1403 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fed208a-4d4b-407f-9bca-aeba37830f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 23:00:04 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-372edf3c-dea0-434c-aadd-4a1257ce1403 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fed208a-4d4b-407f-9bca-aeba37830f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35dc301b-24f7-4a95-bd5d-27f5f2bc1a32', 'volume_name': 'volume-35dc301b-24f7-4a95-bd5d-27f5f2bc1a32', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 23:00:04 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-372edf3c-dea0-434c-aadd-4a1257ce1403 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c965f903-aaca-4075-9792-32adbf54aa9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 23:00:04 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-372edf3c-dea0-434c-aadd-4a1257ce1403 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c965f903-aaca-4075-9792-32adbf54aa9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 23:00:04 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-372edf3c-dea0-434c-aadd-4a1257ce1403 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19ed632c-d9d9-4d72-9bc5-adef382baefb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 23:00:04 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-372edf3c-dea0-434c-aadd-4a1257ce1403 tempest-ProjectMemberTests-1763329861 None] Volume 35dc301b-24f7-4a95-bd5d-27f5f2bc1a32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35dc301b-24f7-4a95-bd5d-27f5f2bc1a32', 'volume_size': 1} Sep 04 23:00:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-372edf3c-dea0-434c-aadd-4a1257ce1403 tempest-ProjectMemberTests-1763329861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 23:00:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-372edf3c-dea0-434c-aadd-4a1257ce1403 tempest-ProjectMemberTests-1763329861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 23:00:04 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-372edf3c-dea0-434c-aadd-4a1257ce1403 tempest-ProjectMemberTests-1763329861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T21:00:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-237000737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35dc301b-24f7-4a95-bd5d-27f5f2bc1a32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea67d0db23b2432187cdb39da7ed0530',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T21:00:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T21:00:04Z,use_quota=True,user_id='f2beadaff952455f8e8d8ab5cdc33aa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 23:00:04 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-372edf3c-dea0-434c-aadd-4a1257ce1403 tempest-ProjectMemberTests-1763329861 None] Creating volume 35dc301b-24f7-4a95-bd5d-27f5f2bc1a32 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 23:00:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-372edf3c-dea0-434c-aadd-4a1257ce1403 tempest-ProjectMemberTests-1763329861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 23:00:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-372edf3c-dea0-434c-aadd-4a1257ce1403 tempest-ProjectMemberTests-1763329861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 23:00:04 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-372edf3c-dea0-434c-aadd-4a1257ce1403 tempest-ProjectMemberTests-1763329861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 23:00:04 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-372edf3c-dea0-434c-aadd-4a1257ce1403 tempest-ProjectMemberTests-1763329861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 23:00:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-372edf3c-dea0-434c-aadd-4a1257ce1403 tempest-ProjectMemberTests-1763329861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 23:00:04 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-372edf3c-dea0-434c-aadd-4a1257ce1403 tempest-ProjectMemberTests-1763329861 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 23:00:04 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-372edf3c-dea0-434c-aadd-4a1257ce1403 tempest-ProjectMemberTests-1763329861 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 23:00:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-372edf3c-dea0-434c-aadd-4a1257ce1403 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-35dc301b-24f7-4a95-bd5d-27f5f2bc1a32 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:04 devstack sudo[107962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-35dc301b-24f7-4a95-bd5d-27f5f2bc1a32 1073741824 Sep 04 23:00:04 devstack sudo[107962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:04 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-fc5a1620-6378-4f67-87a9-ff3b55c7cc56 tempest-ProjectReaderTests-1498489724 None] Acquiring lock "cinder-5eaa2720-3af3-4d57-b460-baae7626a556-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 23:00:04 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-fc5a1620-6378-4f67-87a9-ff3b55c7cc56 tempest-ProjectReaderTests-1498489724 None] Lock "cinder-5eaa2720-3af3-4d57-b460-baae7626a556-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 23:00:04 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-fc5a1620-6378-4f67-87a9-ff3b55c7cc56 tempest-ProjectReaderTests-1498489724 None] Acquiring lock "cinder-quobyte-5eaa2720-3af3-4d57-b460-baae7626a556" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 23:00:04 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-fc5a1620-6378-4f67-87a9-ff3b55c7cc56 tempest-ProjectReaderTests-1498489724 None] Lock "cinder-quobyte-5eaa2720-3af3-4d57-b460-baae7626a556" acquired by "delete_volume" :: waited 0.019s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 23:00:04 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e43148-d566-45f0-b51a-d76e6e3e944c]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 23:00:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-fc5a1620-6378-4f67-87a9-ff3b55c7cc56 tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5eaa2720-3af3-4d57-b460-baae7626a556 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:04 devstack sudo[107962]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-372edf3c-dea0-434c-aadd-4a1257ce1403 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-35dc301b-24f7-4a95-bd5d-27f5f2bc1a32 1073741824" returned: 0 in 0.453s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:04 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-372edf3c-dea0-434c-aadd-4a1257ce1403 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-35dc301b-24f7-4a95-bd5d-27f5f2bc1a32 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:04 devstack sudo[107968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-35dc301b-24f7-4a95-bd5d-27f5f2bc1a32 Sep 04 23:00:04 devstack sudo[107968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:05 devstack sudo[107967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5eaa2720-3af3-4d57-b460-baae7626a556 Sep 04 23:00:05 devstack sudo[107967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:05 devstack sudo[107968]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-372edf3c-dea0-434c-aadd-4a1257ce1403 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-35dc301b-24f7-4a95-bd5d-27f5f2bc1a32" returned: 0 in 0.234s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:05 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-372edf3c-dea0-434c-aadd-4a1257ce1403 tempest-ProjectMemberTests-1763329861 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 23:00:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-372edf3c-dea0-434c-aadd-4a1257ce1403 tempest-ProjectMemberTests-1763329861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 23:00:05 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-372edf3c-dea0-434c-aadd-4a1257ce1403 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19ed632c-d9d9-4d72-9bc5-adef382baefb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35dc301b-24f7-4a95-bd5d-27f5f2bc1a32', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 23:00:05 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-372edf3c-dea0-434c-aadd-4a1257ce1403 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af31f582-1736-449f-a315-0d10d5837268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 23:00:05 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-372edf3c-dea0-434c-aadd-4a1257ce1403 tempest-ProjectMemberTests-1763329861 None] Volume volume-35dc301b-24f7-4a95-bd5d-27f5f2bc1a32 (35dc301b-24f7-4a95-bd5d-27f5f2bc1a32): created successfully Sep 04 23:00:05 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-372edf3c-dea0-434c-aadd-4a1257ce1403 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af31f582-1736-449f-a315-0d10d5837268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 23:00:05 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-372edf3c-dea0-434c-aadd-4a1257ce1403 tempest-ProjectMemberTests-1763329861 None] Flow 'volume_create_manager' (ff7c95c5-1c7c-4332-b82b-1c442bf4fea4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 23:00:05 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-372edf3c-dea0-434c-aadd-4a1257ce1403 tempest-ProjectMemberTests-1763329861 None] Created volume successfully. Sep 04 23:00:05 devstack sudo[107967]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-fc5a1620-6378-4f67-87a9-ff3b55c7cc56 tempest-ProjectReaderTests-1498489724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5eaa2720-3af3-4d57-b460-baae7626a556" returned: 0 in 0.376s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-fc5a1620-6378-4f67-87a9-ff3b55c7cc56 tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5eaa2720-3af3-4d57-b460-baae7626a556 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:05 devstack sudo[107976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5eaa2720-3af3-4d57-b460-baae7626a556 Sep 04 23:00:05 devstack sudo[107976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:05 devstack sudo[107976]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-fc5a1620-6378-4f67-87a9-ff3b55c7cc56 tempest-ProjectReaderTests-1498489724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-5eaa2720-3af3-4d57-b460-baae7626a556" returned: 0 in 0.267s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:05 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-fc5a1620-6378-4f67-87a9-ff3b55c7cc56 tempest-ProjectReaderTests-1498489724 None] Lock "cinder-quobyte-5eaa2720-3af3-4d57-b460-baae7626a556" released by "delete_volume" :: held 0.709s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 23:00:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-d63c03f0-c96c-4485-99f5-efb622171807 tempest-ProjectMemberTests-1763329861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 23:00:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-d63c03f0-c96c-4485-99f5-efb622171807 tempest-ProjectMemberTests-1763329861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 23:00:05 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-d63c03f0-c96c-4485-99f5-efb622171807 tempest-ProjectMemberTests-1763329861 None] Creating offline snapshot 7a6837bf-80a5-469a-a3ac-a4c0cffe1398 of volume 35dc301b-24f7-4a95-bd5d-27f5f2bc1a32 {{(pid=87576) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 23:00:05 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f1de23-41dd-4a14-85dc-538202e0caf2]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 23:00:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d63c03f0-c96c-4485-99f5-efb622171807 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-35dc301b-24f7-4a95-bd5d-27f5f2bc1a32 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:05 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-fc5a1620-6378-4f67-87a9-ff3b55c7cc56 tempest-ProjectReaderTests-1498489724 None] Created reservations ['0c87f016-1f76-47e0-9045-12015a298ddf', '58fa77ab-e7bf-4c51-95a4-b2747ba433b2', 'ac4658e7-0534-40c9-84fc-24cd38be3276', 'c9c7444f-22a3-4007-915c-0eaf71a94f2c'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 23:00:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-fc5a1620-6378-4f67-87a9-ff3b55c7cc56 tempest-ProjectReaderTests-1498489724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 23:00:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-fc5a1620-6378-4f67-87a9-ff3b55c7cc56 tempest-ProjectReaderTests-1498489724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 23:00:05 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-fc5a1620-6378-4f67-87a9-ff3b55c7cc56 tempest-ProjectReaderTests-1498489724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 23:00:05 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-fc5a1620-6378-4f67-87a9-ff3b55c7cc56 tempest-ProjectReaderTests-1498489724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 23:00:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-fc5a1620-6378-4f67-87a9-ff3b55c7cc56 tempest-ProjectReaderTests-1498489724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 23:00:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-fc5a1620-6378-4f67-87a9-ff3b55c7cc56 tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:05 devstack sudo[107979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-35dc301b-24f7-4a95-bd5d-27f5f2bc1a32 Sep 04 23:00:05 devstack sudo[107979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:05 devstack sudo[107980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 23:00:05 devstack sudo[107980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:05 devstack sudo[107980]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-fc5a1620-6378-4f67-87a9-ff3b55c7cc56 tempest-ProjectReaderTests-1498489724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.247s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:05 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-fc5a1620-6378-4f67-87a9-ff3b55c7cc56 tempest-ProjectReaderTests-1498489724 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 23:00:05 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-fc5a1620-6378-4f67-87a9-ff3b55c7cc56 tempest-ProjectReaderTests-1498489724 None] Deleted volume successfully. Sep 04 23:00:06 devstack sudo[107979]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d63c03f0-c96c-4485-99f5-efb622171807 tempest-ProjectMemberTests-1763329861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-35dc301b-24f7-4a95-bd5d-27f5f2bc1a32" returned: 0 in 0.366s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d63c03f0-c96c-4485-99f5-efb622171807 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-35dc301b-24f7-4a95-bd5d-27f5f2bc1a32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-35dc301b-24f7-4a95-bd5d-27f5f2bc1a32.7a6837bf-80a5-469a-a3ac-a4c0cffe1398 1G {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:06 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-fc5a1620-6378-4f67-87a9-ff3b55c7cc56 tempest-ProjectReaderTests-1498489724 None] Lock "cinder-5eaa2720-3af3-4d57-b460-baae7626a556-delete_volume" released by "delete_volume" :: held 1.217s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 23:00:06 devstack sudo[107987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-35dc301b-24f7-4a95-bd5d-27f5f2bc1a32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-35dc301b-24f7-4a95-bd5d-27f5f2bc1a32.7a6837bf-80a5-469a-a3ac-a4c0cffe1398 1G Sep 04 23:00:06 devstack sudo[107987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:06 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-2136691a-3d7c-45f1-9610-77697e4f3142 tempest-ProjectReaderTests-1498489724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 23:00:06 devstack sudo[107987]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:06 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2136691a-3d7c-45f1-9610-77697e4f3142 tempest-ProjectReaderTests-1498489724 None] Flow 'volume_create_manager' (bc5a2564-b625-4e96-9f71-ee8d57fb6209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 23:00:06 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2136691a-3d7c-45f1-9610-77697e4f3142 tempest-ProjectReaderTests-1498489724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c7c9381-4e55-462e-ab6d-939343e97dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 23:00:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d63c03f0-c96c-4485-99f5-efb622171807 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-35dc301b-24f7-4a95-bd5d-27f5f2bc1a32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-35dc301b-24f7-4a95-bd5d-27f5f2bc1a32.7a6837bf-80a5-469a-a3ac-a4c0cffe1398 1G" returned: 0 in 0.447s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d63c03f0-c96c-4485-99f5-efb622171807 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35dc301b-24f7-4a95-bd5d-27f5f2bc1a32 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-35dc301b-24f7-4a95-bd5d-27f5f2bc1a32.7a6837bf-80a5-469a-a3ac-a4c0cffe1398 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:06 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2136691a-3d7c-45f1-9610-77697e4f3142 tempest-ProjectReaderTests-1498489724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c7c9381-4e55-462e-ab6d-939343e97dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T21:00:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1923458232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78e526c2-14fb-402d-b5ec-23baf034a271,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7585397571d4467c940871ba04edaa79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T21:00:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T21:00:06Z,use_quota=True,user_id='7ce20a5cf92b4a7dae47527aa9513e2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 23:00:06 devstack sudo[107993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35dc301b-24f7-4a95-bd5d-27f5f2bc1a32 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-35dc301b-24f7-4a95-bd5d-27f5f2bc1a32.7a6837bf-80a5-469a-a3ac-a4c0cffe1398 Sep 04 23:00:06 devstack sudo[107993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:06 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2136691a-3d7c-45f1-9610-77697e4f3142 tempest-ProjectReaderTests-1498489724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b0045a4-4c13-4359-a27f-50407139764f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 23:00:06 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2136691a-3d7c-45f1-9610-77697e4f3142 tempest-ProjectReaderTests-1498489724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b0045a4-4c13-4359-a27f-50407139764f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 23:00:06 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2136691a-3d7c-45f1-9610-77697e4f3142 tempest-ProjectReaderTests-1498489724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff4f2387-d5dc-46d1-8ca3-cd58a8dee91a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 23:00:06 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2136691a-3d7c-45f1-9610-77697e4f3142 tempest-ProjectReaderTests-1498489724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff4f2387-d5dc-46d1-8ca3-cd58a8dee91a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78e526c2-14fb-402d-b5ec-23baf034a271', 'volume_name': 'volume-78e526c2-14fb-402d-b5ec-23baf034a271', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 23:00:06 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2136691a-3d7c-45f1-9610-77697e4f3142 tempest-ProjectReaderTests-1498489724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d203c37-a09b-4c32-b8cd-86d9f1688ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 23:00:06 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2136691a-3d7c-45f1-9610-77697e4f3142 tempest-ProjectReaderTests-1498489724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d203c37-a09b-4c32-b8cd-86d9f1688ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 23:00:06 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2136691a-3d7c-45f1-9610-77697e4f3142 tempest-ProjectReaderTests-1498489724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd125e46-6553-4dee-9294-a67d73f5abeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 23:00:06 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-2136691a-3d7c-45f1-9610-77697e4f3142 tempest-ProjectReaderTests-1498489724 None] Volume 78e526c2-14fb-402d-b5ec-23baf034a271: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78e526c2-14fb-402d-b5ec-23baf034a271', 'volume_size': 1} Sep 04 23:00:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-2136691a-3d7c-45f1-9610-77697e4f3142 tempest-ProjectReaderTests-1498489724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 23:00:06 devstack sudo[107993]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d63c03f0-c96c-4485-99f5-efb622171807 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35dc301b-24f7-4a95-bd5d-27f5f2bc1a32 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-35dc301b-24f7-4a95-bd5d-27f5f2bc1a32.7a6837bf-80a5-469a-a3ac-a4c0cffe1398" returned: 0 in 0.281s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:06 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-d63c03f0-c96c-4485-99f5-efb622171807 tempest-ProjectMemberTests-1763329861 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-35dc301b-24f7-4a95-bd5d-27f5f2bc1a32.7a6837bf-80a5-469a-a3ac-a4c0cffe1398 is being set with open permissions: ugo+rw Sep 04 23:00:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d63c03f0-c96c-4485-99f5-efb622171807 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-35dc301b-24f7-4a95-bd5d-27f5f2bc1a32.7a6837bf-80a5-469a-a3ac-a4c0cffe1398 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:06 devstack sudo[107998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-35dc301b-24f7-4a95-bd5d-27f5f2bc1a32.7a6837bf-80a5-469a-a3ac-a4c0cffe1398 Sep 04 23:00:06 devstack sudo[107998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:06 devstack sudo[107998]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d63c03f0-c96c-4485-99f5-efb622171807 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-35dc301b-24f7-4a95-bd5d-27f5f2bc1a32.7a6837bf-80a5-469a-a3ac-a4c0cffe1398" returned: 0 in 0.238s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d63c03f0-c96c-4485-99f5-efb622171807 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-35dc301b-24f7-4a95-bd5d-27f5f2bc1a32.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:07 devstack sudo[108001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-35dc301b-24f7-4a95-bd5d-27f5f2bc1a32.info Sep 04 23:00:07 devstack sudo[108001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:07 devstack sudo[108001]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d63c03f0-c96c-4485-99f5-efb622171807 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-35dc301b-24f7-4a95-bd5d-27f5f2bc1a32.info" returned: 0 in 0.246s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:07 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-d63c03f0-c96c-4485-99f5-efb622171807 tempest-ProjectMemberTests-1763329861 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-35dc301b-24f7-4a95-bd5d-27f5f2bc1a32.info is being set with open permissions: ugo+rw Sep 04 23:00:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d63c03f0-c96c-4485-99f5-efb622171807 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-35dc301b-24f7-4a95-bd5d-27f5f2bc1a32.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:07 devstack sudo[108004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-35dc301b-24f7-4a95-bd5d-27f5f2bc1a32.info Sep 04 23:00:07 devstack sudo[108004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:07 devstack sudo[108004]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-d63c03f0-c96c-4485-99f5-efb622171807 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-35dc301b-24f7-4a95-bd5d-27f5f2bc1a32.info" returned: 0 in 0.236s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-d63c03f0-c96c-4485-99f5-efb622171807 tempest-ProjectMemberTests-1763329861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.892s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 23:00:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-2136691a-3d7c-45f1-9610-77697e4f3142 tempest-ProjectReaderTests-1498489724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.987s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 23:00:07 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-2136691a-3d7c-45f1-9610-77697e4f3142 tempest-ProjectReaderTests-1498489724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T21:00:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1923458232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78e526c2-14fb-402d-b5ec-23baf034a271,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7585397571d4467c940871ba04edaa79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T21:00:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T21:00:06Z,use_quota=True,user_id='7ce20a5cf92b4a7dae47527aa9513e2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 23:00:07 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-2136691a-3d7c-45f1-9610-77697e4f3142 tempest-ProjectReaderTests-1498489724 None] Creating volume 78e526c2-14fb-402d-b5ec-23baf034a271 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 23:00:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-2136691a-3d7c-45f1-9610-77697e4f3142 tempest-ProjectReaderTests-1498489724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 23:00:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-2136691a-3d7c-45f1-9610-77697e4f3142 tempest-ProjectReaderTests-1498489724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 23:00:07 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-2136691a-3d7c-45f1-9610-77697e4f3142 tempest-ProjectReaderTests-1498489724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 23:00:07 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-2136691a-3d7c-45f1-9610-77697e4f3142 tempest-ProjectReaderTests-1498489724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 23:00:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-2136691a-3d7c-45f1-9610-77697e4f3142 tempest-ProjectReaderTests-1498489724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 23:00:07 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-2136691a-3d7c-45f1-9610-77697e4f3142 tempest-ProjectReaderTests-1498489724 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 23:00:07 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-2136691a-3d7c-45f1-9610-77697e4f3142 tempest-ProjectReaderTests-1498489724 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 23:00:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2136691a-3d7c-45f1-9610-77697e4f3142 tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-78e526c2-14fb-402d-b5ec-23baf034a271 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:07 devstack sudo[108007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-78e526c2-14fb-402d-b5ec-23baf034a271 1073741824 Sep 04 23:00:07 devstack sudo[108007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:07 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-d63c03f0-c96c-4485-99f5-efb622171807 tempest-ProjectMemberTests-1763329861 None] Create snapshot completed successfully Sep 04 23:00:07 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-6a821e07-e292-4abe-9ab3-b67abf4d2662 tempest-ProjectMemberTests-1763329861 None] Acquiring lock "cinder-7a6837bf-80a5-469a-a3ac-a4c0cffe1398-delete_snapshot" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 23:00:07 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-6a821e07-e292-4abe-9ab3-b67abf4d2662 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-7a6837bf-80a5-469a-a3ac-a4c0cffe1398-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 23:00:07 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-6a821e07-e292-4abe-9ab3-b67abf4d2662 tempest-ProjectMemberTests-1763329861 None] Acquiring lock "cinder-quobyte-35dc301b-24f7-4a95-bd5d-27f5f2bc1a32" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 23:00:07 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-6a821e07-e292-4abe-9ab3-b67abf4d2662 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-quobyte-35dc301b-24f7-4a95-bd5d-27f5f2bc1a32" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 23:00:07 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-6a821e07-e292-4abe-9ab3-b67abf4d2662 tempest-ProjectMemberTests-1763329861 None] Acquiring lock "cinder-quobyte-7a6837bf-80a5-469a-a3ac-a4c0cffe1398" by "_delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 23:00:07 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-6a821e07-e292-4abe-9ab3-b67abf4d2662 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-quobyte-7a6837bf-80a5-469a-a3ac-a4c0cffe1398" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 23:00:07 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-6a821e07-e292-4abe-9ab3-b67abf4d2662 tempest-ProjectMemberTests-1763329861 None] Deleting offline snapshot 7a6837bf-80a5-469a-a3ac-a4c0cffe1398 of volume 35dc301b-24f7-4a95-bd5d-27f5f2bc1a32 {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 23:00:07 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-6a821e07-e292-4abe-9ab3-b67abf4d2662 tempest-ProjectMemberTests-1763329861 None] snapshot_file for this snap is: volume-35dc301b-24f7-4a95-bd5d-27f5f2bc1a32.7a6837bf-80a5-469a-a3ac-a4c0cffe1398 {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 23:00:07 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[e229b93a-79f6-4a46-a172-af24fef923eb]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 23:00:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-6a821e07-e292-4abe-9ab3-b67abf4d2662 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-35dc301b-24f7-4a95-bd5d-27f5f2bc1a32.7a6837bf-80a5-469a-a3ac-a4c0cffe1398 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:07 devstack sudo[108012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-35dc301b-24f7-4a95-bd5d-27f5f2bc1a32.7a6837bf-80a5-469a-a3ac-a4c0cffe1398 Sep 04 23:00:07 devstack sudo[108012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:07 devstack sudo[108007]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2136691a-3d7c-45f1-9610-77697e4f3142 tempest-ProjectReaderTests-1498489724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-78e526c2-14fb-402d-b5ec-23baf034a271 1073741824" returned: 0 in 0.437s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2136691a-3d7c-45f1-9610-77697e4f3142 tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-78e526c2-14fb-402d-b5ec-23baf034a271 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:08 devstack sudo[108014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-78e526c2-14fb-402d-b5ec-23baf034a271 Sep 04 23:00:08 devstack sudo[108014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:08 devstack sudo[108012]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-6a821e07-e292-4abe-9ab3-b67abf4d2662 tempest-ProjectMemberTests-1763329861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-35dc301b-24f7-4a95-bd5d-27f5f2bc1a32.7a6837bf-80a5-469a-a3ac-a4c0cffe1398" returned: 0 in 0.382s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:08 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-6a821e07-e292-4abe-9ab3-b67abf4d2662 tempest-ProjectMemberTests-1763329861 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35dc301b-24f7-4a95-bd5d-27f5f2bc1a32(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 23:00:08 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d03af3-97f0-4c50-a26f-073fbec8bf0a]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 23:00:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-6a821e07-e292-4abe-9ab3-b67abf4d2662 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-35dc301b-24f7-4a95-bd5d-27f5f2bc1a32 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:08 devstack sudo[108014]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-2136691a-3d7c-45f1-9610-77697e4f3142 tempest-ProjectReaderTests-1498489724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-78e526c2-14fb-402d-b5ec-23baf034a271" returned: 0 in 0.250s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:08 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-2136691a-3d7c-45f1-9610-77697e4f3142 tempest-ProjectReaderTests-1498489724 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 23:00:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-2136691a-3d7c-45f1-9610-77697e4f3142 tempest-ProjectReaderTests-1498489724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 23:00:08 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2136691a-3d7c-45f1-9610-77697e4f3142 tempest-ProjectReaderTests-1498489724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd125e46-6553-4dee-9294-a67d73f5abeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78e526c2-14fb-402d-b5ec-23baf034a271', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 23:00:08 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2136691a-3d7c-45f1-9610-77697e4f3142 tempest-ProjectReaderTests-1498489724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbd6ecc6-a548-4035-aea6-3c2eeac59f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 23:00:08 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-2136691a-3d7c-45f1-9610-77697e4f3142 tempest-ProjectReaderTests-1498489724 None] Volume volume-78e526c2-14fb-402d-b5ec-23baf034a271 (78e526c2-14fb-402d-b5ec-23baf034a271): created successfully Sep 04 23:00:08 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2136691a-3d7c-45f1-9610-77697e4f3142 tempest-ProjectReaderTests-1498489724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbd6ecc6-a548-4035-aea6-3c2eeac59f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 23:00:08 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-2136691a-3d7c-45f1-9610-77697e4f3142 tempest-ProjectReaderTests-1498489724 None] Flow 'volume_create_manager' (bc5a2564-b625-4e96-9f71-ee8d57fb6209) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 23:00:08 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-2136691a-3d7c-45f1-9610-77697e4f3142 tempest-ProjectReaderTests-1498489724 None] Created volume successfully. Sep 04 23:00:08 devstack sudo[108020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-35dc301b-24f7-4a95-bd5d-27f5f2bc1a32 Sep 04 23:00:08 devstack sudo[108020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:08 devstack sudo[108020]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-6a821e07-e292-4abe-9ab3-b67abf4d2662 tempest-ProjectMemberTests-1763329861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-35dc301b-24f7-4a95-bd5d-27f5f2bc1a32" returned: 0 in 0.394s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-6a821e07-e292-4abe-9ab3-b67abf4d2662 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-35dc301b-24f7-4a95-bd5d-27f5f2bc1a32.7a6837bf-80a5-469a-a3ac-a4c0cffe1398 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:08 devstack sudo[108027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-35dc301b-24f7-4a95-bd5d-27f5f2bc1a32.7a6837bf-80a5-469a-a3ac-a4c0cffe1398 Sep 04 23:00:08 devstack sudo[108027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-3c104ed9-ccb5-4008-997f-bf88353d1d83 tempest-ProjectReaderTests-1498489724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 23:00:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-3c104ed9-ccb5-4008-997f-bf88353d1d83 tempest-ProjectReaderTests-1498489724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 23:00:08 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-3c104ed9-ccb5-4008-997f-bf88353d1d83 tempest-ProjectReaderTests-1498489724 None] Creating offline snapshot 5a15789c-c5ee-44d1-b33c-f18134af69e1 of volume 78e526c2-14fb-402d-b5ec-23baf034a271 {{(pid=87576) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 23:00:08 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32a4247-711f-4174-a888-8b69d1155586]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 23:00:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3c104ed9-ccb5-4008-997f-bf88353d1d83 tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-78e526c2-14fb-402d-b5ec-23baf034a271 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:08 devstack sudo[108029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-78e526c2-14fb-402d-b5ec-23baf034a271 Sep 04 23:00:08 devstack sudo[108029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:09 devstack sudo[108027]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-6a821e07-e292-4abe-9ab3-b67abf4d2662 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-35dc301b-24f7-4a95-bd5d-27f5f2bc1a32.7a6837bf-80a5-469a-a3ac-a4c0cffe1398" returned: 0 in 0.421s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-6a821e07-e292-4abe-9ab3-b67abf4d2662 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-35dc301b-24f7-4a95-bd5d-27f5f2bc1a32.7a6837bf-80a5-469a-a3ac-a4c0cffe1398 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:09 devstack sudo[108035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-35dc301b-24f7-4a95-bd5d-27f5f2bc1a32.7a6837bf-80a5-469a-a3ac-a4c0cffe1398 Sep 04 23:00:09 devstack sudo[108035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:09 devstack sudo[108029]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3c104ed9-ccb5-4008-997f-bf88353d1d83 tempest-ProjectReaderTests-1498489724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-78e526c2-14fb-402d-b5ec-23baf034a271" returned: 0 in 0.401s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3c104ed9-ccb5-4008-997f-bf88353d1d83 tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-78e526c2-14fb-402d-b5ec-23baf034a271,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-78e526c2-14fb-402d-b5ec-23baf034a271.5a15789c-c5ee-44d1-b33c-f18134af69e1 1G {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:09 devstack sudo[108040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-78e526c2-14fb-402d-b5ec-23baf034a271,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-78e526c2-14fb-402d-b5ec-23baf034a271.5a15789c-c5ee-44d1-b33c-f18134af69e1 1G Sep 04 23:00:09 devstack sudo[108040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:09 devstack sudo[108035]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-6a821e07-e292-4abe-9ab3-b67abf4d2662 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-35dc301b-24f7-4a95-bd5d-27f5f2bc1a32.7a6837bf-80a5-469a-a3ac-a4c0cffe1398" returned: 0 in 0.266s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:09 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-6a821e07-e292-4abe-9ab3-b67abf4d2662 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-quobyte-7a6837bf-80a5-469a-a3ac-a4c0cffe1398" released by "_delete_snapshot" :: held 1.557s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 23:00:09 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-6a821e07-e292-4abe-9ab3-b67abf4d2662 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-quobyte-35dc301b-24f7-4a95-bd5d-27f5f2bc1a32" released by "delete_snapshot" :: held 1.584s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 23:00:09 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-6a821e07-e292-4abe-9ab3-b67abf4d2662 tempest-ProjectMemberTests-1763329861 None] Created reservations ['7f0be603-12a4-43ea-9108-8f6858c03f50', '221cd00d-898c-4efe-bb11-8f280b0f018a', 'ace562e8-3d3e-44b1-a7ff-81adeb837fda', 'ff4ced97-ba82-4316-a4f2-58bbb4f67cd6'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 23:00:09 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-6a821e07-e292-4abe-9ab3-b67abf4d2662 tempest-ProjectMemberTests-1763329861 None] Delete snapshot completed successfully. Sep 04 23:00:09 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-6a821e07-e292-4abe-9ab3-b67abf4d2662 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-7a6837bf-80a5-469a-a3ac-a4c0cffe1398-delete_snapshot" released by "delete_snapshot" :: held 1.726s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 23:00:09 devstack sudo[108040]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3c104ed9-ccb5-4008-997f-bf88353d1d83 tempest-ProjectReaderTests-1498489724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-78e526c2-14fb-402d-b5ec-23baf034a271,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-78e526c2-14fb-402d-b5ec-23baf034a271.5a15789c-c5ee-44d1-b33c-f18134af69e1 1G" returned: 0 in 0.403s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3c104ed9-ccb5-4008-997f-bf88353d1d83 tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78e526c2-14fb-402d-b5ec-23baf034a271 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-78e526c2-14fb-402d-b5ec-23baf034a271.5a15789c-c5ee-44d1-b33c-f18134af69e1 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:09 devstack sudo[108047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78e526c2-14fb-402d-b5ec-23baf034a271 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-78e526c2-14fb-402d-b5ec-23baf034a271.5a15789c-c5ee-44d1-b33c-f18134af69e1 Sep 04 23:00:09 devstack sudo[108047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:09 devstack sudo[108047]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3c104ed9-ccb5-4008-997f-bf88353d1d83 tempest-ProjectReaderTests-1498489724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78e526c2-14fb-402d-b5ec-23baf034a271 -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-78e526c2-14fb-402d-b5ec-23baf034a271.5a15789c-c5ee-44d1-b33c-f18134af69e1" returned: 0 in 0.301s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:09 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-3c104ed9-ccb5-4008-997f-bf88353d1d83 tempest-ProjectReaderTests-1498489724 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-78e526c2-14fb-402d-b5ec-23baf034a271.5a15789c-c5ee-44d1-b33c-f18134af69e1 is being set with open permissions: ugo+rw Sep 04 23:00:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3c104ed9-ccb5-4008-997f-bf88353d1d83 tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-78e526c2-14fb-402d-b5ec-23baf034a271.5a15789c-c5ee-44d1-b33c-f18134af69e1 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:09 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-8d9eb491-c4b6-486d-92bd-6122222e8ef9 tempest-ProjectMemberTests-1763329861 None] Acquiring lock "cinder-35dc301b-24f7-4a95-bd5d-27f5f2bc1a32-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 23:00:09 devstack sudo[108052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-78e526c2-14fb-402d-b5ec-23baf034a271.5a15789c-c5ee-44d1-b33c-f18134af69e1 Sep 04 23:00:09 devstack sudo[108052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:09 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-8d9eb491-c4b6-486d-92bd-6122222e8ef9 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-35dc301b-24f7-4a95-bd5d-27f5f2bc1a32-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 23:00:09 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-8d9eb491-c4b6-486d-92bd-6122222e8ef9 tempest-ProjectMemberTests-1763329861 None] Acquiring lock "cinder-quobyte-35dc301b-24f7-4a95-bd5d-27f5f2bc1a32" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 23:00:09 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-8d9eb491-c4b6-486d-92bd-6122222e8ef9 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-quobyte-35dc301b-24f7-4a95-bd5d-27f5f2bc1a32" acquired by "delete_volume" :: waited 0.017s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 23:00:10 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5f1eea-ccb6-4168-b9ef-bbdbcbd321c5]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 23:00:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-8d9eb491-c4b6-486d-92bd-6122222e8ef9 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-35dc301b-24f7-4a95-bd5d-27f5f2bc1a32 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:10 devstack sudo[108054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-35dc301b-24f7-4a95-bd5d-27f5f2bc1a32 Sep 04 23:00:10 devstack sudo[108054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:10 devstack sudo[108052]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3c104ed9-ccb5-4008-997f-bf88353d1d83 tempest-ProjectReaderTests-1498489724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-78e526c2-14fb-402d-b5ec-23baf034a271.5a15789c-c5ee-44d1-b33c-f18134af69e1" returned: 0 in 0.274s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3c104ed9-ccb5-4008-997f-bf88353d1d83 tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-78e526c2-14fb-402d-b5ec-23baf034a271.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:10 devstack sudo[108057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-78e526c2-14fb-402d-b5ec-23baf034a271.info Sep 04 23:00:10 devstack sudo[108057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:10 devstack sudo[108054]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-8d9eb491-c4b6-486d-92bd-6122222e8ef9 tempest-ProjectMemberTests-1763329861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-35dc301b-24f7-4a95-bd5d-27f5f2bc1a32" returned: 0 in 0.368s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-8d9eb491-c4b6-486d-92bd-6122222e8ef9 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-35dc301b-24f7-4a95-bd5d-27f5f2bc1a32 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:10 devstack sudo[108062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-35dc301b-24f7-4a95-bd5d-27f5f2bc1a32 Sep 04 23:00:10 devstack sudo[108062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:10 devstack sudo[108057]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3c104ed9-ccb5-4008-997f-bf88353d1d83 tempest-ProjectReaderTests-1498489724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-78e526c2-14fb-402d-b5ec-23baf034a271.info" returned: 0 in 0.267s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:10 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-3c104ed9-ccb5-4008-997f-bf88353d1d83 tempest-ProjectReaderTests-1498489724 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-78e526c2-14fb-402d-b5ec-23baf034a271.info is being set with open permissions: ugo+rw Sep 04 23:00:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3c104ed9-ccb5-4008-997f-bf88353d1d83 tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-78e526c2-14fb-402d-b5ec-23baf034a271.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:10 devstack sudo[108065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-78e526c2-14fb-402d-b5ec-23baf034a271.info Sep 04 23:00:10 devstack sudo[108065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:10 devstack sudo[108062]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-8d9eb491-c4b6-486d-92bd-6122222e8ef9 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-35dc301b-24f7-4a95-bd5d-27f5f2bc1a32" returned: 0 in 0.265s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:10 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-8d9eb491-c4b6-486d-92bd-6122222e8ef9 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-quobyte-35dc301b-24f7-4a95-bd5d-27f5f2bc1a32" released by "delete_volume" :: held 0.690s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 23:00:10 devstack sudo[108065]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3c104ed9-ccb5-4008-997f-bf88353d1d83 tempest-ProjectReaderTests-1498489724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-78e526c2-14fb-402d-b5ec-23baf034a271.info" returned: 0 in 0.242s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-3c104ed9-ccb5-4008-997f-bf88353d1d83 tempest-ProjectReaderTests-1498489724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.976s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 23:00:10 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-3c104ed9-ccb5-4008-997f-bf88353d1d83 tempest-ProjectReaderTests-1498489724 None] Create snapshot completed successfully Sep 04 23:00:10 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-8d9eb491-c4b6-486d-92bd-6122222e8ef9 tempest-ProjectMemberTests-1763329861 None] Created reservations ['82b24ee1-4392-41cb-9e3d-59a300abcddb', 'aaef35e7-a59d-4986-bcde-d9424c76a55b', '89b800b7-1f32-44d5-b125-bb22900b4a70', 'b2241139-941b-4336-bfd5-06b47144a591'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 23:00:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-8d9eb491-c4b6-486d-92bd-6122222e8ef9 tempest-ProjectMemberTests-1763329861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 23:00:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-8d9eb491-c4b6-486d-92bd-6122222e8ef9 tempest-ProjectMemberTests-1763329861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 23:00:10 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-8d9eb491-c4b6-486d-92bd-6122222e8ef9 tempest-ProjectMemberTests-1763329861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 23:00:10 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-8d9eb491-c4b6-486d-92bd-6122222e8ef9 tempest-ProjectMemberTests-1763329861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 23:00:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-8d9eb491-c4b6-486d-92bd-6122222e8ef9 tempest-ProjectMemberTests-1763329861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 23:00:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-8d9eb491-c4b6-486d-92bd-6122222e8ef9 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:10 devstack sudo[108069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 23:00:10 devstack sudo[108069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:11 devstack sudo[108069]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-8d9eb491-c4b6-486d-92bd-6122222e8ef9 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.251s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:11 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-8d9eb491-c4b6-486d-92bd-6122222e8ef9 tempest-ProjectMemberTests-1763329861 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 23:00:11 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-8d9eb491-c4b6-486d-92bd-6122222e8ef9 tempest-ProjectMemberTests-1763329861 None] Deleted volume successfully. Sep 04 23:00:11 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-8d9eb491-c4b6-486d-92bd-6122222e8ef9 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-35dc301b-24f7-4a95-bd5d-27f5f2bc1a32-delete_volume" released by "delete_volume" :: held 1.173s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 23:00:11 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-1268d2d4-81de-42f8-89db-b916524ee538 tempest-ProjectMemberTests-1763329861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 23:00:11 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-1268d2d4-81de-42f8-89db-b916524ee538 tempest-ProjectMemberTests-1763329861 None] Flow 'volume_create_manager' (95c383c4-be45-498b-936c-42b390e4397f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 23:00:11 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-1268d2d4-81de-42f8-89db-b916524ee538 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ebe29d3-4e1e-4048-a653-cbe5ea72337e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 23:00:11 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-1268d2d4-81de-42f8-89db-b916524ee538 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ebe29d3-4e1e-4048-a653-cbe5ea72337e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T21:00:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1519802100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eab6b92-b72f-4c41-9c6d-e98066ba0d8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea67d0db23b2432187cdb39da7ed0530',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T21:00:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T21:00:12Z,use_quota=True,user_id='f2beadaff952455f8e8d8ab5cdc33aa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 23:00:11 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-1268d2d4-81de-42f8-89db-b916524ee538 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60048f2d-860c-4664-b73e-37ef215ef92d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 23:00:11 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-1268d2d4-81de-42f8-89db-b916524ee538 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60048f2d-860c-4664-b73e-37ef215ef92d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 23:00:11 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-1268d2d4-81de-42f8-89db-b916524ee538 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3870515d-a2a2-4653-8ac3-0316b460d755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 23:00:11 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-1268d2d4-81de-42f8-89db-b916524ee538 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3870515d-a2a2-4653-8ac3-0316b460d755) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3eab6b92-b72f-4c41-9c6d-e98066ba0d8e', 'volume_name': 'volume-3eab6b92-b72f-4c41-9c6d-e98066ba0d8e', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 23:00:11 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-1268d2d4-81de-42f8-89db-b916524ee538 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9ce550e-c418-45aa-a950-0f5db2cd372a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 23:00:11 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-1268d2d4-81de-42f8-89db-b916524ee538 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9ce550e-c418-45aa-a950-0f5db2cd372a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 23:00:11 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-1268d2d4-81de-42f8-89db-b916524ee538 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3ae1c71-7302-4747-bba8-fc0b8474bd95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 23:00:11 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-1268d2d4-81de-42f8-89db-b916524ee538 tempest-ProjectMemberTests-1763329861 None] Volume 3eab6b92-b72f-4c41-9c6d-e98066ba0d8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3eab6b92-b72f-4c41-9c6d-e98066ba0d8e', 'volume_size': 1} Sep 04 23:00:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-1268d2d4-81de-42f8-89db-b916524ee538 tempest-ProjectMemberTests-1763329861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 23:00:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-1268d2d4-81de-42f8-89db-b916524ee538 tempest-ProjectMemberTests-1763329861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 23:00:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-1268d2d4-81de-42f8-89db-b916524ee538 tempest-ProjectMemberTests-1763329861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T21:00:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1519802100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eab6b92-b72f-4c41-9c6d-e98066ba0d8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea67d0db23b2432187cdb39da7ed0530',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T21:00:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T21:00:12Z,use_quota=True,user_id='f2beadaff952455f8e8d8ab5cdc33aa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 23:00:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-1268d2d4-81de-42f8-89db-b916524ee538 tempest-ProjectMemberTests-1763329861 None] Creating volume 3eab6b92-b72f-4c41-9c6d-e98066ba0d8e {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 23:00:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-1268d2d4-81de-42f8-89db-b916524ee538 tempest-ProjectMemberTests-1763329861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 23:00:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-1268d2d4-81de-42f8-89db-b916524ee538 tempest-ProjectMemberTests-1763329861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 23:00:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-1268d2d4-81de-42f8-89db-b916524ee538 tempest-ProjectMemberTests-1763329861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 23:00:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-1268d2d4-81de-42f8-89db-b916524ee538 tempest-ProjectMemberTests-1763329861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 23:00:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-1268d2d4-81de-42f8-89db-b916524ee538 tempest-ProjectMemberTests-1763329861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 23:00:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-1268d2d4-81de-42f8-89db-b916524ee538 tempest-ProjectMemberTests-1763329861 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 23:00:11 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-1268d2d4-81de-42f8-89db-b916524ee538 tempest-ProjectMemberTests-1763329861 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 23:00:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-1268d2d4-81de-42f8-89db-b916524ee538 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-3eab6b92-b72f-4c41-9c6d-e98066ba0d8e 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:11 devstack sudo[108072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-3eab6b92-b72f-4c41-9c6d-e98066ba0d8e 1073741824 Sep 04 23:00:11 devstack sudo[108072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:11 devstack cinder-volume[87576]: DEBUG oslo_service.periodic_task [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87576) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 23:00:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 23:00:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 23:00:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 23:00:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 23:00:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 23:00:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:11 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-133fd4d8-8a72-4738-bae6-7e85bf174367 tempest-ProjectReaderTests-1498489724 None] Acquiring lock "cinder-5a15789c-c5ee-44d1-b33c-f18134af69e1-delete_snapshot" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 23:00:11 devstack sudo[108075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 23:00:11 devstack sudo[108075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:11 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-133fd4d8-8a72-4738-bae6-7e85bf174367 tempest-ProjectReaderTests-1498489724 None] Lock "cinder-5a15789c-c5ee-44d1-b33c-f18134af69e1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 23:00:11 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-133fd4d8-8a72-4738-bae6-7e85bf174367 tempest-ProjectReaderTests-1498489724 None] Acquiring lock "cinder-quobyte-78e526c2-14fb-402d-b5ec-23baf034a271" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 23:00:11 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-133fd4d8-8a72-4738-bae6-7e85bf174367 tempest-ProjectReaderTests-1498489724 None] Lock "cinder-quobyte-78e526c2-14fb-402d-b5ec-23baf034a271" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 23:00:11 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-133fd4d8-8a72-4738-bae6-7e85bf174367 tempest-ProjectReaderTests-1498489724 None] Acquiring lock "cinder-quobyte-5a15789c-c5ee-44d1-b33c-f18134af69e1" by "_delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 23:00:11 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-133fd4d8-8a72-4738-bae6-7e85bf174367 tempest-ProjectReaderTests-1498489724 None] Lock "cinder-quobyte-5a15789c-c5ee-44d1-b33c-f18134af69e1" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 23:00:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-133fd4d8-8a72-4738-bae6-7e85bf174367 tempest-ProjectReaderTests-1498489724 None] Deleting offline snapshot 5a15789c-c5ee-44d1-b33c-f18134af69e1 of volume 78e526c2-14fb-402d-b5ec-23baf034a271 {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 23:00:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-133fd4d8-8a72-4738-bae6-7e85bf174367 tempest-ProjectReaderTests-1498489724 None] snapshot_file for this snap is: volume-78e526c2-14fb-402d-b5ec-23baf034a271.5a15789c-c5ee-44d1-b33c-f18134af69e1 {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 23:00:11 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79e83f0-27b3-4c24-afe0-0de93496b5f4]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 23:00:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-133fd4d8-8a72-4738-bae6-7e85bf174367 tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-78e526c2-14fb-402d-b5ec-23baf034a271.5a15789c-c5ee-44d1-b33c-f18134af69e1 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:12 devstack sudo[108072]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-1268d2d4-81de-42f8-89db-b916524ee538 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-3eab6b92-b72f-4c41-9c6d-e98066ba0d8e 1073741824" returned: 0 in 0.457s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:12 devstack sudo[108079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-78e526c2-14fb-402d-b5ec-23baf034a271.5a15789c-c5ee-44d1-b33c-f18134af69e1 Sep 04 23:00:12 devstack sudo[108079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:12 devstack sudo[108075]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.277s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:12 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 23:00:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-1268d2d4-81de-42f8-89db-b916524ee538 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-3eab6b92-b72f-4c41-9c6d-e98066ba0d8e {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:12 devstack cinder-volume[87576]: DEBUG oslo_service.periodic_task [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Running periodic task VolumeManager._thread_info {{(pid=87576) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 23:00:12 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] thread count: 28 {{(pid=87576) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 23:00:12 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] thread info: [<_MainThread(MainThread, started 125730416963712)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87576) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 23:00:12 devstack sudo[108083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-3eab6b92-b72f-4c41-9c6d-e98066ba0d8e Sep 04 23:00:12 devstack sudo[108083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:12 devstack sudo[108079]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-133fd4d8-8a72-4738-bae6-7e85bf174367 tempest-ProjectReaderTests-1498489724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-78e526c2-14fb-402d-b5ec-23baf034a271.5a15789c-c5ee-44d1-b33c-f18134af69e1" returned: 0 in 0.396s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:12 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-133fd4d8-8a72-4738-bae6-7e85bf174367 tempest-ProjectReaderTests-1498489724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78e526c2-14fb-402d-b5ec-23baf034a271(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 23:00:12 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[786cf593-f396-49fa-9c52-544808056fc9]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 23:00:12 devstack sudo[108083]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-133fd4d8-8a72-4738-bae6-7e85bf174367 tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-78e526c2-14fb-402d-b5ec-23baf034a271 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-1268d2d4-81de-42f8-89db-b916524ee538 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-3eab6b92-b72f-4c41-9c6d-e98066ba0d8e" returned: 0 in 0.268s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:12 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-1268d2d4-81de-42f8-89db-b916524ee538 tempest-ProjectMemberTests-1763329861 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 23:00:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-1268d2d4-81de-42f8-89db-b916524ee538 tempest-ProjectMemberTests-1763329861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 23:00:12 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-1268d2d4-81de-42f8-89db-b916524ee538 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3ae1c71-7302-4747-bba8-fc0b8474bd95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3eab6b92-b72f-4c41-9c6d-e98066ba0d8e', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 23:00:12 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-1268d2d4-81de-42f8-89db-b916524ee538 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07a9d0ba-f69b-48ac-9f19-03efdc2a524c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 23:00:12 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-1268d2d4-81de-42f8-89db-b916524ee538 tempest-ProjectMemberTests-1763329861 None] Volume volume-3eab6b92-b72f-4c41-9c6d-e98066ba0d8e (3eab6b92-b72f-4c41-9c6d-e98066ba0d8e): created successfully Sep 04 23:00:12 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-1268d2d4-81de-42f8-89db-b916524ee538 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07a9d0ba-f69b-48ac-9f19-03efdc2a524c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 23:00:12 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-1268d2d4-81de-42f8-89db-b916524ee538 tempest-ProjectMemberTests-1763329861 None] Flow 'volume_create_manager' (95c383c4-be45-498b-936c-42b390e4397f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 23:00:12 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-1268d2d4-81de-42f8-89db-b916524ee538 tempest-ProjectMemberTests-1763329861 None] Created volume successfully. Sep 04 23:00:12 devstack sudo[108089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-78e526c2-14fb-402d-b5ec-23baf034a271 Sep 04 23:00:12 devstack sudo[108089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:12 devstack sudo[108089]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-133fd4d8-8a72-4738-bae6-7e85bf174367 tempest-ProjectReaderTests-1498489724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-78e526c2-14fb-402d-b5ec-23baf034a271" returned: 0 in 0.367s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-133fd4d8-8a72-4738-bae6-7e85bf174367 tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-78e526c2-14fb-402d-b5ec-23baf034a271.5a15789c-c5ee-44d1-b33c-f18134af69e1 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:12 devstack sudo[108094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-78e526c2-14fb-402d-b5ec-23baf034a271.5a15789c-c5ee-44d1-b33c-f18134af69e1 Sep 04 23:00:12 devstack sudo[108094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:13 devstack sudo[108094]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-133fd4d8-8a72-4738-bae6-7e85bf174367 tempest-ProjectReaderTests-1498489724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-78e526c2-14fb-402d-b5ec-23baf034a271.5a15789c-c5ee-44d1-b33c-f18134af69e1" returned: 0 in 0.325s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-133fd4d8-8a72-4738-bae6-7e85bf174367 tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-78e526c2-14fb-402d-b5ec-23baf034a271.5a15789c-c5ee-44d1-b33c-f18134af69e1 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:13 devstack sudo[108099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-78e526c2-14fb-402d-b5ec-23baf034a271.5a15789c-c5ee-44d1-b33c-f18134af69e1 Sep 04 23:00:13 devstack sudo[108099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:13 devstack sudo[108099]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-133fd4d8-8a72-4738-bae6-7e85bf174367 tempest-ProjectReaderTests-1498489724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-78e526c2-14fb-402d-b5ec-23baf034a271.5a15789c-c5ee-44d1-b33c-f18134af69e1" returned: 0 in 0.239s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:13 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-133fd4d8-8a72-4738-bae6-7e85bf174367 tempest-ProjectReaderTests-1498489724 None] Lock "cinder-quobyte-5a15789c-c5ee-44d1-b33c-f18134af69e1" released by "_delete_snapshot" :: held 1.421s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 23:00:13 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-133fd4d8-8a72-4738-bae6-7e85bf174367 tempest-ProjectReaderTests-1498489724 None] Lock "cinder-quobyte-78e526c2-14fb-402d-b5ec-23baf034a271" released by "delete_snapshot" :: held 1.448s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 23:00:13 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-133fd4d8-8a72-4738-bae6-7e85bf174367 tempest-ProjectReaderTests-1498489724 None] Created reservations ['940505f5-8236-4eed-a9f4-6110a634a3ba', 'd615872b-52c1-4a08-81bf-c3089c1b20a6', '26bd7e8a-b84f-4089-8838-7f80b1cec6a4', 'ac4b8b37-0949-4166-b207-8860578ff1f6'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 23:00:13 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-133fd4d8-8a72-4738-bae6-7e85bf174367 tempest-ProjectReaderTests-1498489724 None] Delete snapshot completed successfully. Sep 04 23:00:13 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-133fd4d8-8a72-4738-bae6-7e85bf174367 tempest-ProjectReaderTests-1498489724 None] Lock "cinder-5a15789c-c5ee-44d1-b33c-f18134af69e1-delete_snapshot" released by "delete_snapshot" :: held 1.600s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 23:00:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f170da64-0179-43c9-b750-51ec5eda40e3 tempest-ProjectMemberTests-1763329861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 23:00:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f170da64-0179-43c9-b750-51ec5eda40e3 tempest-ProjectMemberTests-1763329861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 23:00:13 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-f170da64-0179-43c9-b750-51ec5eda40e3 tempest-ProjectMemberTests-1763329861 None] Creating offline snapshot 99d883e9-a4c8-4621-841d-1a2c43170c46 of volume 3eab6b92-b72f-4c41-9c6d-e98066ba0d8e {{(pid=87576) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 23:00:13 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a3c6d9-8a84-459d-866b-03166efd58f8]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 23:00:13 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f170da64-0179-43c9-b750-51ec5eda40e3 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-3eab6b92-b72f-4c41-9c6d-e98066ba0d8e {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:13 devstack sudo[108103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-3eab6b92-b72f-4c41-9c6d-e98066ba0d8e Sep 04 23:00:13 devstack sudo[108103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:14 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-6e68bbae-d5ea-44b1-b956-371b8d4bfb98 tempest-ProjectReaderTests-1498489724 None] Acquiring lock "cinder-78e526c2-14fb-402d-b5ec-23baf034a271-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 23:00:14 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-6e68bbae-d5ea-44b1-b956-371b8d4bfb98 tempest-ProjectReaderTests-1498489724 None] Lock "cinder-78e526c2-14fb-402d-b5ec-23baf034a271-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 23:00:14 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-6e68bbae-d5ea-44b1-b956-371b8d4bfb98 tempest-ProjectReaderTests-1498489724 None] Acquiring lock "cinder-quobyte-78e526c2-14fb-402d-b5ec-23baf034a271" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 23:00:14 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-6e68bbae-d5ea-44b1-b956-371b8d4bfb98 tempest-ProjectReaderTests-1498489724 None] Lock "cinder-quobyte-78e526c2-14fb-402d-b5ec-23baf034a271" acquired by "delete_volume" :: waited 0.018s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 23:00:14 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[febc7317-8813-4093-8707-fc8d62866f8e]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 23:00:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-6e68bbae-d5ea-44b1-b956-371b8d4bfb98 tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-78e526c2-14fb-402d-b5ec-23baf034a271 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:14 devstack sudo[108103]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f170da64-0179-43c9-b750-51ec5eda40e3 tempest-ProjectMemberTests-1763329861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-3eab6b92-b72f-4c41-9c6d-e98066ba0d8e" returned: 0 in 0.380s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f170da64-0179-43c9-b750-51ec5eda40e3 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-3eab6b92-b72f-4c41-9c6d-e98066ba0d8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-3eab6b92-b72f-4c41-9c6d-e98066ba0d8e.99d883e9-a4c8-4621-841d-1a2c43170c46 1G {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:14 devstack sudo[108109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-3eab6b92-b72f-4c41-9c6d-e98066ba0d8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-3eab6b92-b72f-4c41-9c6d-e98066ba0d8e.99d883e9-a4c8-4621-841d-1a2c43170c46 1G Sep 04 23:00:14 devstack sudo[108109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:14 devstack sudo[108108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-78e526c2-14fb-402d-b5ec-23baf034a271 Sep 04 23:00:14 devstack sudo[108108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:14 devstack sudo[108108]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-6e68bbae-d5ea-44b1-b956-371b8d4bfb98 tempest-ProjectReaderTests-1498489724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-78e526c2-14fb-402d-b5ec-23baf034a271" returned: 0 in 0.369s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-6e68bbae-d5ea-44b1-b956-371b8d4bfb98 tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-78e526c2-14fb-402d-b5ec-23baf034a271 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:14 devstack sudo[108119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-78e526c2-14fb-402d-b5ec-23baf034a271 Sep 04 23:00:14 devstack sudo[108119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:14 devstack sudo[108109]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f170da64-0179-43c9-b750-51ec5eda40e3 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-3eab6b92-b72f-4c41-9c6d-e98066ba0d8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-3eab6b92-b72f-4c41-9c6d-e98066ba0d8e.99d883e9-a4c8-4621-841d-1a2c43170c46 1G" returned: 0 in 0.391s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f170da64-0179-43c9-b750-51ec5eda40e3 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3eab6b92-b72f-4c41-9c6d-e98066ba0d8e -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-3eab6b92-b72f-4c41-9c6d-e98066ba0d8e.99d883e9-a4c8-4621-841d-1a2c43170c46 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:14 devstack sudo[108121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3eab6b92-b72f-4c41-9c6d-e98066ba0d8e -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-3eab6b92-b72f-4c41-9c6d-e98066ba0d8e.99d883e9-a4c8-4621-841d-1a2c43170c46 Sep 04 23:00:14 devstack sudo[108121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:14 devstack sudo[108119]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-6e68bbae-d5ea-44b1-b956-371b8d4bfb98 tempest-ProjectReaderTests-1498489724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-78e526c2-14fb-402d-b5ec-23baf034a271" returned: 0 in 0.271s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:14 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-6e68bbae-d5ea-44b1-b956-371b8d4bfb98 tempest-ProjectReaderTests-1498489724 None] Lock "cinder-quobyte-78e526c2-14fb-402d-b5ec-23baf034a271" released by "delete_volume" :: held 0.698s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 23:00:14 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-6e68bbae-d5ea-44b1-b956-371b8d4bfb98 tempest-ProjectReaderTests-1498489724 None] Created reservations ['a641eb62-ea7b-478b-88d5-200bf1d50291', '4b41a8b2-d310-4e36-80ff-80d784d943b7', 'd3d7010f-955a-4ee5-a832-e5aab958c663', '000adef6-ff90-47bf-aebe-2a9e6bcc9b64'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 23:00:14 devstack sudo[108121]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f170da64-0179-43c9-b750-51ec5eda40e3 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3eab6b92-b72f-4c41-9c6d-e98066ba0d8e -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-3eab6b92-b72f-4c41-9c6d-e98066ba0d8e.99d883e9-a4c8-4621-841d-1a2c43170c46" returned: 0 in 0.305s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:14 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-f170da64-0179-43c9-b750-51ec5eda40e3 tempest-ProjectMemberTests-1763329861 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-3eab6b92-b72f-4c41-9c6d-e98066ba0d8e.99d883e9-a4c8-4621-841d-1a2c43170c46 is being set with open permissions: ugo+rw Sep 04 23:00:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f170da64-0179-43c9-b750-51ec5eda40e3 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-3eab6b92-b72f-4c41-9c6d-e98066ba0d8e.99d883e9-a4c8-4621-841d-1a2c43170c46 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:14 devstack sudo[108127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-3eab6b92-b72f-4c41-9c6d-e98066ba0d8e.99d883e9-a4c8-4621-841d-1a2c43170c46 Sep 04 23:00:14 devstack sudo[108127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-6e68bbae-d5ea-44b1-b956-371b8d4bfb98 tempest-ProjectReaderTests-1498489724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 23:00:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-6e68bbae-d5ea-44b1-b956-371b8d4bfb98 tempest-ProjectReaderTests-1498489724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 23:00:14 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-6e68bbae-d5ea-44b1-b956-371b8d4bfb98 tempest-ProjectReaderTests-1498489724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 23:00:14 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-6e68bbae-d5ea-44b1-b956-371b8d4bfb98 tempest-ProjectReaderTests-1498489724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 23:00:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-6e68bbae-d5ea-44b1-b956-371b8d4bfb98 tempest-ProjectReaderTests-1498489724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 23:00:14 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-6e68bbae-d5ea-44b1-b956-371b8d4bfb98 tempest-ProjectReaderTests-1498489724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:14 devstack sudo[108129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 23:00:14 devstack sudo[108129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:15 devstack sudo[108127]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f170da64-0179-43c9-b750-51ec5eda40e3 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-3eab6b92-b72f-4c41-9c6d-e98066ba0d8e.99d883e9-a4c8-4621-841d-1a2c43170c46" returned: 0 in 0.253s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f170da64-0179-43c9-b750-51ec5eda40e3 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-3eab6b92-b72f-4c41-9c6d-e98066ba0d8e.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:15 devstack sudo[108132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-3eab6b92-b72f-4c41-9c6d-e98066ba0d8e.info Sep 04 23:00:15 devstack sudo[108132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:15 devstack sudo[108129]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-6e68bbae-d5ea-44b1-b956-371b8d4bfb98 tempest-ProjectReaderTests-1498489724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.264s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:15 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-6e68bbae-d5ea-44b1-b956-371b8d4bfb98 tempest-ProjectReaderTests-1498489724 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 23:00:15 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-6e68bbae-d5ea-44b1-b956-371b8d4bfb98 tempest-ProjectReaderTests-1498489724 None] Deleted volume successfully. Sep 04 23:00:15 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-6e68bbae-d5ea-44b1-b956-371b8d4bfb98 tempest-ProjectReaderTests-1498489724 None] Lock "cinder-78e526c2-14fb-402d-b5ec-23baf034a271-delete_volume" released by "delete_volume" :: held 1.195s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 23:00:15 devstack sudo[108132]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f170da64-0179-43c9-b750-51ec5eda40e3 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-3eab6b92-b72f-4c41-9c6d-e98066ba0d8e.info" returned: 0 in 0.277s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:15 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-f170da64-0179-43c9-b750-51ec5eda40e3 tempest-ProjectMemberTests-1763329861 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-3eab6b92-b72f-4c41-9c6d-e98066ba0d8e.info is being set with open permissions: ugo+rw Sep 04 23:00:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f170da64-0179-43c9-b750-51ec5eda40e3 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-3eab6b92-b72f-4c41-9c6d-e98066ba0d8e.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:15 devstack sudo[108136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-3eab6b92-b72f-4c41-9c6d-e98066ba0d8e.info Sep 04 23:00:15 devstack sudo[108136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:15 devstack sudo[108136]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f170da64-0179-43c9-b750-51ec5eda40e3 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-3eab6b92-b72f-4c41-9c6d-e98066ba0d8e.info" returned: 0 in 0.246s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-f170da64-0179-43c9-b750-51ec5eda40e3 tempest-ProjectMemberTests-1763329861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.938s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 23:00:15 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-f170da64-0179-43c9-b750-51ec5eda40e3 tempest-ProjectMemberTests-1763329861 None] Create snapshot completed successfully Sep 04 23:00:15 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-3abcc6b6-26b1-411f-a77e-5371ff3288e1 tempest-ProjectMemberTests-1763329861 None] Acquiring lock "cinder-99d883e9-a4c8-4621-841d-1a2c43170c46-delete_snapshot" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 23:00:15 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-3abcc6b6-26b1-411f-a77e-5371ff3288e1 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-99d883e9-a4c8-4621-841d-1a2c43170c46-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 23:00:15 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-3abcc6b6-26b1-411f-a77e-5371ff3288e1 tempest-ProjectMemberTests-1763329861 None] Acquiring lock "cinder-quobyte-3eab6b92-b72f-4c41-9c6d-e98066ba0d8e" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 23:00:15 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-3abcc6b6-26b1-411f-a77e-5371ff3288e1 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-quobyte-3eab6b92-b72f-4c41-9c6d-e98066ba0d8e" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 23:00:15 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-3abcc6b6-26b1-411f-a77e-5371ff3288e1 tempest-ProjectMemberTests-1763329861 None] Acquiring lock "cinder-quobyte-99d883e9-a4c8-4621-841d-1a2c43170c46" by "_delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 23:00:15 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-3abcc6b6-26b1-411f-a77e-5371ff3288e1 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-quobyte-99d883e9-a4c8-4621-841d-1a2c43170c46" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 23:00:15 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-3abcc6b6-26b1-411f-a77e-5371ff3288e1 tempest-ProjectMemberTests-1763329861 None] Deleting offline snapshot 99d883e9-a4c8-4621-841d-1a2c43170c46 of volume 3eab6b92-b72f-4c41-9c6d-e98066ba0d8e {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 23:00:15 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-3abcc6b6-26b1-411f-a77e-5371ff3288e1 tempest-ProjectMemberTests-1763329861 None] snapshot_file for this snap is: volume-3eab6b92-b72f-4c41-9c6d-e98066ba0d8e.99d883e9-a4c8-4621-841d-1a2c43170c46 {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 23:00:15 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0988ab6-77a2-484b-bbbf-20464409ba79]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 23:00:15 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3abcc6b6-26b1-411f-a77e-5371ff3288e1 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-3eab6b92-b72f-4c41-9c6d-e98066ba0d8e.99d883e9-a4c8-4621-841d-1a2c43170c46 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:16 devstack sudo[108139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-3eab6b92-b72f-4c41-9c6d-e98066ba0d8e.99d883e9-a4c8-4621-841d-1a2c43170c46 Sep 04 23:00:16 devstack sudo[108139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:16 devstack sudo[108139]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:16 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3abcc6b6-26b1-411f-a77e-5371ff3288e1 tempest-ProjectMemberTests-1763329861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-3eab6b92-b72f-4c41-9c6d-e98066ba0d8e.99d883e9-a4c8-4621-841d-1a2c43170c46" returned: 0 in 0.430s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:16 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-3abcc6b6-26b1-411f-a77e-5371ff3288e1 tempest-ProjectMemberTests-1763329861 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3eab6b92-b72f-4c41-9c6d-e98066ba0d8e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 23:00:16 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[362d5387-a05f-4e79-bc5c-e8105e222ead]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 23:00:16 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3abcc6b6-26b1-411f-a77e-5371ff3288e1 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-3eab6b92-b72f-4c41-9c6d-e98066ba0d8e {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:16 devstack sudo[108145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-3eab6b92-b72f-4c41-9c6d-e98066ba0d8e Sep 04 23:00:16 devstack sudo[108145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:16 devstack sudo[108145]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:16 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3abcc6b6-26b1-411f-a77e-5371ff3288e1 tempest-ProjectMemberTests-1763329861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-3eab6b92-b72f-4c41-9c6d-e98066ba0d8e" returned: 0 in 0.423s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:16 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3abcc6b6-26b1-411f-a77e-5371ff3288e1 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-3eab6b92-b72f-4c41-9c6d-e98066ba0d8e.99d883e9-a4c8-4621-841d-1a2c43170c46 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:16 devstack sudo[108150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-3eab6b92-b72f-4c41-9c6d-e98066ba0d8e.99d883e9-a4c8-4621-841d-1a2c43170c46 Sep 04 23:00:16 devstack sudo[108150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:17 devstack sudo[108150]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3abcc6b6-26b1-411f-a77e-5371ff3288e1 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-3eab6b92-b72f-4c41-9c6d-e98066ba0d8e.99d883e9-a4c8-4621-841d-1a2c43170c46" returned: 0 in 0.345s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3abcc6b6-26b1-411f-a77e-5371ff3288e1 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-3eab6b92-b72f-4c41-9c6d-e98066ba0d8e.99d883e9-a4c8-4621-841d-1a2c43170c46 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:17 devstack sudo[108156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-3eab6b92-b72f-4c41-9c6d-e98066ba0d8e.99d883e9-a4c8-4621-841d-1a2c43170c46 Sep 04 23:00:17 devstack sudo[108156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:17 devstack sudo[108156]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:17 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-3abcc6b6-26b1-411f-a77e-5371ff3288e1 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-3eab6b92-b72f-4c41-9c6d-e98066ba0d8e.99d883e9-a4c8-4621-841d-1a2c43170c46" returned: 0 in 0.272s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:17 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-3abcc6b6-26b1-411f-a77e-5371ff3288e1 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-quobyte-99d883e9-a4c8-4621-841d-1a2c43170c46" released by "_delete_snapshot" :: held 1.570s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 23:00:17 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-3abcc6b6-26b1-411f-a77e-5371ff3288e1 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-quobyte-3eab6b92-b72f-4c41-9c6d-e98066ba0d8e" released by "delete_snapshot" :: held 1.597s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 23:00:17 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-3abcc6b6-26b1-411f-a77e-5371ff3288e1 tempest-ProjectMemberTests-1763329861 None] Created reservations ['6bf65149-98c0-44d5-9d1f-c55b2ecb4283', '30344960-25b3-459c-8035-66d30b640877', 'febccdec-129f-4f84-beaf-3a6f49b16bac', '4e0d9df5-616a-4d45-9a05-2408ced5df60'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 23:00:17 devstack cinder-volume[87576]: DEBUG dbcounter [-] [87576] Writing DB stats cinder:SELECT=197,cinder:UPDATE=204,cinder:DELETE=17,cinder:INSERT=61 {{(pid=87576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 23:00:17 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-3abcc6b6-26b1-411f-a77e-5371ff3288e1 tempest-ProjectMemberTests-1763329861 None] Delete snapshot completed successfully. Sep 04 23:00:17 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-3abcc6b6-26b1-411f-a77e-5371ff3288e1 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-99d883e9-a4c8-4621-841d-1a2c43170c46-delete_snapshot" released by "delete_snapshot" :: held 1.756s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 23:00:18 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-65e2f226-bccf-40a3-bfc8-c00b18406473 tempest-ProjectMemberTests-1763329861 None] Acquiring lock "cinder-3eab6b92-b72f-4c41-9c6d-e98066ba0d8e-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 23:00:18 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-65e2f226-bccf-40a3-bfc8-c00b18406473 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-3eab6b92-b72f-4c41-9c6d-e98066ba0d8e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 23:00:18 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-65e2f226-bccf-40a3-bfc8-c00b18406473 tempest-ProjectMemberTests-1763329861 None] Acquiring lock "cinder-quobyte-3eab6b92-b72f-4c41-9c6d-e98066ba0d8e" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 23:00:18 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-65e2f226-bccf-40a3-bfc8-c00b18406473 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-quobyte-3eab6b92-b72f-4c41-9c6d-e98066ba0d8e" acquired by "delete_volume" :: waited 0.015s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 23:00:18 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[91cb3684-86bc-439b-81e1-16e8945fd8e1]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 23:00:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-65e2f226-bccf-40a3-bfc8-c00b18406473 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-3eab6b92-b72f-4c41-9c6d-e98066ba0d8e {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:18 devstack sudo[108159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-3eab6b92-b72f-4c41-9c6d-e98066ba0d8e Sep 04 23:00:18 devstack sudo[108159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:18 devstack sudo[108159]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-65e2f226-bccf-40a3-bfc8-c00b18406473 tempest-ProjectMemberTests-1763329861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-3eab6b92-b72f-4c41-9c6d-e98066ba0d8e" returned: 0 in 0.388s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-65e2f226-bccf-40a3-bfc8-c00b18406473 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-3eab6b92-b72f-4c41-9c6d-e98066ba0d8e {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:18 devstack sudo[108164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-3eab6b92-b72f-4c41-9c6d-e98066ba0d8e Sep 04 23:00:18 devstack sudo[108164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:18 devstack sudo[108164]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-65e2f226-bccf-40a3-bfc8-c00b18406473 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-3eab6b92-b72f-4c41-9c6d-e98066ba0d8e" returned: 0 in 0.262s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:18 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-65e2f226-bccf-40a3-bfc8-c00b18406473 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-quobyte-3eab6b92-b72f-4c41-9c6d-e98066ba0d8e" released by "delete_volume" :: held 0.705s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 23:00:18 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-65e2f226-bccf-40a3-bfc8-c00b18406473 tempest-ProjectMemberTests-1763329861 None] Created reservations ['c8e39bfe-5815-4c79-9136-fe649e906a3e', '9c69d037-afc1-4f12-8df2-64b6e942068e', '57332332-bcde-4174-861f-ca538b2833de', '38dd0f95-12a8-47df-a502-af66f8e91abb'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 23:00:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-65e2f226-bccf-40a3-bfc8-c00b18406473 tempest-ProjectMemberTests-1763329861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 23:00:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-65e2f226-bccf-40a3-bfc8-c00b18406473 tempest-ProjectMemberTests-1763329861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 23:00:18 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-65e2f226-bccf-40a3-bfc8-c00b18406473 tempest-ProjectMemberTests-1763329861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 23:00:18 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-65e2f226-bccf-40a3-bfc8-c00b18406473 tempest-ProjectMemberTests-1763329861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 23:00:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-65e2f226-bccf-40a3-bfc8-c00b18406473 tempest-ProjectMemberTests-1763329861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 23:00:18 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-65e2f226-bccf-40a3-bfc8-c00b18406473 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:18 devstack sudo[108167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 23:00:18 devstack sudo[108167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:19 devstack sudo[108167]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:19 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-65e2f226-bccf-40a3-bfc8-c00b18406473 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.262s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:19 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-65e2f226-bccf-40a3-bfc8-c00b18406473 tempest-ProjectMemberTests-1763329861 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 23:00:19 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-65e2f226-bccf-40a3-bfc8-c00b18406473 tempest-ProjectMemberTests-1763329861 None] Deleted volume successfully. Sep 04 23:00:19 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-65e2f226-bccf-40a3-bfc8-c00b18406473 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-3eab6b92-b72f-4c41-9c6d-e98066ba0d8e-delete_volume" released by "delete_volume" :: held 1.162s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 23:00:19 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3f80e31-71e6-4e85-b3b6-4b37c00142f0 tempest-ProjectMemberTests-1763329861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 23:00:19 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-c3f80e31-71e6-4e85-b3b6-4b37c00142f0 tempest-ProjectMemberTests-1763329861 None] Flow 'volume_create_manager' (dd49b313-8bdc-4290-b76d-9b4e34041336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 23:00:19 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-c3f80e31-71e6-4e85-b3b6-4b37c00142f0 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b4de013-6a88-4f8b-8b09-6c3242cac399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 23:00:19 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-c3f80e31-71e6-4e85-b3b6-4b37c00142f0 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b4de013-6a88-4f8b-8b09-6c3242cac399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T21:00:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1575017100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90a2f10f-4897-4b35-8d71-8ed499472adb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea67d0db23b2432187cdb39da7ed0530',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T21:00:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T21:00:20Z,use_quota=True,user_id='f2beadaff952455f8e8d8ab5cdc33aa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 23:00:19 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-c3f80e31-71e6-4e85-b3b6-4b37c00142f0 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7f9421c-3b3b-4665-8abd-0946f9d18b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 23:00:19 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-c3f80e31-71e6-4e85-b3b6-4b37c00142f0 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7f9421c-3b3b-4665-8abd-0946f9d18b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 23:00:19 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-c3f80e31-71e6-4e85-b3b6-4b37c00142f0 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bc98d12-9784-492e-94cb-69998ed35521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 23:00:19 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-c3f80e31-71e6-4e85-b3b6-4b37c00142f0 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bc98d12-9784-492e-94cb-69998ed35521) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90a2f10f-4897-4b35-8d71-8ed499472adb', 'volume_name': 'volume-90a2f10f-4897-4b35-8d71-8ed499472adb', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 23:00:19 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-c3f80e31-71e6-4e85-b3b6-4b37c00142f0 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e6a2764-67ae-4017-a7ab-baff7d7ea19c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 23:00:19 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-c3f80e31-71e6-4e85-b3b6-4b37c00142f0 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e6a2764-67ae-4017-a7ab-baff7d7ea19c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 23:00:19 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-c3f80e31-71e6-4e85-b3b6-4b37c00142f0 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baa52435-3a94-475f-9bb4-5aec082f9e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 23:00:19 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-c3f80e31-71e6-4e85-b3b6-4b37c00142f0 tempest-ProjectMemberTests-1763329861 None] Volume 90a2f10f-4897-4b35-8d71-8ed499472adb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90a2f10f-4897-4b35-8d71-8ed499472adb', 'volume_size': 1} Sep 04 23:00:19 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-c3f80e31-71e6-4e85-b3b6-4b37c00142f0 tempest-ProjectMemberTests-1763329861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 23:00:19 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-c3f80e31-71e6-4e85-b3b6-4b37c00142f0 tempest-ProjectMemberTests-1763329861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 23:00:19 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-c3f80e31-71e6-4e85-b3b6-4b37c00142f0 tempest-ProjectMemberTests-1763329861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T21:00:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1575017100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90a2f10f-4897-4b35-8d71-8ed499472adb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea67d0db23b2432187cdb39da7ed0530',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T21:00:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T21:00:20Z,use_quota=True,user_id='f2beadaff952455f8e8d8ab5cdc33aa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 23:00:19 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-c3f80e31-71e6-4e85-b3b6-4b37c00142f0 tempest-ProjectMemberTests-1763329861 None] Creating volume 90a2f10f-4897-4b35-8d71-8ed499472adb {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 23:00:19 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-c3f80e31-71e6-4e85-b3b6-4b37c00142f0 tempest-ProjectMemberTests-1763329861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 23:00:19 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-c3f80e31-71e6-4e85-b3b6-4b37c00142f0 tempest-ProjectMemberTests-1763329861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 23:00:19 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-c3f80e31-71e6-4e85-b3b6-4b37c00142f0 tempest-ProjectMemberTests-1763329861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 23:00:19 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-c3f80e31-71e6-4e85-b3b6-4b37c00142f0 tempest-ProjectMemberTests-1763329861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 23:00:19 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-c3f80e31-71e6-4e85-b3b6-4b37c00142f0 tempest-ProjectMemberTests-1763329861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 23:00:19 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-c3f80e31-71e6-4e85-b3b6-4b37c00142f0 tempest-ProjectMemberTests-1763329861 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 23:00:19 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-c3f80e31-71e6-4e85-b3b6-4b37c00142f0 tempest-ProjectMemberTests-1763329861 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 23:00:19 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c3f80e31-71e6-4e85-b3b6-4b37c00142f0 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-90a2f10f-4897-4b35-8d71-8ed499472adb 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:19 devstack sudo[108170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-90a2f10f-4897-4b35-8d71-8ed499472adb 1073741824 Sep 04 23:00:19 devstack sudo[108170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:20 devstack sudo[108170]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c3f80e31-71e6-4e85-b3b6-4b37c00142f0 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-90a2f10f-4897-4b35-8d71-8ed499472adb 1073741824" returned: 0 in 0.484s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c3f80e31-71e6-4e85-b3b6-4b37c00142f0 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-90a2f10f-4897-4b35-8d71-8ed499472adb {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:20 devstack sudo[108176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-90a2f10f-4897-4b35-8d71-8ed499472adb Sep 04 23:00:20 devstack sudo[108176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:20 devstack sudo[108176]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-c3f80e31-71e6-4e85-b3b6-4b37c00142f0 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-90a2f10f-4897-4b35-8d71-8ed499472adb" returned: 0 in 0.255s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:20 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-c3f80e31-71e6-4e85-b3b6-4b37c00142f0 tempest-ProjectMemberTests-1763329861 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 23:00:20 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-c3f80e31-71e6-4e85-b3b6-4b37c00142f0 tempest-ProjectMemberTests-1763329861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 23:00:20 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-c3f80e31-71e6-4e85-b3b6-4b37c00142f0 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baa52435-3a94-475f-9bb4-5aec082f9e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90a2f10f-4897-4b35-8d71-8ed499472adb', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 23:00:20 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-c3f80e31-71e6-4e85-b3b6-4b37c00142f0 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46f3de18-c413-4264-b4d6-a63aa35c9e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 23:00:20 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-c3f80e31-71e6-4e85-b3b6-4b37c00142f0 tempest-ProjectMemberTests-1763329861 None] Volume volume-90a2f10f-4897-4b35-8d71-8ed499472adb (90a2f10f-4897-4b35-8d71-8ed499472adb): created successfully Sep 04 23:00:20 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-c3f80e31-71e6-4e85-b3b6-4b37c00142f0 tempest-ProjectMemberTests-1763329861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46f3de18-c413-4264-b4d6-a63aa35c9e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 23:00:20 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-c3f80e31-71e6-4e85-b3b6-4b37c00142f0 tempest-ProjectMemberTests-1763329861 None] Flow 'volume_create_manager' (dd49b313-8bdc-4290-b76d-9b4e34041336) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 23:00:20 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-c3f80e31-71e6-4e85-b3b6-4b37c00142f0 tempest-ProjectMemberTests-1763329861 None] Created volume successfully. Sep 04 23:00:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-5816f393-62ba-434c-be9a-aaf84a060977 tempest-ProjectMemberTests-1763329861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 23:00:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-5816f393-62ba-434c-be9a-aaf84a060977 tempest-ProjectMemberTests-1763329861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 23:00:21 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-5816f393-62ba-434c-be9a-aaf84a060977 tempest-ProjectMemberTests-1763329861 None] Creating offline snapshot 674e30b1-52ba-4c89-b709-ba30093d7a6f of volume 90a2f10f-4897-4b35-8d71-8ed499472adb {{(pid=87576) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 23:00:21 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[103ba65c-d75f-4a6d-8194-63c095d63481]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 23:00:21 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5816f393-62ba-434c-be9a-aaf84a060977 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-90a2f10f-4897-4b35-8d71-8ed499472adb {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:22 devstack sudo[108179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-90a2f10f-4897-4b35-8d71-8ed499472adb Sep 04 23:00:22 devstack sudo[108179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:22 devstack sudo[108179]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5816f393-62ba-434c-be9a-aaf84a060977 tempest-ProjectMemberTests-1763329861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-90a2f10f-4897-4b35-8d71-8ed499472adb" returned: 0 in 0.358s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5816f393-62ba-434c-be9a-aaf84a060977 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-90a2f10f-4897-4b35-8d71-8ed499472adb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-90a2f10f-4897-4b35-8d71-8ed499472adb.674e30b1-52ba-4c89-b709-ba30093d7a6f 1G {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:22 devstack sudo[108184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-90a2f10f-4897-4b35-8d71-8ed499472adb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-90a2f10f-4897-4b35-8d71-8ed499472adb.674e30b1-52ba-4c89-b709-ba30093d7a6f 1G Sep 04 23:00:22 devstack sudo[108184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:22 devstack sudo[108184]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5816f393-62ba-434c-be9a-aaf84a060977 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-90a2f10f-4897-4b35-8d71-8ed499472adb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-90a2f10f-4897-4b35-8d71-8ed499472adb.674e30b1-52ba-4c89-b709-ba30093d7a6f 1G" returned: 0 in 0.388s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:22 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5816f393-62ba-434c-be9a-aaf84a060977 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90a2f10f-4897-4b35-8d71-8ed499472adb -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-90a2f10f-4897-4b35-8d71-8ed499472adb.674e30b1-52ba-4c89-b709-ba30093d7a6f {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:22 devstack sudo[108189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90a2f10f-4897-4b35-8d71-8ed499472adb -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-90a2f10f-4897-4b35-8d71-8ed499472adb.674e30b1-52ba-4c89-b709-ba30093d7a6f Sep 04 23:00:22 devstack sudo[108189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:23 devstack sudo[108189]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5816f393-62ba-434c-be9a-aaf84a060977 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90a2f10f-4897-4b35-8d71-8ed499472adb -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-90a2f10f-4897-4b35-8d71-8ed499472adb.674e30b1-52ba-4c89-b709-ba30093d7a6f" returned: 0 in 0.284s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:23 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-5816f393-62ba-434c-be9a-aaf84a060977 tempest-ProjectMemberTests-1763329861 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-90a2f10f-4897-4b35-8d71-8ed499472adb.674e30b1-52ba-4c89-b709-ba30093d7a6f is being set with open permissions: ugo+rw Sep 04 23:00:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5816f393-62ba-434c-be9a-aaf84a060977 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-90a2f10f-4897-4b35-8d71-8ed499472adb.674e30b1-52ba-4c89-b709-ba30093d7a6f {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:23 devstack sudo[108194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-90a2f10f-4897-4b35-8d71-8ed499472adb.674e30b1-52ba-4c89-b709-ba30093d7a6f Sep 04 23:00:23 devstack sudo[108194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:23 devstack sudo[108194]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5816f393-62ba-434c-be9a-aaf84a060977 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-90a2f10f-4897-4b35-8d71-8ed499472adb.674e30b1-52ba-4c89-b709-ba30093d7a6f" returned: 0 in 0.246s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5816f393-62ba-434c-be9a-aaf84a060977 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-90a2f10f-4897-4b35-8d71-8ed499472adb.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:23 devstack sudo[108198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-90a2f10f-4897-4b35-8d71-8ed499472adb.info Sep 04 23:00:23 devstack sudo[108198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:23 devstack sudo[108198]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5816f393-62ba-434c-be9a-aaf84a060977 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-90a2f10f-4897-4b35-8d71-8ed499472adb.info" returned: 0 in 0.248s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:23 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-5816f393-62ba-434c-be9a-aaf84a060977 tempest-ProjectMemberTests-1763329861 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-90a2f10f-4897-4b35-8d71-8ed499472adb.info is being set with open permissions: ugo+rw Sep 04 23:00:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5816f393-62ba-434c-be9a-aaf84a060977 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-90a2f10f-4897-4b35-8d71-8ed499472adb.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:23 devstack sudo[108201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-90a2f10f-4897-4b35-8d71-8ed499472adb.info Sep 04 23:00:23 devstack sudo[108201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:23 devstack sudo[108201]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-5816f393-62ba-434c-be9a-aaf84a060977 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-90a2f10f-4897-4b35-8d71-8ed499472adb.info" returned: 0 in 0.236s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:23 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-5816f393-62ba-434c-be9a-aaf84a060977 tempest-ProjectMemberTests-1763329861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.843s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 23:00:23 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-5816f393-62ba-434c-be9a-aaf84a060977 tempest-ProjectMemberTests-1763329861 None] Create snapshot completed successfully Sep 04 23:00:24 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-b6f10a7c-d360-470d-b172-0e8b216771a4 tempest-ProjectMemberTests-1763329861 None] Acquiring lock "cinder-674e30b1-52ba-4c89-b709-ba30093d7a6f-delete_snapshot" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 23:00:24 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-b6f10a7c-d360-470d-b172-0e8b216771a4 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-674e30b1-52ba-4c89-b709-ba30093d7a6f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 23:00:24 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-b6f10a7c-d360-470d-b172-0e8b216771a4 tempest-ProjectMemberTests-1763329861 None] Acquiring lock "cinder-quobyte-90a2f10f-4897-4b35-8d71-8ed499472adb" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 23:00:24 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-b6f10a7c-d360-470d-b172-0e8b216771a4 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-quobyte-90a2f10f-4897-4b35-8d71-8ed499472adb" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 23:00:24 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-b6f10a7c-d360-470d-b172-0e8b216771a4 tempest-ProjectMemberTests-1763329861 None] Acquiring lock "cinder-quobyte-674e30b1-52ba-4c89-b709-ba30093d7a6f" by "_delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 23:00:24 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-b6f10a7c-d360-470d-b172-0e8b216771a4 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-quobyte-674e30b1-52ba-4c89-b709-ba30093d7a6f" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 23:00:24 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-b6f10a7c-d360-470d-b172-0e8b216771a4 tempest-ProjectMemberTests-1763329861 None] Deleting offline snapshot 674e30b1-52ba-4c89-b709-ba30093d7a6f of volume 90a2f10f-4897-4b35-8d71-8ed499472adb {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 23:00:24 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-b6f10a7c-d360-470d-b172-0e8b216771a4 tempest-ProjectMemberTests-1763329861 None] snapshot_file for this snap is: volume-90a2f10f-4897-4b35-8d71-8ed499472adb.674e30b1-52ba-4c89-b709-ba30093d7a6f {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 23:00:24 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f931341-5347-4728-87f6-de06efdfb675]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 23:00:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b6f10a7c-d360-470d-b172-0e8b216771a4 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-90a2f10f-4897-4b35-8d71-8ed499472adb.674e30b1-52ba-4c89-b709-ba30093d7a6f {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:24 devstack sudo[108204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-90a2f10f-4897-4b35-8d71-8ed499472adb.674e30b1-52ba-4c89-b709-ba30093d7a6f Sep 04 23:00:24 devstack sudo[108204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:24 devstack sudo[108204]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b6f10a7c-d360-470d-b172-0e8b216771a4 tempest-ProjectMemberTests-1763329861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-90a2f10f-4897-4b35-8d71-8ed499472adb.674e30b1-52ba-4c89-b709-ba30093d7a6f" returned: 0 in 0.405s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:24 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-b6f10a7c-d360-470d-b172-0e8b216771a4 tempest-ProjectMemberTests-1763329861 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-90a2f10f-4897-4b35-8d71-8ed499472adb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 23:00:24 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[27293679-1f7d-4244-8641-9b5d06a5d2ec]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 23:00:24 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b6f10a7c-d360-470d-b172-0e8b216771a4 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-90a2f10f-4897-4b35-8d71-8ed499472adb {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:24 devstack sudo[108209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-90a2f10f-4897-4b35-8d71-8ed499472adb Sep 04 23:00:24 devstack sudo[108209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:25 devstack sudo[108209]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b6f10a7c-d360-470d-b172-0e8b216771a4 tempest-ProjectMemberTests-1763329861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-90a2f10f-4897-4b35-8d71-8ed499472adb" returned: 0 in 0.359s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b6f10a7c-d360-470d-b172-0e8b216771a4 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-90a2f10f-4897-4b35-8d71-8ed499472adb.674e30b1-52ba-4c89-b709-ba30093d7a6f {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:25 devstack sudo[108214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-90a2f10f-4897-4b35-8d71-8ed499472adb.674e30b1-52ba-4c89-b709-ba30093d7a6f Sep 04 23:00:25 devstack sudo[108214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:25 devstack sudo[108214]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b6f10a7c-d360-470d-b172-0e8b216771a4 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-90a2f10f-4897-4b35-8d71-8ed499472adb.674e30b1-52ba-4c89-b709-ba30093d7a6f" returned: 0 in 0.346s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b6f10a7c-d360-470d-b172-0e8b216771a4 tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-90a2f10f-4897-4b35-8d71-8ed499472adb.674e30b1-52ba-4c89-b709-ba30093d7a6f {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:25 devstack sudo[108220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-90a2f10f-4897-4b35-8d71-8ed499472adb.674e30b1-52ba-4c89-b709-ba30093d7a6f Sep 04 23:00:25 devstack sudo[108220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:25 devstack sudo[108220]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:25 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-b6f10a7c-d360-470d-b172-0e8b216771a4 tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-90a2f10f-4897-4b35-8d71-8ed499472adb.674e30b1-52ba-4c89-b709-ba30093d7a6f" returned: 0 in 0.257s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:25 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-b6f10a7c-d360-470d-b172-0e8b216771a4 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-quobyte-674e30b1-52ba-4c89-b709-ba30093d7a6f" released by "_delete_snapshot" :: held 1.479s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 23:00:25 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-b6f10a7c-d360-470d-b172-0e8b216771a4 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-quobyte-90a2f10f-4897-4b35-8d71-8ed499472adb" released by "delete_snapshot" :: held 1.509s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 23:00:25 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-b6f10a7c-d360-470d-b172-0e8b216771a4 tempest-ProjectMemberTests-1763329861 None] Created reservations ['95605df8-5e11-4114-92ae-675f5a0d0e30', 'f325d94c-437f-4d6f-adb0-4396d54b5e6f', '83e47e2e-a528-4c69-bae1-c22781ae2917', 'c4868c8f-7dda-418b-905b-7524b650a8a7'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 23:00:25 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-b6f10a7c-d360-470d-b172-0e8b216771a4 tempest-ProjectMemberTests-1763329861 None] Delete snapshot completed successfully. Sep 04 23:00:25 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-b6f10a7c-d360-470d-b172-0e8b216771a4 tempest-ProjectMemberTests-1763329861 None] Lock "cinder-674e30b1-52ba-4c89-b709-ba30093d7a6f-delete_snapshot" released by "delete_snapshot" :: held 1.654s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 23:00:26 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-1192acfc-a1dc-4c9f-8ed3-d79d585aecbd tempest-ProjectMemberTests-1763329861 None] Acquiring lock "cinder-90a2f10f-4897-4b35-8d71-8ed499472adb-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 23:00:26 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-1192acfc-a1dc-4c9f-8ed3-d79d585aecbd tempest-ProjectMemberTests-1763329861 None] Lock "cinder-90a2f10f-4897-4b35-8d71-8ed499472adb-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 23:00:26 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-1192acfc-a1dc-4c9f-8ed3-d79d585aecbd tempest-ProjectMemberTests-1763329861 None] Acquiring lock "cinder-quobyte-90a2f10f-4897-4b35-8d71-8ed499472adb" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 23:00:26 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-1192acfc-a1dc-4c9f-8ed3-d79d585aecbd tempest-ProjectMemberTests-1763329861 None] Lock "cinder-quobyte-90a2f10f-4897-4b35-8d71-8ed499472adb" acquired by "delete_volume" :: waited 0.015s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 23:00:26 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[1690e20d-7f0d-49ed-9ccc-0e36064fb208]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 23:00:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-1192acfc-a1dc-4c9f-8ed3-d79d585aecbd tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-90a2f10f-4897-4b35-8d71-8ed499472adb {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:26 devstack sudo[108223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-90a2f10f-4897-4b35-8d71-8ed499472adb Sep 04 23:00:26 devstack sudo[108223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:26 devstack sudo[108223]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-1192acfc-a1dc-4c9f-8ed3-d79d585aecbd tempest-ProjectMemberTests-1763329861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-90a2f10f-4897-4b35-8d71-8ed499472adb" returned: 0 in 0.396s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:26 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-1192acfc-a1dc-4c9f-8ed3-d79d585aecbd tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-90a2f10f-4897-4b35-8d71-8ed499472adb {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:26 devstack sudo[108228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-90a2f10f-4897-4b35-8d71-8ed499472adb Sep 04 23:00:26 devstack sudo[108228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:27 devstack sudo[108228]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:27 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-1192acfc-a1dc-4c9f-8ed3-d79d585aecbd tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-90a2f10f-4897-4b35-8d71-8ed499472adb" returned: 0 in 0.241s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:27 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-1192acfc-a1dc-4c9f-8ed3-d79d585aecbd tempest-ProjectMemberTests-1763329861 None] Lock "cinder-quobyte-90a2f10f-4897-4b35-8d71-8ed499472adb" released by "delete_volume" :: held 0.694s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 23:00:27 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-1192acfc-a1dc-4c9f-8ed3-d79d585aecbd tempest-ProjectMemberTests-1763329861 None] Created reservations ['7b26821e-b7a7-43b1-8beb-2b7c5e38d610', '694e58a2-5415-49bc-93f2-09a57a9f2c41', '1aeacaab-64ce-4acb-81d8-b867ee09d799', 'f7b61866-f5e4-4ccb-8793-ca9766729e00'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 23:00:27 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-1192acfc-a1dc-4c9f-8ed3-d79d585aecbd tempest-ProjectMemberTests-1763329861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 23:00:27 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-1192acfc-a1dc-4c9f-8ed3-d79d585aecbd tempest-ProjectMemberTests-1763329861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 23:00:27 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-1192acfc-a1dc-4c9f-8ed3-d79d585aecbd tempest-ProjectMemberTests-1763329861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 23:00:27 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-1192acfc-a1dc-4c9f-8ed3-d79d585aecbd tempest-ProjectMemberTests-1763329861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 23:00:27 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-1192acfc-a1dc-4c9f-8ed3-d79d585aecbd tempest-ProjectMemberTests-1763329861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 23:00:27 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-1192acfc-a1dc-4c9f-8ed3-d79d585aecbd tempest-ProjectMemberTests-1763329861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:27 devstack sudo[108231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 23:00:27 devstack sudo[108231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:27 devstack sudo[108231]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:27 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-1192acfc-a1dc-4c9f-8ed3-d79d585aecbd tempest-ProjectMemberTests-1763329861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.249s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:27 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-1192acfc-a1dc-4c9f-8ed3-d79d585aecbd tempest-ProjectMemberTests-1763329861 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 23:00:27 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-1192acfc-a1dc-4c9f-8ed3-d79d585aecbd tempest-ProjectMemberTests-1763329861 None] Deleted volume successfully. Sep 04 23:00:27 devstack cinder-volume[87576]: DEBUG dbcounter [-] [87576] Writing DB stats cinder:INSERT=67,cinder:UPDATE=240,cinder:DELETE=21,cinder:SELECT=155 {{(pid=87576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 23:00:27 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-1192acfc-a1dc-4c9f-8ed3-d79d585aecbd tempest-ProjectMemberTests-1763329861 None] Lock "cinder-90a2f10f-4897-4b35-8d71-8ed499472adb-delete_volume" released by "delete_volume" :: held 1.155s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 23:00:31 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a0b0f65-e795-45fb-9a89-c2a5042f7f7e tempest-ProjectReaderTests-227575279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 23:00:31 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-7a0b0f65-e795-45fb-9a89-c2a5042f7f7e tempest-ProjectReaderTests-227575279 None] Flow 'volume_create_manager' (18216c5b-bca2-43f2-a921-ef6f81f1626e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 23:00:31 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-7a0b0f65-e795-45fb-9a89-c2a5042f7f7e tempest-ProjectReaderTests-227575279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92aca4bc-09bc-4651-a0a9-6e8edfd4ef24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 23:00:31 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-7a0b0f65-e795-45fb-9a89-c2a5042f7f7e tempest-ProjectReaderTests-227575279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92aca4bc-09bc-4651-a0a9-6e8edfd4ef24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T21:00:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2076401465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37fc7b05-be62-4f15-9300-19f7cdd54ca6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='667877222c914b398c6cf970dd1276e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T21:00:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T21:00:31Z,use_quota=True,user_id='f8506a79937b4ae6ad4071b24c91a258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 23:00:31 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-7a0b0f65-e795-45fb-9a89-c2a5042f7f7e tempest-ProjectReaderTests-227575279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a1a1288-3840-4f75-8190-c37f316339bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 23:00:31 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-7a0b0f65-e795-45fb-9a89-c2a5042f7f7e tempest-ProjectReaderTests-227575279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a1a1288-3840-4f75-8190-c37f316339bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 23:00:31 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-7a0b0f65-e795-45fb-9a89-c2a5042f7f7e tempest-ProjectReaderTests-227575279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b86751a-d803-45db-a309-b8f6886af9e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 23:00:31 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-7a0b0f65-e795-45fb-9a89-c2a5042f7f7e tempest-ProjectReaderTests-227575279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b86751a-d803-45db-a309-b8f6886af9e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37fc7b05-be62-4f15-9300-19f7cdd54ca6', 'volume_name': 'volume-37fc7b05-be62-4f15-9300-19f7cdd54ca6', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 23:00:31 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-7a0b0f65-e795-45fb-9a89-c2a5042f7f7e tempest-ProjectReaderTests-227575279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18b82b52-f204-4423-b4d7-2341951d055d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 23:00:31 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-7a0b0f65-e795-45fb-9a89-c2a5042f7f7e tempest-ProjectReaderTests-227575279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18b82b52-f204-4423-b4d7-2341951d055d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 23:00:31 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-7a0b0f65-e795-45fb-9a89-c2a5042f7f7e tempest-ProjectReaderTests-227575279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b758e819-bd29-4b13-a73b-86c1e4dc5a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 23:00:31 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-7a0b0f65-e795-45fb-9a89-c2a5042f7f7e tempest-ProjectReaderTests-227575279 None] Volume 37fc7b05-be62-4f15-9300-19f7cdd54ca6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37fc7b05-be62-4f15-9300-19f7cdd54ca6', 'volume_size': 1} Sep 04 23:00:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-7a0b0f65-e795-45fb-9a89-c2a5042f7f7e tempest-ProjectReaderTests-227575279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 23:00:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-7a0b0f65-e795-45fb-9a89-c2a5042f7f7e tempest-ProjectReaderTests-227575279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 23:00:31 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-7a0b0f65-e795-45fb-9a89-c2a5042f7f7e tempest-ProjectReaderTests-227575279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T21:00:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2076401465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37fc7b05-be62-4f15-9300-19f7cdd54ca6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='667877222c914b398c6cf970dd1276e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T21:00:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T21:00:31Z,use_quota=True,user_id='f8506a79937b4ae6ad4071b24c91a258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 23:00:31 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-7a0b0f65-e795-45fb-9a89-c2a5042f7f7e tempest-ProjectReaderTests-227575279 None] Creating volume 37fc7b05-be62-4f15-9300-19f7cdd54ca6 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 23:00:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-7a0b0f65-e795-45fb-9a89-c2a5042f7f7e tempest-ProjectReaderTests-227575279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 23:00:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-7a0b0f65-e795-45fb-9a89-c2a5042f7f7e tempest-ProjectReaderTests-227575279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 23:00:31 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-7a0b0f65-e795-45fb-9a89-c2a5042f7f7e tempest-ProjectReaderTests-227575279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 23:00:31 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-7a0b0f65-e795-45fb-9a89-c2a5042f7f7e tempest-ProjectReaderTests-227575279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 23:00:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-7a0b0f65-e795-45fb-9a89-c2a5042f7f7e tempest-ProjectReaderTests-227575279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 23:00:31 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-7a0b0f65-e795-45fb-9a89-c2a5042f7f7e tempest-ProjectReaderTests-227575279 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 23:00:31 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-7a0b0f65-e795-45fb-9a89-c2a5042f7f7e tempest-ProjectReaderTests-227575279 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 23:00:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-7a0b0f65-e795-45fb-9a89-c2a5042f7f7e tempest-ProjectReaderTests-227575279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-37fc7b05-be62-4f15-9300-19f7cdd54ca6 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:31 devstack sudo[108234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-37fc7b05-be62-4f15-9300-19f7cdd54ca6 1073741824 Sep 04 23:00:31 devstack sudo[108234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:31 devstack sudo[108234]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-7a0b0f65-e795-45fb-9a89-c2a5042f7f7e tempest-ProjectReaderTests-227575279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-37fc7b05-be62-4f15-9300-19f7cdd54ca6 1073741824" returned: 0 in 0.408s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:31 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-7a0b0f65-e795-45fb-9a89-c2a5042f7f7e tempest-ProjectReaderTests-227575279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-37fc7b05-be62-4f15-9300-19f7cdd54ca6 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:31 devstack sudo[108240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-37fc7b05-be62-4f15-9300-19f7cdd54ca6 Sep 04 23:00:31 devstack sudo[108240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:32 devstack sudo[108240]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:32 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-7a0b0f65-e795-45fb-9a89-c2a5042f7f7e tempest-ProjectReaderTests-227575279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-37fc7b05-be62-4f15-9300-19f7cdd54ca6" returned: 0 in 0.257s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:32 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-7a0b0f65-e795-45fb-9a89-c2a5042f7f7e tempest-ProjectReaderTests-227575279 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 23:00:32 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-7a0b0f65-e795-45fb-9a89-c2a5042f7f7e tempest-ProjectReaderTests-227575279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 23:00:32 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-7a0b0f65-e795-45fb-9a89-c2a5042f7f7e tempest-ProjectReaderTests-227575279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b758e819-bd29-4b13-a73b-86c1e4dc5a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37fc7b05-be62-4f15-9300-19f7cdd54ca6', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 23:00:32 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-7a0b0f65-e795-45fb-9a89-c2a5042f7f7e tempest-ProjectReaderTests-227575279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1006fa1a-a740-4a8f-8bbc-8dfea1b39ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 23:00:32 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-7a0b0f65-e795-45fb-9a89-c2a5042f7f7e tempest-ProjectReaderTests-227575279 None] Volume volume-37fc7b05-be62-4f15-9300-19f7cdd54ca6 (37fc7b05-be62-4f15-9300-19f7cdd54ca6): created successfully Sep 04 23:00:32 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-7a0b0f65-e795-45fb-9a89-c2a5042f7f7e tempest-ProjectReaderTests-227575279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1006fa1a-a740-4a8f-8bbc-8dfea1b39ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 23:00:32 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-7a0b0f65-e795-45fb-9a89-c2a5042f7f7e tempest-ProjectReaderTests-227575279 None] Flow 'volume_create_manager' (18216c5b-bca2-43f2-a921-ef6f81f1626e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 23:00:32 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-7a0b0f65-e795-45fb-9a89-c2a5042f7f7e tempest-ProjectReaderTests-227575279 None] Created volume successfully. Sep 04 23:00:32 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-00bde3d9-c1de-4dbc-8f75-9ae18f55e6fa tempest-ProjectReaderTests-227575279 None] Acquiring lock "cinder-37fc7b05-be62-4f15-9300-19f7cdd54ca6-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 23:00:32 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-00bde3d9-c1de-4dbc-8f75-9ae18f55e6fa tempest-ProjectReaderTests-227575279 None] Lock "cinder-37fc7b05-be62-4f15-9300-19f7cdd54ca6-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 23:00:32 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-00bde3d9-c1de-4dbc-8f75-9ae18f55e6fa tempest-ProjectReaderTests-227575279 None] Acquiring lock "cinder-quobyte-37fc7b05-be62-4f15-9300-19f7cdd54ca6" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 23:00:32 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-00bde3d9-c1de-4dbc-8f75-9ae18f55e6fa tempest-ProjectReaderTests-227575279 None] Lock "cinder-quobyte-37fc7b05-be62-4f15-9300-19f7cdd54ca6" acquired by "delete_volume" :: waited 0.014s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 23:00:32 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c507d27-bc19-4041-a2ce-a676ae11424d]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 23:00:32 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-00bde3d9-c1de-4dbc-8f75-9ae18f55e6fa tempest-ProjectReaderTests-227575279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-37fc7b05-be62-4f15-9300-19f7cdd54ca6 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:32 devstack sudo[108243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-37fc7b05-be62-4f15-9300-19f7cdd54ca6 Sep 04 23:00:32 devstack sudo[108243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:32 devstack sudo[108243]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:32 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-00bde3d9-c1de-4dbc-8f75-9ae18f55e6fa tempest-ProjectReaderTests-227575279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-37fc7b05-be62-4f15-9300-19f7cdd54ca6" returned: 0 in 0.373s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:32 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-00bde3d9-c1de-4dbc-8f75-9ae18f55e6fa tempest-ProjectReaderTests-227575279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-37fc7b05-be62-4f15-9300-19f7cdd54ca6 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:32 devstack sudo[108248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-37fc7b05-be62-4f15-9300-19f7cdd54ca6 Sep 04 23:00:32 devstack sudo[108248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:33 devstack sudo[108248]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-00bde3d9-c1de-4dbc-8f75-9ae18f55e6fa tempest-ProjectReaderTests-227575279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-37fc7b05-be62-4f15-9300-19f7cdd54ca6" returned: 0 in 0.284s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:33 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-00bde3d9-c1de-4dbc-8f75-9ae18f55e6fa tempest-ProjectReaderTests-227575279 None] Lock "cinder-quobyte-37fc7b05-be62-4f15-9300-19f7cdd54ca6" released by "delete_volume" :: held 0.699s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 23:00:33 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-00bde3d9-c1de-4dbc-8f75-9ae18f55e6fa tempest-ProjectReaderTests-227575279 None] Created reservations ['b568f366-2e51-4386-bb2e-f383d1fb7bff', 'b6d297ea-4509-47ef-8f8a-bb93ab941538', '44631c71-4a88-45ac-876c-b25d3f510d35', 'c103ff9c-2763-4e5e-92fe-7c3429eb8078'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 23:00:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-00bde3d9-c1de-4dbc-8f75-9ae18f55e6fa tempest-ProjectReaderTests-227575279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 23:00:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-00bde3d9-c1de-4dbc-8f75-9ae18f55e6fa tempest-ProjectReaderTests-227575279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 23:00:33 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-00bde3d9-c1de-4dbc-8f75-9ae18f55e6fa tempest-ProjectReaderTests-227575279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 23:00:33 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-00bde3d9-c1de-4dbc-8f75-9ae18f55e6fa tempest-ProjectReaderTests-227575279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 23:00:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-00bde3d9-c1de-4dbc-8f75-9ae18f55e6fa tempest-ProjectReaderTests-227575279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 23:00:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-00bde3d9-c1de-4dbc-8f75-9ae18f55e6fa tempest-ProjectReaderTests-227575279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:33 devstack sudo[108252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 23:00:33 devstack sudo[108252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:33 devstack sudo[108252]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:33 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-00bde3d9-c1de-4dbc-8f75-9ae18f55e6fa tempest-ProjectReaderTests-227575279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.250s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:33 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-00bde3d9-c1de-4dbc-8f75-9ae18f55e6fa tempest-ProjectReaderTests-227575279 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 23:00:33 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-00bde3d9-c1de-4dbc-8f75-9ae18f55e6fa tempest-ProjectReaderTests-227575279 None] Deleted volume successfully. Sep 04 23:00:33 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-00bde3d9-c1de-4dbc-8f75-9ae18f55e6fa tempest-ProjectReaderTests-227575279 None] Lock "cinder-37fc7b05-be62-4f15-9300-19f7cdd54ca6-delete_volume" released by "delete_volume" :: held 1.180s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 23:00:34 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-820f6024-b419-4e54-b015-6df9e65e43ed tempest-ProjectReaderTests-227575279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 23:00:34 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-820f6024-b419-4e54-b015-6df9e65e43ed tempest-ProjectReaderTests-227575279 None] Flow 'volume_create_manager' (fb2f2a1f-559b-4a2c-81c5-9c0aa7e2f9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 23:00:34 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-820f6024-b419-4e54-b015-6df9e65e43ed tempest-ProjectReaderTests-227575279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76a3fc94-1591-4cd3-9930-4d4c2daf661a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 23:00:34 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-820f6024-b419-4e54-b015-6df9e65e43ed tempest-ProjectReaderTests-227575279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76a3fc94-1591-4cd3-9930-4d4c2daf661a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T21:00:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-966384406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dad8770-87e4-41e1-b0f4-a5e71502cf25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='667877222c914b398c6cf970dd1276e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T21:00:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T21:00:34Z,use_quota=True,user_id='f8506a79937b4ae6ad4071b24c91a258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 23:00:34 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-820f6024-b419-4e54-b015-6df9e65e43ed tempest-ProjectReaderTests-227575279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81cd00c8-a595-4c10-a5d7-38dee7d1361a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 23:00:34 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-820f6024-b419-4e54-b015-6df9e65e43ed tempest-ProjectReaderTests-227575279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81cd00c8-a595-4c10-a5d7-38dee7d1361a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 23:00:34 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-820f6024-b419-4e54-b015-6df9e65e43ed tempest-ProjectReaderTests-227575279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fee1f38d-16b4-451e-9b6f-b9d8b710eb23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 23:00:34 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-820f6024-b419-4e54-b015-6df9e65e43ed tempest-ProjectReaderTests-227575279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fee1f38d-16b4-451e-9b6f-b9d8b710eb23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0dad8770-87e4-41e1-b0f4-a5e71502cf25', 'volume_name': 'volume-0dad8770-87e4-41e1-b0f4-a5e71502cf25', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 23:00:34 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-820f6024-b419-4e54-b015-6df9e65e43ed tempest-ProjectReaderTests-227575279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1f389f0-2f53-4fc6-b856-1984bec92b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 23:00:34 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-820f6024-b419-4e54-b015-6df9e65e43ed tempest-ProjectReaderTests-227575279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1f389f0-2f53-4fc6-b856-1984bec92b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 23:00:34 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-820f6024-b419-4e54-b015-6df9e65e43ed tempest-ProjectReaderTests-227575279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (352dd4b3-5a90-422b-a84e-6b6790928a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 23:00:34 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-820f6024-b419-4e54-b015-6df9e65e43ed tempest-ProjectReaderTests-227575279 None] Volume 0dad8770-87e4-41e1-b0f4-a5e71502cf25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0dad8770-87e4-41e1-b0f4-a5e71502cf25', 'volume_size': 1} Sep 04 23:00:34 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-820f6024-b419-4e54-b015-6df9e65e43ed tempest-ProjectReaderTests-227575279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 23:00:34 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-820f6024-b419-4e54-b015-6df9e65e43ed tempest-ProjectReaderTests-227575279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 23:00:34 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-820f6024-b419-4e54-b015-6df9e65e43ed tempest-ProjectReaderTests-227575279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T21:00:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-966384406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dad8770-87e4-41e1-b0f4-a5e71502cf25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='667877222c914b398c6cf970dd1276e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T21:00:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T21:00:34Z,use_quota=True,user_id='f8506a79937b4ae6ad4071b24c91a258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 23:00:34 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-820f6024-b419-4e54-b015-6df9e65e43ed tempest-ProjectReaderTests-227575279 None] Creating volume 0dad8770-87e4-41e1-b0f4-a5e71502cf25 {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 23:00:34 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-820f6024-b419-4e54-b015-6df9e65e43ed tempest-ProjectReaderTests-227575279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 23:00:34 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-820f6024-b419-4e54-b015-6df9e65e43ed tempest-ProjectReaderTests-227575279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 23:00:34 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-820f6024-b419-4e54-b015-6df9e65e43ed tempest-ProjectReaderTests-227575279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 23:00:34 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-820f6024-b419-4e54-b015-6df9e65e43ed tempest-ProjectReaderTests-227575279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 23:00:34 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-820f6024-b419-4e54-b015-6df9e65e43ed tempest-ProjectReaderTests-227575279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 23:00:34 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-820f6024-b419-4e54-b015-6df9e65e43ed tempest-ProjectReaderTests-227575279 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 23:00:34 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-820f6024-b419-4e54-b015-6df9e65e43ed tempest-ProjectReaderTests-227575279 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 23:00:34 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-820f6024-b419-4e54-b015-6df9e65e43ed tempest-ProjectReaderTests-227575279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-0dad8770-87e4-41e1-b0f4-a5e71502cf25 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:34 devstack sudo[108255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-0dad8770-87e4-41e1-b0f4-a5e71502cf25 1073741824 Sep 04 23:00:34 devstack sudo[108255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:34 devstack sudo[108255]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:34 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-820f6024-b419-4e54-b015-6df9e65e43ed tempest-ProjectReaderTests-227575279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-0dad8770-87e4-41e1-b0f4-a5e71502cf25 1073741824" returned: 0 in 0.395s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:34 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-820f6024-b419-4e54-b015-6df9e65e43ed tempest-ProjectReaderTests-227575279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-0dad8770-87e4-41e1-b0f4-a5e71502cf25 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:34 devstack sudo[108260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-0dad8770-87e4-41e1-b0f4-a5e71502cf25 Sep 04 23:00:34 devstack sudo[108260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:34 devstack sudo[108260]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:34 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-820f6024-b419-4e54-b015-6df9e65e43ed tempest-ProjectReaderTests-227575279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-0dad8770-87e4-41e1-b0f4-a5e71502cf25" returned: 0 in 0.246s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:34 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-820f6024-b419-4e54-b015-6df9e65e43ed tempest-ProjectReaderTests-227575279 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 23:00:34 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-820f6024-b419-4e54-b015-6df9e65e43ed tempest-ProjectReaderTests-227575279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 23:00:34 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-820f6024-b419-4e54-b015-6df9e65e43ed tempest-ProjectReaderTests-227575279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (352dd4b3-5a90-422b-a84e-6b6790928a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0dad8770-87e4-41e1-b0f4-a5e71502cf25', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 23:00:34 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-820f6024-b419-4e54-b015-6df9e65e43ed tempest-ProjectReaderTests-227575279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91feb27e-7f9f-4f4e-8478-cd79ff54733f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 23:00:34 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-820f6024-b419-4e54-b015-6df9e65e43ed tempest-ProjectReaderTests-227575279 None] Volume volume-0dad8770-87e4-41e1-b0f4-a5e71502cf25 (0dad8770-87e4-41e1-b0f4-a5e71502cf25): created successfully Sep 04 23:00:34 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-820f6024-b419-4e54-b015-6df9e65e43ed tempest-ProjectReaderTests-227575279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91feb27e-7f9f-4f4e-8478-cd79ff54733f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 23:00:34 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-820f6024-b419-4e54-b015-6df9e65e43ed tempest-ProjectReaderTests-227575279 None] Flow 'volume_create_manager' (fb2f2a1f-559b-4a2c-81c5-9c0aa7e2f9be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 23:00:34 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-820f6024-b419-4e54-b015-6df9e65e43ed tempest-ProjectReaderTests-227575279 None] Created volume successfully. Sep 04 23:00:35 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-a1f7f12f-fb29-45d2-b109-88b6ead8cc7f tempest-ProjectReaderTests-227575279 None] Acquiring lock "cinder-0dad8770-87e4-41e1-b0f4-a5e71502cf25-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 23:00:35 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-a1f7f12f-fb29-45d2-b109-88b6ead8cc7f tempest-ProjectReaderTests-227575279 None] Lock "cinder-0dad8770-87e4-41e1-b0f4-a5e71502cf25-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 23:00:35 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-a1f7f12f-fb29-45d2-b109-88b6ead8cc7f tempest-ProjectReaderTests-227575279 None] Acquiring lock "cinder-quobyte-0dad8770-87e4-41e1-b0f4-a5e71502cf25" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 23:00:35 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-a1f7f12f-fb29-45d2-b109-88b6ead8cc7f tempest-ProjectReaderTests-227575279 None] Lock "cinder-quobyte-0dad8770-87e4-41e1-b0f4-a5e71502cf25" acquired by "delete_volume" :: waited 0.013s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 23:00:35 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28c2b08-21cf-4e9d-9eb4-6c7f6c611950]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 23:00:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a1f7f12f-fb29-45d2-b109-88b6ead8cc7f tempest-ProjectReaderTests-227575279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-0dad8770-87e4-41e1-b0f4-a5e71502cf25 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:35 devstack sudo[108263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-0dad8770-87e4-41e1-b0f4-a5e71502cf25 Sep 04 23:00:35 devstack sudo[108263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:35 devstack sudo[108263]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a1f7f12f-fb29-45d2-b109-88b6ead8cc7f tempest-ProjectReaderTests-227575279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-0dad8770-87e4-41e1-b0f4-a5e71502cf25" returned: 0 in 0.356s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a1f7f12f-fb29-45d2-b109-88b6ead8cc7f tempest-ProjectReaderTests-227575279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-0dad8770-87e4-41e1-b0f4-a5e71502cf25 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:35 devstack sudo[108268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-0dad8770-87e4-41e1-b0f4-a5e71502cf25 Sep 04 23:00:35 devstack sudo[108268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:35 devstack sudo[108268]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a1f7f12f-fb29-45d2-b109-88b6ead8cc7f tempest-ProjectReaderTests-227575279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-0dad8770-87e4-41e1-b0f4-a5e71502cf25" returned: 0 in 0.240s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:35 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-a1f7f12f-fb29-45d2-b109-88b6ead8cc7f tempest-ProjectReaderTests-227575279 None] Lock "cinder-quobyte-0dad8770-87e4-41e1-b0f4-a5e71502cf25" released by "delete_volume" :: held 0.630s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 23:00:35 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-a1f7f12f-fb29-45d2-b109-88b6ead8cc7f tempest-ProjectReaderTests-227575279 None] Created reservations ['27556aba-7927-4a17-9732-3760899eec9c', 'cca37b93-7f43-428e-bd9b-3b7f6fb4d104', '75d91090-a11c-4791-99b7-7207d3e5b2b6', '88aa6847-a89d-494e-ab21-d311e0d5db0f'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 23:00:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-a1f7f12f-fb29-45d2-b109-88b6ead8cc7f tempest-ProjectReaderTests-227575279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 23:00:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-a1f7f12f-fb29-45d2-b109-88b6ead8cc7f tempest-ProjectReaderTests-227575279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 23:00:35 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-a1f7f12f-fb29-45d2-b109-88b6ead8cc7f tempest-ProjectReaderTests-227575279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 23:00:35 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-a1f7f12f-fb29-45d2-b109-88b6ead8cc7f tempest-ProjectReaderTests-227575279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 23:00:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-a1f7f12f-fb29-45d2-b109-88b6ead8cc7f tempest-ProjectReaderTests-227575279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 23:00:35 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a1f7f12f-fb29-45d2-b109-88b6ead8cc7f tempest-ProjectReaderTests-227575279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:35 devstack sudo[108271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 23:00:35 devstack sudo[108271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:36 devstack sudo[108271]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:36 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a1f7f12f-fb29-45d2-b109-88b6ead8cc7f tempest-ProjectReaderTests-227575279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.231s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:36 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-a1f7f12f-fb29-45d2-b109-88b6ead8cc7f tempest-ProjectReaderTests-227575279 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 23:00:36 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-a1f7f12f-fb29-45d2-b109-88b6ead8cc7f tempest-ProjectReaderTests-227575279 None] Deleted volume successfully. Sep 04 23:00:36 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-a1f7f12f-fb29-45d2-b109-88b6ead8cc7f tempest-ProjectReaderTests-227575279 None] Lock "cinder-0dad8770-87e4-41e1-b0f4-a5e71502cf25-delete_volume" released by "delete_volume" :: held 1.039s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 23:00:45 devstack cinder-volume[87576]: DEBUG dbcounter [-] [87576] Writing DB stats cinder:SELECT=33,cinder:UPDATE=41,cinder:INSERT=10,cinder:DELETE=2 {{(pid=87576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 23:00:46 devstack cinder-volume[87576]: DEBUG dbcounter [-] [87576] Writing DB stats cinder:UPDATE=26,cinder:SELECT=14,cinder:INSERT=6,cinder:DELETE=3 {{(pid=87576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 23:00:56 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-079ce774-70ee-4caf-95ea-b64c8d21a931 tempest-SnapshotDependencyTests-1242167571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 23:00:56 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-079ce774-70ee-4caf-95ea-b64c8d21a931 tempest-SnapshotDependencyTests-1242167571 None] Flow 'volume_create_manager' (0e0c07c0-fbcc-435d-8e38-424b2736872f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 23:00:56 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-079ce774-70ee-4caf-95ea-b64c8d21a931 tempest-SnapshotDependencyTests-1242167571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89501748-0431-4d27-95d6-d62bc66076e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 23:00:56 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-079ce774-70ee-4caf-95ea-b64c8d21a931 tempest-SnapshotDependencyTests-1242167571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89501748-0431-4d27-95d6-d62bc66076e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T21:00:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-780576974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24e0df16-04c2-442b-a6e0-448b33234cbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a36de25bfe4f4ff3aa97dc08f4a90173',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T21:00:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T21:00:56Z,use_quota=True,user_id='605faa1876ab4978af085c725f6dc130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 23:00:56 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-079ce774-70ee-4caf-95ea-b64c8d21a931 tempest-SnapshotDependencyTests-1242167571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0967ee84-ebfd-41ab-9d9f-4a4f3708def2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 23:00:56 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-079ce774-70ee-4caf-95ea-b64c8d21a931 tempest-SnapshotDependencyTests-1242167571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0967ee84-ebfd-41ab-9d9f-4a4f3708def2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 23:00:56 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-079ce774-70ee-4caf-95ea-b64c8d21a931 tempest-SnapshotDependencyTests-1242167571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04fd923a-e923-4229-ac66-afee0005844f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 23:00:56 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-079ce774-70ee-4caf-95ea-b64c8d21a931 tempest-SnapshotDependencyTests-1242167571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04fd923a-e923-4229-ac66-afee0005844f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24e0df16-04c2-442b-a6e0-448b33234cbb', 'volume_name': 'volume-24e0df16-04c2-442b-a6e0-448b33234cbb', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 23:00:56 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-079ce774-70ee-4caf-95ea-b64c8d21a931 tempest-SnapshotDependencyTests-1242167571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a8eba87-7582-43f8-8e32-48dce69c43c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 23:00:56 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-079ce774-70ee-4caf-95ea-b64c8d21a931 tempest-SnapshotDependencyTests-1242167571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a8eba87-7582-43f8-8e32-48dce69c43c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 23:00:56 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-079ce774-70ee-4caf-95ea-b64c8d21a931 tempest-SnapshotDependencyTests-1242167571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af44a86b-86f0-4011-af3b-8aca55be80a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 23:00:56 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-079ce774-70ee-4caf-95ea-b64c8d21a931 tempest-SnapshotDependencyTests-1242167571 None] Volume 24e0df16-04c2-442b-a6e0-448b33234cbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24e0df16-04c2-442b-a6e0-448b33234cbb', 'volume_size': 1} Sep 04 23:00:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-079ce774-70ee-4caf-95ea-b64c8d21a931 tempest-SnapshotDependencyTests-1242167571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 23:00:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-079ce774-70ee-4caf-95ea-b64c8d21a931 tempest-SnapshotDependencyTests-1242167571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 23:00:56 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-079ce774-70ee-4caf-95ea-b64c8d21a931 tempest-SnapshotDependencyTests-1242167571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T21:00:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-780576974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24e0df16-04c2-442b-a6e0-448b33234cbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a36de25bfe4f4ff3aa97dc08f4a90173',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T21:00:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T21:00:56Z,use_quota=True,user_id='605faa1876ab4978af085c725f6dc130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)}" {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 23:00:56 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-079ce774-70ee-4caf-95ea-b64c8d21a931 tempest-SnapshotDependencyTests-1242167571 None] Creating volume 24e0df16-04c2-442b-a6e0-448b33234cbb {{(pid=87576) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 23:00:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-079ce774-70ee-4caf-95ea-b64c8d21a931 tempest-SnapshotDependencyTests-1242167571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 23:00:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-079ce774-70ee-4caf-95ea-b64c8d21a931 tempest-SnapshotDependencyTests-1242167571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 23:00:56 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-079ce774-70ee-4caf-95ea-b64c8d21a931 tempest-SnapshotDependencyTests-1242167571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 23:00:56 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-079ce774-70ee-4caf-95ea-b64c8d21a931 tempest-SnapshotDependencyTests-1242167571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 23:00:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-079ce774-70ee-4caf-95ea-b64c8d21a931 tempest-SnapshotDependencyTests-1242167571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 23:00:56 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-079ce774-70ee-4caf-95ea-b64c8d21a931 tempest-SnapshotDependencyTests-1242167571 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 23:00:56 devstack cinder-volume[87576]: INFO cinder.volume.drivers.remotefs [None req-079ce774-70ee-4caf-95ea-b64c8d21a931 tempest-SnapshotDependencyTests-1242167571 None] casted to osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 Sep 04 23:00:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-079ce774-70ee-4caf-95ea-b64c8d21a931 tempest-SnapshotDependencyTests-1242167571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-24e0df16-04c2-442b-a6e0-448b33234cbb 1073741824 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:56 devstack sudo[108322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-24e0df16-04c2-442b-a6e0-448b33234cbb 1073741824 Sep 04 23:00:56 devstack sudo[108322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:56 devstack sudo[108322]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-079ce774-70ee-4caf-95ea-b64c8d21a931 tempest-SnapshotDependencyTests-1242167571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-24e0df16-04c2-442b-a6e0-448b33234cbb 1073741824" returned: 0 in 0.399s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:56 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-079ce774-70ee-4caf-95ea-b64c8d21a931 tempest-SnapshotDependencyTests-1242167571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-24e0df16-04c2-442b-a6e0-448b33234cbb {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:56 devstack sudo[108327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-24e0df16-04c2-442b-a6e0-448b33234cbb Sep 04 23:00:56 devstack sudo[108327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:57 devstack sudo[108327]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-079ce774-70ee-4caf-95ea-b64c8d21a931 tempest-SnapshotDependencyTests-1242167571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-24e0df16-04c2-442b-a6e0-448b33234cbb" returned: 0 in 0.231s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:57 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-079ce774-70ee-4caf-95ea-b64c8d21a931 tempest-SnapshotDependencyTests-1242167571 None] <== create_volume: return (671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'} {{(pid=87576) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 23:00:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-079ce774-70ee-4caf-95ea-b64c8d21a931 tempest-SnapshotDependencyTests-1242167571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.674s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 23:00:57 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-079ce774-70ee-4caf-95ea-b64c8d21a931 tempest-SnapshotDependencyTests-1242167571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af44a86b-86f0-4011-af3b-8aca55be80a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24e0df16-04c2-442b-a6e0-448b33234cbb', 'volume_size': 1}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 23:00:57 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-079ce774-70ee-4caf-95ea-b64c8d21a931 tempest-SnapshotDependencyTests-1242167571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3a66566-b36d-4923-a7de-bdb97e6e1136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 23:00:57 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-079ce774-70ee-4caf-95ea-b64c8d21a931 tempest-SnapshotDependencyTests-1242167571 None] Volume volume-24e0df16-04c2-442b-a6e0-448b33234cbb (24e0df16-04c2-442b-a6e0-448b33234cbb): created successfully Sep 04 23:00:57 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-079ce774-70ee-4caf-95ea-b64c8d21a931 tempest-SnapshotDependencyTests-1242167571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3a66566-b36d-4923-a7de-bdb97e6e1136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 23:00:57 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-079ce774-70ee-4caf-95ea-b64c8d21a931 tempest-SnapshotDependencyTests-1242167571 None] Flow 'volume_create_manager' (0e0c07c0-fbcc-435d-8e38-424b2736872f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 23:00:57 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-079ce774-70ee-4caf-95ea-b64c8d21a931 tempest-SnapshotDependencyTests-1242167571 None] Created volume successfully. Sep 04 23:00:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-21036d74-c6db-4689-abec-16839c0d9fe4 tempest-SnapshotDependencyTests-1242167571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 23:00:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-21036d74-c6db-4689-abec-16839c0d9fe4 tempest-SnapshotDependencyTests-1242167571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 23:00:57 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-21036d74-c6db-4689-abec-16839c0d9fe4 tempest-SnapshotDependencyTests-1242167571 None] Creating offline snapshot e61d976f-d2d4-422f-a405-cd78f2f4d0ab of volume 24e0df16-04c2-442b-a6e0-448b33234cbb {{(pid=87576) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 23:00:57 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ecd369f-31ec-4673-8257-4b6a9da8f26a]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 23:00:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-21036d74-c6db-4689-abec-16839c0d9fe4 tempest-SnapshotDependencyTests-1242167571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-24e0df16-04c2-442b-a6e0-448b33234cbb {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:57 devstack sudo[108330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-24e0df16-04c2-442b-a6e0-448b33234cbb Sep 04 23:00:57 devstack sudo[108330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:57 devstack sudo[108330]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-21036d74-c6db-4689-abec-16839c0d9fe4 tempest-SnapshotDependencyTests-1242167571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-24e0df16-04c2-442b-a6e0-448b33234cbb" returned: 0 in 0.346s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:57 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-21036d74-c6db-4689-abec-16839c0d9fe4 tempest-SnapshotDependencyTests-1242167571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-24e0df16-04c2-442b-a6e0-448b33234cbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-24e0df16-04c2-442b-a6e0-448b33234cbb.e61d976f-d2d4-422f-a405-cd78f2f4d0ab 1G {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:57 devstack sudo[108335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-24e0df16-04c2-442b-a6e0-448b33234cbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-24e0df16-04c2-442b-a6e0-448b33234cbb.e61d976f-d2d4-422f-a405-cd78f2f4d0ab 1G Sep 04 23:00:57 devstack sudo[108335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:58 devstack sudo[108335]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-21036d74-c6db-4689-abec-16839c0d9fe4 tempest-SnapshotDependencyTests-1242167571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-24e0df16-04c2-442b-a6e0-448b33234cbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-24e0df16-04c2-442b-a6e0-448b33234cbb.e61d976f-d2d4-422f-a405-cd78f2f4d0ab 1G" returned: 0 in 0.369s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-21036d74-c6db-4689-abec-16839c0d9fe4 tempest-SnapshotDependencyTests-1242167571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24e0df16-04c2-442b-a6e0-448b33234cbb -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-24e0df16-04c2-442b-a6e0-448b33234cbb.e61d976f-d2d4-422f-a405-cd78f2f4d0ab {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:58 devstack sudo[108340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24e0df16-04c2-442b-a6e0-448b33234cbb -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-24e0df16-04c2-442b-a6e0-448b33234cbb.e61d976f-d2d4-422f-a405-cd78f2f4d0ab Sep 04 23:00:58 devstack sudo[108340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:58 devstack sudo[108340]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-21036d74-c6db-4689-abec-16839c0d9fe4 tempest-SnapshotDependencyTests-1242167571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24e0df16-04c2-442b-a6e0-448b33234cbb -F qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-24e0df16-04c2-442b-a6e0-448b33234cbb.e61d976f-d2d4-422f-a405-cd78f2f4d0ab" returned: 0 in 0.273s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:58 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-21036d74-c6db-4689-abec-16839c0d9fe4 tempest-SnapshotDependencyTests-1242167571 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-24e0df16-04c2-442b-a6e0-448b33234cbb.e61d976f-d2d4-422f-a405-cd78f2f4d0ab is being set with open permissions: ugo+rw Sep 04 23:00:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-21036d74-c6db-4689-abec-16839c0d9fe4 tempest-SnapshotDependencyTests-1242167571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-24e0df16-04c2-442b-a6e0-448b33234cbb.e61d976f-d2d4-422f-a405-cd78f2f4d0ab {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:58 devstack sudo[108345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-24e0df16-04c2-442b-a6e0-448b33234cbb.e61d976f-d2d4-422f-a405-cd78f2f4d0ab Sep 04 23:00:58 devstack sudo[108345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:58 devstack sudo[108345]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-21036d74-c6db-4689-abec-16839c0d9fe4 tempest-SnapshotDependencyTests-1242167571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-24e0df16-04c2-442b-a6e0-448b33234cbb.e61d976f-d2d4-422f-a405-cd78f2f4d0ab" returned: 0 in 0.249s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:58 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-21036d74-c6db-4689-abec-16839c0d9fe4 tempest-SnapshotDependencyTests-1242167571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-24e0df16-04c2-442b-a6e0-448b33234cbb.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:58 devstack sudo[108348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-24e0df16-04c2-442b-a6e0-448b33234cbb.info Sep 04 23:00:58 devstack sudo[108348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:59 devstack sudo[108348]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-21036d74-c6db-4689-abec-16839c0d9fe4 tempest-SnapshotDependencyTests-1242167571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-24e0df16-04c2-442b-a6e0-448b33234cbb.info" returned: 0 in 0.256s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:59 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-21036d74-c6db-4689-abec-16839c0d9fe4 tempest-SnapshotDependencyTests-1242167571 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-24e0df16-04c2-442b-a6e0-448b33234cbb.info is being set with open permissions: ugo+rw Sep 04 23:00:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-21036d74-c6db-4689-abec-16839c0d9fe4 tempest-SnapshotDependencyTests-1242167571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-24e0df16-04c2-442b-a6e0-448b33234cbb.info {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:00:59 devstack sudo[108351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-24e0df16-04c2-442b-a6e0-448b33234cbb.info Sep 04 23:00:59 devstack sudo[108351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:00:59 devstack sudo[108351]: pam_unix(sudo:session): session closed for user root Sep 04 23:00:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-21036d74-c6db-4689-abec-16839c0d9fe4 tempest-SnapshotDependencyTests-1242167571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-24e0df16-04c2-442b-a6e0-448b33234cbb.info" returned: 0 in 0.251s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:00:59 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-21036d74-c6db-4689-abec-16839c0d9fe4 tempest-SnapshotDependencyTests-1242167571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.832s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 23:00:59 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-21036d74-c6db-4689-abec-16839c0d9fe4 tempest-SnapshotDependencyTests-1242167571 None] Create snapshot completed successfully Sep 04 23:01:00 devstack cinder-volume[87576]: DEBUG cinder.volume.flows.manager.create_volume [None req-911e68e0-f917-4c08-bbc0-03f291188e9b tempest-SnapshotDependencyTests-1242167571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87576) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 23:01:00 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-911e68e0-f917-4c08-bbc0-03f291188e9b tempest-SnapshotDependencyTests-1242167571 None] Flow 'volume_create_manager' (61b8af04-b628-4b1d-9fd7-7b478da06f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 23:01:00 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-911e68e0-f917-4c08-bbc0-03f291188e9b tempest-SnapshotDependencyTests-1242167571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54d19104-5987-4c6f-bb28-3a0e7d631484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 23:01:00 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-911e68e0-f917-4c08-bbc0-03f291188e9b tempest-SnapshotDependencyTests-1242167571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54d19104-5987-4c6f-bb28-3a0e7d631484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T21:01:00Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94929717-2f54-40b8-ac24-11eae00c2129,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a36de25bfe4f4ff3aa97dc08f4a90173',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T21:01:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e61d976f-d2d4-422f-a405-cd78f2f4d0ab,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T21:01:00Z,use_quota=True,user_id='605faa1876ab4978af085c725f6dc130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250f28d-e7dd-4dcc-8d96-8f0a93084c2d),volume_type_id=9250f28d-e7dd-4dcc-8d96-8f0a93084c2d)' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 23:01:00 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-911e68e0-f917-4c08-bbc0-03f291188e9b tempest-SnapshotDependencyTests-1242167571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87fb37fe-1e9b-4f7a-bad4-ab6bb8196803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 23:01:00 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-911e68e0-f917-4c08-bbc0-03f291188e9b tempest-SnapshotDependencyTests-1242167571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87fb37fe-1e9b-4f7a-bad4-ab6bb8196803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 23:01:00 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-911e68e0-f917-4c08-bbc0-03f291188e9b tempest-SnapshotDependencyTests-1242167571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79e5168e-a94a-4c31-8458-32ea70ab3c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 23:01:00 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-911e68e0-f917-4c08-bbc0-03f291188e9b tempest-SnapshotDependencyTests-1242167571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79e5168e-a94a-4c31-8458-32ea70ab3c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '94929717-2f54-40b8-ac24-11eae00c2129', 'volume_name': 'volume-94929717-2f54-40b8-ac24-11eae00c2129', 'volume_size': 1, 'snapshot_id': 'e61d976f-d2d4-422f-a405-cd78f2f4d0ab'}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 23:01:00 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-911e68e0-f917-4c08-bbc0-03f291188e9b tempest-SnapshotDependencyTests-1242167571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e24e1aaf-11c7-460a-bbd5-3ac2fc967556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 23:01:00 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-911e68e0-f917-4c08-bbc0-03f291188e9b tempest-SnapshotDependencyTests-1242167571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e24e1aaf-11c7-460a-bbd5-3ac2fc967556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 23:01:00 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-911e68e0-f917-4c08-bbc0-03f291188e9b tempest-SnapshotDependencyTests-1242167571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c64682b4-a532-45e8-a6ae-c31117b283e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 23:01:00 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-911e68e0-f917-4c08-bbc0-03f291188e9b tempest-SnapshotDependencyTests-1242167571 None] Volume 94929717-2f54-40b8-ac24-11eae00c2129: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-94929717-2f54-40b8-ac24-11eae00c2129', 'volume_size': 1, 'snapshot_id': 'e61d976f-d2d4-422f-a405-cd78f2f4d0ab'} Sep 04 23:01:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-911e68e0-f917-4c08-bbc0-03f291188e9b tempest-SnapshotDependencyTests-1242167571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 23:01:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-911e68e0-f917-4c08-bbc0-03f291188e9b tempest-SnapshotDependencyTests-1242167571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 23:01:00 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-911e68e0-f917-4c08-bbc0-03f291188e9b tempest-SnapshotDependencyTests-1242167571 None] Acquiring lock "cinder-quobyte-e61d976f-d2d4-422f-a405-cd78f2f4d0ab-94929717-2f54-40b8-ac24-11eae00c2129" by "_create_volume_from_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 23:01:00 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-911e68e0-f917-4c08-bbc0-03f291188e9b tempest-SnapshotDependencyTests-1242167571 None] Lock "cinder-quobyte-e61d976f-d2d4-422f-a405-cd78f2f4d0ab-94929717-2f54-40b8-ac24-11eae00c2129" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 23:01:00 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-911e68e0-f917-4c08-bbc0-03f291188e9b tempest-SnapshotDependencyTests-1242167571 None] Creating volume 94929717-2f54-40b8-ac24-11eae00c2129 from snapshot e61d976f-d2d4-422f-a405-cd78f2f4d0ab {{(pid=87576) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 04 23:01:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-911e68e0-f917-4c08-bbc0-03f291188e9b tempest-SnapshotDependencyTests-1242167571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 23:01:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-911e68e0-f917-4c08-bbc0-03f291188e9b tempest-SnapshotDependencyTests-1242167571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 23:01:00 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-911e68e0-f917-4c08-bbc0-03f291188e9b tempest-SnapshotDependencyTests-1242167571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 23:01:00 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-911e68e0-f917-4c08-bbc0-03f291188e9b tempest-SnapshotDependencyTests-1242167571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 23:01:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-911e68e0-f917-4c08-bbc0-03f291188e9b tempest-SnapshotDependencyTests-1242167571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 23:01:00 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-911e68e0-f917-4c08-bbc0-03f291188e9b tempest-SnapshotDependencyTests-1242167571 None] Selected osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4 as target Quobyte volume. {{(pid=87576) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 23:01:00 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-911e68e0-f917-4c08-bbc0-03f291188e9b tempest-SnapshotDependencyTests-1242167571 None] Acquiring lock "cinder-quobyte-94929717-2f54-40b8-ac24-11eae00c2129" by "_copy_volume_from_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 23:01:00 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-911e68e0-f917-4c08-bbc0-03f291188e9b tempest-SnapshotDependencyTests-1242167571 None] Lock "cinder-quobyte-94929717-2f54-40b8-ac24-11eae00c2129" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 23:01:00 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-911e68e0-f917-4c08-bbc0-03f291188e9b tempest-SnapshotDependencyTests-1242167571 None] snapshot: e61d976f-d2d4-422f-a405-cd78f2f4d0ab, volume: 94929717-2f54-40b8-ac24-11eae00c2129, {{(pid=87576) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 04 23:01:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-911e68e0-f917-4c08-bbc0-03f291188e9b tempest-SnapshotDependencyTests-1242167571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 23:01:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-911e68e0-f917-4c08-bbc0-03f291188e9b tempest-SnapshotDependencyTests-1242167571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 23:01:00 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-911e68e0-f917-4c08-bbc0-03f291188e9b tempest-SnapshotDependencyTests-1242167571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 23:01:00 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-911e68e0-f917-4c08-bbc0-03f291188e9b tempest-SnapshotDependencyTests-1242167571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 23:01:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-911e68e0-f917-4c08-bbc0-03f291188e9b tempest-SnapshotDependencyTests-1242167571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 23:01:00 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1398a8-f192-464c-81e7-f29150875907]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 23:01:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-911e68e0-f917-4c08-bbc0-03f291188e9b tempest-SnapshotDependencyTests-1242167571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-24e0df16-04c2-442b-a6e0-448b33234cbb.e61d976f-d2d4-422f-a405-cd78f2f4d0ab {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:01:00 devstack sudo[108354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-24e0df16-04c2-442b-a6e0-448b33234cbb.e61d976f-d2d4-422f-a405-cd78f2f4d0ab Sep 04 23:01:00 devstack sudo[108354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:01:00 devstack sudo[108354]: pam_unix(sudo:session): session closed for user root Sep 04 23:01:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-911e68e0-f917-4c08-bbc0-03f291188e9b tempest-SnapshotDependencyTests-1242167571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-24e0df16-04c2-442b-a6e0-448b33234cbb.e61d976f-d2d4-422f-a405-cd78f2f4d0ab" returned: 0 in 0.335s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:01:00 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-911e68e0-f917-4c08-bbc0-03f291188e9b tempest-SnapshotDependencyTests-1242167571 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24e0df16-04c2-442b-a6e0-448b33234cbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 23:01:00 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79fc031-f6c7-47e2-a2b2-84fd76ce98ab]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 23:01:00 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-911e68e0-f917-4c08-bbc0-03f291188e9b tempest-SnapshotDependencyTests-1242167571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-24e0df16-04c2-442b-a6e0-448b33234cbb {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:01:00 devstack sudo[108359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-24e0df16-04c2-442b-a6e0-448b33234cbb Sep 04 23:01:00 devstack sudo[108359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:01:01 devstack sudo[108359]: pam_unix(sudo:session): session closed for user root Sep 04 23:01:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-911e68e0-f917-4c08-bbc0-03f291188e9b tempest-SnapshotDependencyTests-1242167571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-24e0df16-04c2-442b-a6e0-448b33234cbb" returned: 0 in 0.351s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:01:01 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-911e68e0-f917-4c08-bbc0-03f291188e9b tempest-SnapshotDependencyTests-1242167571 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-24e0df16-04c2-442b-a6e0-448b33234cbb {{(pid=87576) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 04 23:01:01 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-911e68e0-f917-4c08-bbc0-03f291188e9b tempest-SnapshotDependencyTests-1242167571 None] Creating direct copy from snapshot {{(pid=87576) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 04 23:01:01 devstack cinder-volume[87576]: DEBUG cinder.utils [None req-911e68e0-f917-4c08-bbc0-03f291188e9b tempest-SnapshotDependencyTests-1242167571 None] Path /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94929717-2f54-40b8-ac24-11eae00c2129 not found in is_blk_device check {{(pid=87576) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 04 23:01:01 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-911e68e0-f917-4c08-bbc0-03f291188e9b tempest-SnapshotDependencyTests-1242167571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-24e0df16-04c2-442b-a6e0-448b33234cbb /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94929717-2f54-40b8-ac24-11eae00c2129 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:01:01 devstack sudo[108364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-24e0df16-04c2-442b-a6e0-448b33234cbb /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94929717-2f54-40b8-ac24-11eae00c2129 Sep 04 23:01:01 devstack sudo[108364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:01:05 devstack sudo[108364]: pam_unix(sudo:session): session closed for user root Sep 04 23:01:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-911e68e0-f917-4c08-bbc0-03f291188e9b tempest-SnapshotDependencyTests-1242167571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-24e0df16-04c2-442b-a6e0-448b33234cbb /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94929717-2f54-40b8-ac24-11eae00c2129" returned: 0 in 4.061s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:01:05 devstack cinder-volume[87576]: DEBUG cinder.image.image_utils [None req-911e68e0-f917-4c08-bbc0-03f291188e9b tempest-SnapshotDependencyTests-1242167571 None] Image conversion details: src /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-24e0df16-04c2-442b-a6e0-448b33234cbb, size 1024.00 MB, duration 4.06 sec, destination /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94929717-2f54-40b8-ac24-11eae00c2129 {{(pid=87576) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 23:01:05 devstack cinder-volume[87576]: INFO cinder.image.image_utils [None req-911e68e0-f917-4c08-bbc0-03f291188e9b tempest-SnapshotDependencyTests-1242167571 None] Converted 1024.00 MB image at 252.04 MB/s Sep 04 23:01:05 devstack cinder-volume[87576]: WARNING cinder.volume.drivers.remotefs [None req-911e68e0-f917-4c08-bbc0-03f291188e9b tempest-SnapshotDependencyTests-1242167571 None] /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94929717-2f54-40b8-ac24-11eae00c2129 is being set with open permissions: ugo+rw Sep 04 23:01:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-911e68e0-f917-4c08-bbc0-03f291188e9b tempest-SnapshotDependencyTests-1242167571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94929717-2f54-40b8-ac24-11eae00c2129 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:01:05 devstack sudo[108378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94929717-2f54-40b8-ac24-11eae00c2129 Sep 04 23:01:05 devstack sudo[108378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:01:05 devstack sudo[108378]: pam_unix(sudo:session): session closed for user root Sep 04 23:01:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-911e68e0-f917-4c08-bbc0-03f291188e9b tempest-SnapshotDependencyTests-1242167571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94929717-2f54-40b8-ac24-11eae00c2129" returned: 0 in 0.247s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:01:05 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-911e68e0-f917-4c08-bbc0-03f291188e9b tempest-SnapshotDependencyTests-1242167571 None] Lock "cinder-quobyte-94929717-2f54-40b8-ac24-11eae00c2129" released by "_copy_volume_from_snapshot" :: held 5.066s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 23:01:05 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-911e68e0-f917-4c08-bbc0-03f291188e9b tempest-SnapshotDependencyTests-1242167571 None] Lock "cinder-quobyte-e61d976f-d2d4-422f-a405-cd78f2f4d0ab-94929717-2f54-40b8-ac24-11eae00c2129" released by "_create_volume_from_snapshot" :: held 5.125s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 23:01:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-911e68e0-f917-4c08-bbc0-03f291188e9b tempest-SnapshotDependencyTests-1242167571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.140s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 23:01:05 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-911e68e0-f917-4c08-bbc0-03f291188e9b tempest-SnapshotDependencyTests-1242167571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c64682b4-a532-45e8-a6ae-c31117b283e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94929717-2f54-40b8-ac24-11eae00c2129', 'volume_size': 1, 'snapshot_id': 'e61d976f-d2d4-422f-a405-cd78f2f4d0ab'}' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 23:01:05 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-911e68e0-f917-4c08-bbc0-03f291188e9b tempest-SnapshotDependencyTests-1242167571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdb0bacc-0981-4317-89b5-77d72855aea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 23:01:05 devstack cinder-volume[87576]: INFO cinder.volume.flows.manager.create_volume [None req-911e68e0-f917-4c08-bbc0-03f291188e9b tempest-SnapshotDependencyTests-1242167571 None] Volume volume-94929717-2f54-40b8-ac24-11eae00c2129 (94929717-2f54-40b8-ac24-11eae00c2129): created successfully Sep 04 23:01:05 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-911e68e0-f917-4c08-bbc0-03f291188e9b tempest-SnapshotDependencyTests-1242167571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdb0bacc-0981-4317-89b5-77d72855aea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87576) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 23:01:05 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-911e68e0-f917-4c08-bbc0-03f291188e9b tempest-SnapshotDependencyTests-1242167571 None] Flow 'volume_create_manager' (61b8af04-b628-4b1d-9fd7-7b478da06f1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87576) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 23:01:05 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-911e68e0-f917-4c08-bbc0-03f291188e9b tempest-SnapshotDependencyTests-1242167571 None] Created volume successfully. Sep 04 23:01:05 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f42b3510-55e8-4761-a972-16688065cbc0 tempest-SnapshotDependencyTests-1242167571 None] Acquiring lock "cinder-e61d976f-d2d4-422f-a405-cd78f2f4d0ab-delete_snapshot" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 23:01:05 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f42b3510-55e8-4761-a972-16688065cbc0 tempest-SnapshotDependencyTests-1242167571 None] Lock "cinder-e61d976f-d2d4-422f-a405-cd78f2f4d0ab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 23:01:05 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f42b3510-55e8-4761-a972-16688065cbc0 tempest-SnapshotDependencyTests-1242167571 None] Acquiring lock "cinder-quobyte-24e0df16-04c2-442b-a6e0-448b33234cbb" by "delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 23:01:05 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f42b3510-55e8-4761-a972-16688065cbc0 tempest-SnapshotDependencyTests-1242167571 None] Lock "cinder-quobyte-24e0df16-04c2-442b-a6e0-448b33234cbb" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 23:01:05 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f42b3510-55e8-4761-a972-16688065cbc0 tempest-SnapshotDependencyTests-1242167571 None] Acquiring lock "cinder-quobyte-e61d976f-d2d4-422f-a405-cd78f2f4d0ab" by "_delete_snapshot" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 23:01:05 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f42b3510-55e8-4761-a972-16688065cbc0 tempest-SnapshotDependencyTests-1242167571 None] Lock "cinder-quobyte-e61d976f-d2d4-422f-a405-cd78f2f4d0ab" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 23:01:05 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-f42b3510-55e8-4761-a972-16688065cbc0 tempest-SnapshotDependencyTests-1242167571 None] Deleting offline snapshot e61d976f-d2d4-422f-a405-cd78f2f4d0ab of volume 24e0df16-04c2-442b-a6e0-448b33234cbb {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 23:01:05 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-f42b3510-55e8-4761-a972-16688065cbc0 tempest-SnapshotDependencyTests-1242167571 None] snapshot_file for this snap is: volume-24e0df16-04c2-442b-a6e0-448b33234cbb.e61d976f-d2d4-422f-a405-cd78f2f4d0ab {{(pid=87576) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 23:01:05 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99596f3-c6f9-4885-ae07-824dafba87af]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 23:01:05 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f42b3510-55e8-4761-a972-16688065cbc0 tempest-SnapshotDependencyTests-1242167571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-24e0df16-04c2-442b-a6e0-448b33234cbb.e61d976f-d2d4-422f-a405-cd78f2f4d0ab {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:01:06 devstack sudo[108381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-24e0df16-04c2-442b-a6e0-448b33234cbb.e61d976f-d2d4-422f-a405-cd78f2f4d0ab Sep 04 23:01:06 devstack sudo[108381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:01:06 devstack sudo[108381]: pam_unix(sudo:session): session closed for user root Sep 04 23:01:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f42b3510-55e8-4761-a972-16688065cbc0 tempest-SnapshotDependencyTests-1242167571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-24e0df16-04c2-442b-a6e0-448b33234cbb.e61d976f-d2d4-422f-a405-cd78f2f4d0ab" returned: 0 in 0.348s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:01:06 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.remotefs [None req-f42b3510-55e8-4761-a972-16688065cbc0 tempest-SnapshotDependencyTests-1242167571 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24e0df16-04c2-442b-a6e0-448b33234cbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87576) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 23:01:06 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f486026-63ea-4ffc-96b3-95b0ed936048]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 23:01:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f42b3510-55e8-4761-a972-16688065cbc0 tempest-SnapshotDependencyTests-1242167571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-24e0df16-04c2-442b-a6e0-448b33234cbb {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:01:06 devstack sudo[108386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-24e0df16-04c2-442b-a6e0-448b33234cbb Sep 04 23:01:06 devstack sudo[108386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:01:06 devstack sudo[108386]: pam_unix(sudo:session): session closed for user root Sep 04 23:01:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f42b3510-55e8-4761-a972-16688065cbc0 tempest-SnapshotDependencyTests-1242167571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-24e0df16-04c2-442b-a6e0-448b33234cbb" returned: 0 in 0.510s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:01:06 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f42b3510-55e8-4761-a972-16688065cbc0 tempest-SnapshotDependencyTests-1242167571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-24e0df16-04c2-442b-a6e0-448b33234cbb.e61d976f-d2d4-422f-a405-cd78f2f4d0ab {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:01:06 devstack sudo[108391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-24e0df16-04c2-442b-a6e0-448b33234cbb.e61d976f-d2d4-422f-a405-cd78f2f4d0ab Sep 04 23:01:06 devstack sudo[108391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:01:07 devstack sudo[108391]: pam_unix(sudo:session): session closed for user root Sep 04 23:01:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f42b3510-55e8-4761-a972-16688065cbc0 tempest-SnapshotDependencyTests-1242167571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-24e0df16-04c2-442b-a6e0-448b33234cbb.e61d976f-d2d4-422f-a405-cd78f2f4d0ab" returned: 0 in 0.321s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:01:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f42b3510-55e8-4761-a972-16688065cbc0 tempest-SnapshotDependencyTests-1242167571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-24e0df16-04c2-442b-a6e0-448b33234cbb.e61d976f-d2d4-422f-a405-cd78f2f4d0ab {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:01:07 devstack sudo[108396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-24e0df16-04c2-442b-a6e0-448b33234cbb.e61d976f-d2d4-422f-a405-cd78f2f4d0ab Sep 04 23:01:07 devstack sudo[108396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:01:07 devstack sudo[108396]: pam_unix(sudo:session): session closed for user root Sep 04 23:01:07 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-f42b3510-55e8-4761-a972-16688065cbc0 tempest-SnapshotDependencyTests-1242167571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-24e0df16-04c2-442b-a6e0-448b33234cbb.e61d976f-d2d4-422f-a405-cd78f2f4d0ab" returned: 0 in 0.258s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:01:07 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f42b3510-55e8-4761-a972-16688065cbc0 tempest-SnapshotDependencyTests-1242167571 None] Lock "cinder-quobyte-e61d976f-d2d4-422f-a405-cd78f2f4d0ab" released by "_delete_snapshot" :: held 1.528s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 23:01:07 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f42b3510-55e8-4761-a972-16688065cbc0 tempest-SnapshotDependencyTests-1242167571 None] Lock "cinder-quobyte-24e0df16-04c2-442b-a6e0-448b33234cbb" released by "delete_snapshot" :: held 1.549s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 23:01:07 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-f42b3510-55e8-4761-a972-16688065cbc0 tempest-SnapshotDependencyTests-1242167571 None] Created reservations ['64ac6a60-8355-4c2c-8f64-13c09e836988', '28dd7bd7-dcfc-4b85-8502-58053fea3fa9', '071a0cfb-81e8-4592-95ed-fdf0fefdd07c', '7f7d7718-5f6b-40b1-9734-e44a5fbcee0b'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 23:01:07 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-f42b3510-55e8-4761-a972-16688065cbc0 tempest-SnapshotDependencyTests-1242167571 None] Delete snapshot completed successfully. Sep 04 23:01:07 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-f42b3510-55e8-4761-a972-16688065cbc0 tempest-SnapshotDependencyTests-1242167571 None] Lock "cinder-e61d976f-d2d4-422f-a405-cd78f2f4d0ab-delete_snapshot" released by "delete_snapshot" :: held 1.688s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 23:01:08 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-342108c2-9fa4-40aa-81bb-ca1c3f5bacec tempest-SnapshotDependencyTests-1242167571 None] Acquiring lock "cinder-24e0df16-04c2-442b-a6e0-448b33234cbb-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 23:01:08 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-342108c2-9fa4-40aa-81bb-ca1c3f5bacec tempest-SnapshotDependencyTests-1242167571 None] Lock "cinder-24e0df16-04c2-442b-a6e0-448b33234cbb-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 23:01:08 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-342108c2-9fa4-40aa-81bb-ca1c3f5bacec tempest-SnapshotDependencyTests-1242167571 None] Acquiring lock "cinder-quobyte-24e0df16-04c2-442b-a6e0-448b33234cbb" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 23:01:08 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-342108c2-9fa4-40aa-81bb-ca1c3f5bacec tempest-SnapshotDependencyTests-1242167571 None] Lock "cinder-quobyte-24e0df16-04c2-442b-a6e0-448b33234cbb" acquired by "delete_volume" :: waited 0.016s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 23:01:08 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc568e0-bdca-436e-ad76-8d7acc26306b]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 23:01:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-342108c2-9fa4-40aa-81bb-ca1c3f5bacec tempest-SnapshotDependencyTests-1242167571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-24e0df16-04c2-442b-a6e0-448b33234cbb {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:01:08 devstack sudo[108399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-24e0df16-04c2-442b-a6e0-448b33234cbb Sep 04 23:01:08 devstack sudo[108399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:01:08 devstack sudo[108399]: pam_unix(sudo:session): session closed for user root Sep 04 23:01:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-342108c2-9fa4-40aa-81bb-ca1c3f5bacec tempest-SnapshotDependencyTests-1242167571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-24e0df16-04c2-442b-a6e0-448b33234cbb" returned: 0 in 0.365s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:01:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-342108c2-9fa4-40aa-81bb-ca1c3f5bacec tempest-SnapshotDependencyTests-1242167571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-24e0df16-04c2-442b-a6e0-448b33234cbb {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:01:08 devstack sudo[108404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-24e0df16-04c2-442b-a6e0-448b33234cbb Sep 04 23:01:08 devstack sudo[108404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:01:08 devstack sudo[108404]: pam_unix(sudo:session): session closed for user root Sep 04 23:01:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-342108c2-9fa4-40aa-81bb-ca1c3f5bacec tempest-SnapshotDependencyTests-1242167571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-24e0df16-04c2-442b-a6e0-448b33234cbb" returned: 0 in 0.243s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:01:08 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-342108c2-9fa4-40aa-81bb-ca1c3f5bacec tempest-SnapshotDependencyTests-1242167571 None] Lock "cinder-quobyte-24e0df16-04c2-442b-a6e0-448b33234cbb" released by "delete_volume" :: held 0.663s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 23:01:08 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-342108c2-9fa4-40aa-81bb-ca1c3f5bacec tempest-SnapshotDependencyTests-1242167571 None] Created reservations ['6660a912-8dc2-4c6d-906c-9fbf3e6fbcb1', '9c851030-472a-44c7-9dff-e9d120950903', '024e6ba5-74c6-4f6d-b5ad-7f85637a7d95', '294f7158-bcae-4934-bc39-9e4a55cebb10'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 23:01:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-342108c2-9fa4-40aa-81bb-ca1c3f5bacec tempest-SnapshotDependencyTests-1242167571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 23:01:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-342108c2-9fa4-40aa-81bb-ca1c3f5bacec tempest-SnapshotDependencyTests-1242167571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 23:01:08 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-342108c2-9fa4-40aa-81bb-ca1c3f5bacec tempest-SnapshotDependencyTests-1242167571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 23:01:08 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-342108c2-9fa4-40aa-81bb-ca1c3f5bacec tempest-SnapshotDependencyTests-1242167571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 23:01:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-342108c2-9fa4-40aa-81bb-ca1c3f5bacec tempest-SnapshotDependencyTests-1242167571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 23:01:08 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-342108c2-9fa4-40aa-81bb-ca1c3f5bacec tempest-SnapshotDependencyTests-1242167571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:01:08 devstack sudo[108407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 23:01:08 devstack sudo[108407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:01:09 devstack sudo[108407]: pam_unix(sudo:session): session closed for user root Sep 04 23:01:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-342108c2-9fa4-40aa-81bb-ca1c3f5bacec tempest-SnapshotDependencyTests-1242167571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.245s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:01:09 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-342108c2-9fa4-40aa-81bb-ca1c3f5bacec tempest-SnapshotDependencyTests-1242167571 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 23:01:09 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-342108c2-9fa4-40aa-81bb-ca1c3f5bacec tempest-SnapshotDependencyTests-1242167571 None] Deleted volume successfully. Sep 04 23:01:09 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-342108c2-9fa4-40aa-81bb-ca1c3f5bacec tempest-SnapshotDependencyTests-1242167571 None] Lock "cinder-24e0df16-04c2-442b-a6e0-448b33234cbb-delete_volume" released by "delete_volume" :: held 1.102s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 23:01:09 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-a041cb16-0950-4ae1-b3ca-4dbbcb0973b9 tempest-SnapshotDependencyTests-1242167571 None] Acquiring lock "cinder-94929717-2f54-40b8-ac24-11eae00c2129-delete_volume" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 23:01:09 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-a041cb16-0950-4ae1-b3ca-4dbbcb0973b9 tempest-SnapshotDependencyTests-1242167571 None] Lock "cinder-94929717-2f54-40b8-ac24-11eae00c2129-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 23:01:09 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-a041cb16-0950-4ae1-b3ca-4dbbcb0973b9 tempest-SnapshotDependencyTests-1242167571 None] Acquiring lock "cinder-quobyte-94929717-2f54-40b8-ac24-11eae00c2129" by "delete_volume" {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 23:01:09 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-a041cb16-0950-4ae1-b3ca-4dbbcb0973b9 tempest-SnapshotDependencyTests-1242167571 None] Lock "cinder-quobyte-94929717-2f54-40b8-ac24-11eae00c2129" acquired by "delete_volume" :: waited 0.013s {{(pid=87576) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 23:01:09 devstack cinder-volume[87576]: DEBUG oslo.privsep.daemon [-] privsep: reply[64220485-4fed-4528-83e2-d79d85eb4251]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 23:01:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a041cb16-0950-4ae1-b3ca-4dbbcb0973b9 tempest-SnapshotDependencyTests-1242167571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94929717-2f54-40b8-ac24-11eae00c2129 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:01:09 devstack sudo[108410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94929717-2f54-40b8-ac24-11eae00c2129 Sep 04 23:01:09 devstack sudo[108410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:01:09 devstack sudo[108410]: pam_unix(sudo:session): session closed for user root Sep 04 23:01:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a041cb16-0950-4ae1-b3ca-4dbbcb0973b9 tempest-SnapshotDependencyTests-1242167571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94929717-2f54-40b8-ac24-11eae00c2129" returned: 0 in 0.347s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:01:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a041cb16-0950-4ae1-b3ca-4dbbcb0973b9 tempest-SnapshotDependencyTests-1242167571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94929717-2f54-40b8-ac24-11eae00c2129 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:01:09 devstack sudo[108415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94929717-2f54-40b8-ac24-11eae00c2129 Sep 04 23:01:09 devstack sudo[108415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:01:09 devstack sudo[108415]: pam_unix(sudo:session): session closed for user root Sep 04 23:01:09 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a041cb16-0950-4ae1-b3ca-4dbbcb0973b9 tempest-SnapshotDependencyTests-1242167571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3/volume-94929717-2f54-40b8-ac24-11eae00c2129" returned: 0 in 0.249s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:01:09 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-a041cb16-0950-4ae1-b3ca-4dbbcb0973b9 tempest-SnapshotDependencyTests-1242167571 None] Lock "cinder-quobyte-94929717-2f54-40b8-ac24-11eae00c2129" released by "delete_volume" :: held 0.634s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 23:01:09 devstack cinder-volume[87576]: DEBUG cinder.quota [None req-a041cb16-0950-4ae1-b3ca-4dbbcb0973b9 tempest-SnapshotDependencyTests-1242167571 None] Created reservations ['bacc0b06-22ac-48fb-a175-25dbb9f56aef', '1c5f50ce-c519-4614-8af2-1ecfb3a06eb9', '6724aa1d-e253-4c8f-b058-afc481baf01f', '2ac40482-e599-43d2-8207-ad568769c0f2'] {{(pid=87576) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 23:01:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-a041cb16-0950-4ae1-b3ca-4dbbcb0973b9 tempest-SnapshotDependencyTests-1242167571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 23:01:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-a041cb16-0950-4ae1-b3ca-4dbbcb0973b9 tempest-SnapshotDependencyTests-1242167571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 23:01:10 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-a041cb16-0950-4ae1-b3ca-4dbbcb0973b9 tempest-SnapshotDependencyTests-1242167571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 23:01:10 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-a041cb16-0950-4ae1-b3ca-4dbbcb0973b9 tempest-SnapshotDependencyTests-1242167571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 23:01:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-a041cb16-0950-4ae1-b3ca-4dbbcb0973b9 tempest-SnapshotDependencyTests-1242167571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 23:01:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a041cb16-0950-4ae1-b3ca-4dbbcb0973b9 tempest-SnapshotDependencyTests-1242167571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:01:10 devstack sudo[108419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 23:01:10 devstack sudo[108419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:01:10 devstack sudo[108419]: pam_unix(sudo:session): session closed for user root Sep 04 23:01:10 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-a041cb16-0950-4ae1-b3ca-4dbbcb0973b9 tempest-SnapshotDependencyTests-1242167571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.252s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:01:10 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-a041cb16-0950-4ae1-b3ca-4dbbcb0973b9 tempest-SnapshotDependencyTests-1242167571 None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 23:01:10 devstack cinder-volume[87576]: INFO cinder.volume.manager [None req-a041cb16-0950-4ae1-b3ca-4dbbcb0973b9 tempest-SnapshotDependencyTests-1242167571 None] Deleted volume successfully. Sep 04 23:01:10 devstack cinder-volume[87576]: DEBUG cinder.coordination [None req-a041cb16-0950-4ae1-b3ca-4dbbcb0973b9 tempest-SnapshotDependencyTests-1242167571 None] Lock "cinder-94929717-2f54-40b8-ac24-11eae00c2129-delete_volume" released by "delete_volume" :: held 1.106s {{(pid=87576) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 23:01:11 devstack cinder-volume[87576]: DEBUG oslo_service.periodic_task [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87576) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 23:01:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 23:01:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 23:01:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4': None} {{(pid=87576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 23:01:11 devstack cinder-volume[87576]: DEBUG cinder.volume.drivers.quobyte [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-65ca5e92-2dbb-49ee-aba7-c65123ce5fd4'] {{(pid=87576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 23:01:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.lockutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87576) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 23:01:11 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 23:01:11 devstack sudo[108423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3 Sep 04 23:01:11 devstack sudo[108423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 23:01:12 devstack sudo[108423]: pam_unix(sudo:session): session closed for user root Sep 04 23:01:12 devstack cinder-volume[87576]: DEBUG oslo_concurrency.processutils [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e87180ca0c6f2aa3cfcf6964ffaa1cb3" returned: 0 in 0.253s {{(pid=87576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 23:01:12 devstack cinder-volume[87576]: DEBUG cinder.manager [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Notifying Schedulers of capabilities ... {{(pid=87576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 23:01:12 devstack cinder-volume[87576]: DEBUG oslo_service.periodic_task [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] Running periodic task VolumeManager._thread_info {{(pid=87576) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 23:01:12 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] thread count: 28 {{(pid=87576) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 23:01:12 devstack cinder-volume[87576]: DEBUG cinder.volume.manager [None req-96c69745-6589-4b9f-b8c9-d37cdef16a64 None None] thread info: [<_MainThread(MainThread, started 125730416963712)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87576) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 23:01:19 devstack cinder-volume[87576]: DEBUG dbcounter [-] [87576] Writing DB stats cinder:SELECT=24,cinder:UPDATE=22,cinder:INSERT=8,cinder:DELETE=2 {{(pid=87576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 23:01:20 devstack cinder-volume[87576]: DEBUG dbcounter [-] [87576] Writing DB stats cinder:UPDATE=36,cinder:SELECT=25,cinder:INSERT=7,cinder:DELETE=3 {{(pid=87576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}